2024-06-02T16:31:58.137 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-06-02T16:31:58.138 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} -- /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/orig.config.yaml 2024-06-02T16:31:58.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T16:31:58.266 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7720992' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: b7328fed0e2e9ab66b09f8134f3cebfc71214504 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b7328fed0e2e9ab66b09f8134f3cebfc71214504 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 7aec00165b4b073a25396fd0279151d2b2fa23fe owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6827 sha1: b7328fed0e2e9ab66b09f8134f3cebfc71214504 sleep_before_teardown: 0 subset: 382/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7aec00165b4b073a25396fd0279151d2b2fa23fe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5GE6YoqUBP0ncobsyouAxYllfuMWwGiN2SISInS7wnj1eA2mS3pO/6vFqCGz6RMDzdBrTbT0MHHks9GYRhBBw= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInQY9SYK8j4ZrGvDvSMUZgSrY0sWmcj7AHTG71ToFO6CP4MCJsel22BfAd/+fHspFcFt8tBFdEtUVoY0jFC9yk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-22_20:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T16:31:58.266 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa; will attempt to use it 2024-06-02T16:31:58.267 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks 2024-06-02T16:31:58.267 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T16:31:58.269 INFO:teuthology.task.internal:Checking packages... 2024-06-02T16:31:58.290 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b7328fed0e2e9ab66b09f8134f3cebfc71214504' 2024-06-02T16:31:58.290 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T16:31:58.290 INFO:teuthology.packaging:ref: None 2024-06-02T16:31:58.291 INFO:teuthology.packaging:tag: None 2024-06-02T16:31:58.291 INFO:teuthology.packaging:branch: main 2024-06-02T16:31:58.291 INFO:teuthology.packaging:sha1: b7328fed0e2e9ab66b09f8134f3cebfc71214504 2024-06-02T16:31:58.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-06-02T16:31:58.516 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-4019.g17c6b5a1 2024-06-02T16:31:58.517 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T16:31:58.524 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T16:31:58.524 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T16:31:58.569 INFO:teuthology.task.internal:Saving configuration 2024-06-02T16:31:58.586 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T16:31:58.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T16:31:58.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 16:27:04.642904', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5GE6YoqUBP0ncobsyouAxYllfuMWwGiN2SISInS7wnj1eA2mS3pO/6vFqCGz6RMDzdBrTbT0MHHks9GYRhBBw='} 2024-06-02T16:31:58.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 16:27:04.644347', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInQY9SYK8j4ZrGvDvSMUZgSrY0sWmcj7AHTG71ToFO6CP4MCJsel22BfAd/+fHspFcFt8tBFdEtUVoY0jFC9yk='} 2024-06-02T16:31:58.650 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T16:31:58.658 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-06-02T16:31:58.658 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-06-02T16:31:58.658 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T16:31:58.740 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56ec97bbe0>, signals=[15]) 2024-06-02T16:31:58.740 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T16:31:58.746 INFO:teuthology.task.internal:Opening connections... 2024-06-02T16:31:58.746 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:31:58.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:31:58.824 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:31:58.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:31:58.902 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T16:31:58.908 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-06-02T16:31:58.927 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-06-02T16:31:58.927 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-06-02T16:31:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T16:31:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T16:31:58.987 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-06-02T16:31:59.012 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-06-02T16:31:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-06-02T16:31:59.031 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T16:31:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T16:31:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T16:31:59.091 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-06-02T16:31:59.113 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T16:31:59.122 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T16:31:59.153 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T16:31:59.153 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-06-02T16:31:59.155 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-06-02T16:31:59.171 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T16:31:59.203 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T16:31:59.203 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-06-02T16:31:59.212 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-06-02T16:31:59.233 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T16:31:59.284 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T16:31:59.300 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-02T16:31:59.300 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-06-02T16:31:59.301 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-06-02T16:31:59.301 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T16:31:59.301 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T16:31:59.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:31:59.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-02T16:31:59.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:31:59.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-02T16:31:59.484 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:31:59.484 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-06-02T16:31:59.485 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-06-02T16:31:59.502 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-437.el9.x86_64 2024-06-02T16:31:59.503 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:31:59.503 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-02T16:31:59.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum upgrade -y linux-firmware 2024-06-02T16:31:59.570 DEBUG:teuthology.task.kernel:sha1 for client.1 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:31:59.570 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-06-02T16:31:59.570 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-06-02T16:31:59.587 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-437.el9.x86_64 2024-06-02T16:31:59.587 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:31:59.587 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-02T16:31:59.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum upgrade -y linux-firmware 2024-06-02T16:32:01.837 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-02T16:32:02.910 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.1 MB 00:01 2024-06-02T16:32:05.278 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-06-02T16:32:08.455 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 19 MB 00:05 2024-06-02T16:32:09.346 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-06-02T16:32:11.696 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 17 kB 00:01 2024-06-02T16:32:12.697 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-06-02T16:32:13.756 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-06-02T16:32:14.147 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 17 kB 00:00 2024-06-02T16:32:15.933 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-06-02T16:32:19.014 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-06-02T16:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-06-02T16:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-06-02T16:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-06-02T16:32:21.268 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-06-02T16:32:21.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:32:21.317 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-06-02T16:32:21.488 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-06-02T16:32:21.488 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-02T16:32:21.491 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-06-02T16:32:23.526 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-06-02T16:32:23.527 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-06-02T16:32:23.527 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-06-02T16:32:23.625 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-02T16:32:23.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T16:32:23.872 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-06-02T16:32:23.872 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-02T16:32:23.875 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi052.front.sepia.ceph.com to complete... 2024-06-02T16:32:48.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02 16:32:48 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-02T16:32:48.816 INFO:teuthology.orchestra.run.smithi052.stderr:FINISHED --2024-06-02 16:32:48-- 2024-06-02T16:32:48.816 INFO:teuthology.orchestra.run.smithi052.stderr:Total wall clock time: 25s 2024-06-02T16:32:48.816 INFO:teuthology.orchestra.run.smithi052.stderr:Downloaded: 1 files, 340M in 25s (13.8 MB/s) 2024-06-02T16:32:48.819 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-02T16:32:48.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-02T16:32:51.009 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying... ######################################## 2024-06-02T16:32:51.130 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing... ######################################## 2024-06-02T16:32:51.241 INFO:teuthology.orchestra.run.smithi052.stdout:Updating / installing... 2024-06-02T16:32:59.509 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-06-02T16:33:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02 16:33:07 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-02T16:33:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2024-06-02 16:33:07-- 2024-06-02T16:33:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 46s 2024-06-02T16:33:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 340M in 45s (7.52 MB/s) 2024-06-02T16:33:07.304 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-06-02T16:33:07.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-02T16:33:09.390 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying... ######################################## 2024-06-02T16:33:09.559 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing... ######################################## 2024-06-02T16:33:09.674 INFO:teuthology.orchestra.run.smithi114.stdout:Updating / installing... 2024-06-02T16:33:17.600 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-06-02T16:33:37.317 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-02T16:33:37.317 DEBUG:teuthology.orchestra.run.smithi052:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-02T16:33:37.403 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-06-02T16:33:37.403 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/config-6.9.0-gb9459a26b088 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-02T16:33:37.404 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-02T16:33:37.405 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-06-02T16:33:37.406 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-06-02T16:33:37.407 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-06-02T16:33:37.408 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-06-02T16:33:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-06-02T16:33:37.410 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-06-02T16:33:37.411 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-02T16:33:37.412 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-02T16:33:37.413 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-06-02T16:33:37.414 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-06-02T16:33:37.415 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-06-02T16:33:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-06-02T16:33:37.417 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-06-02T16:33:37.418 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-02T16:33:37.419 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-02T16:33:37.420 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-06-02T16:33:37.421 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-06-02T16:33:37.422 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-06-02T16:33:37.423 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-06-02T16:33:37.424 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-06-02T16:33:37.425 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-02T16:33:37.426 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-02T16:33:37.427 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-06-02T16:33:37.428 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-06-02T16:33:37.429 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-02T16:33:37.430 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-06-02T16:33:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-06-02T16:33:37.432 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-06-02T16:33:37.433 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-06-02T16:33:37.434 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-06-02T16:33:37.435 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-06-02T16:33:37.436 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-02T16:33:37.437 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-06-02T16:33:37.438 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-06-02T16:33:37.439 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-02T16:33:37.440 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-02T16:33:37.441 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-06-02T16:33:37.442 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-06-02T16:33:37.443 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-02T16:33:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-02T16:33:37.445 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-06-02T16:33:37.446 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-02T16:33:37.447 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-06-02T16:33:37.448 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-06-02T16:33:37.449 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-06-02T16:33:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-06-02T16:33:37.451 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-06-02T16:33:37.452 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-06-02T16:33:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-06-02T16:33:37.454 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-02T16:33:37.455 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-02T16:33:37.456 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-06-02T16:33:37.457 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-02T16:33:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-02T16:33:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-02T16:33:37.460 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-06-02T16:33:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-06-02T16:33:37.462 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-06-02T16:33:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-02T16:33:37.464 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-06-02T16:33:37.465 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-02T16:33:37.466 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-02T16:33:37.467 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-06-02T16:33:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-06-02T16:33:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-06-02T16:33:37.470 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-02T16:33:37.471 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-02T16:33:37.472 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-02T16:33:37.473 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-06-02T16:33:37.474 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-02T16:33:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-06-02T16:33:37.476 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-06-02T16:33:37.477 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-06-02T16:33:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-02T16:33:37.479 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-02T16:33:37.480 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-06-02T16:33:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-02T16:33:37.482 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-02T16:33:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-02T16:33:37.484 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-06-02T16:33:37.485 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-02T16:33:37.486 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-02T16:33:37.487 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-02T16:33:37.488 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-06-02T16:33:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-02T16:33:37.490 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-06-02T16:33:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-06-02T16:33:37.492 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-02T16:33:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-06-02T16:33:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-06-02T16:33:37.495 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-02T16:33:37.496 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-06-02T16:33:37.497 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-06-02T16:33:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-02T16:33:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-02T16:33:37.500 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-06-02T16:33:37.501 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-06-02T16:33:37.502 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-06-02T16:33:37.503 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-06-02T16:33:37.504 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-02T16:33:37.505 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-06-02T16:33:37.506 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-06-02T16:33:37.507 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-06-02T16:33:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-06-02T16:33:37.509 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-06-02T16:33:37.510 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-06-02T16:33:37.511 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-06-02T16:33:37.512 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-06-02T16:33:37.513 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-06-02T16:33:37.514 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-02T16:33:37.515 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-06-02T16:33:37.516 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-06-02T16:33:37.517 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-06-02T16:33:37.518 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-02T16:33:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-02T16:33:37.520 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-06-02T16:33:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-02T16:33:37.522 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-02T16:33:37.523 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-06-02T16:33:37.524 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-06-02T16:33:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-02T16:33:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-02T16:33:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-06-02T16:33:37.528 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-06-02T16:33:37.529 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-02T16:33:37.530 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-02T16:33:37.531 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-06-02T16:33:37.532 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-02T16:33:37.533 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-02T16:33:37.534 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-02T16:33:37.535 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-02T16:33:37.536 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-02T16:33:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-06-02T16:33:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-02T16:33:37.539 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-06-02T16:33:37.540 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-06-02T16:33:37.541 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-06-02T16:33:37.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-06-02T16:33:37.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-06-02T16:33:37.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-06-02T16:33:37.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-06-02T16:33:37.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-06-02T16:33:37.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-06-02T16:33:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-02T16:33:37.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-06-02T16:33:37.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-06-02T16:33:37.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-06-02T16:33:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T16:33:37.556 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-06-02T16:33:37.556 DEBUG:teuthology.orchestra.run.smithi052:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-02T16:33:37.579 INFO:teuthology.orchestra.run.smithi052.stdout:postinstall scriptlet (using /bin/sh): 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:for file in vmlinuz System.map config; do 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: fi 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T16:33:37.580 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-06-02T16:33:37.581 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-06-02T16:33:37.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-06-02T16:33:37.655 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-06-02T16:33:37.655 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-06-02T16:33:37.655 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-06-02T16:33:37.655 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 68.el9 2024-06-02T16:33:37.655 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8264254 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-06-02T16:33:37.656 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:33:37.657 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T16:33:37.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T16:33:37.658 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 6.9.0-gb9459a26b088 2024-06-02T16:33:37.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T16:33:38.153 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-06-02T16:33:39.645 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T16:33:39.660 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-06-02T16:33:39.662 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-06-02T16:33:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.JetKfDMdde 2024-06-02T16:33:39.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JetKfDMdde 2024-06-02T16:33:39.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.JetKfDMdde 2024-06-02T16:33:39.879 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.JetKfDMdde is 6KB 2024-06-02T16:33:39.928 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.JetKfDMdde 2024-06-02T16:33:39.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T16:33:40.015 INFO:teuthology.orchestra.run.smithi052.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T16:33:40.015 INFO:teuthology.orchestra.run.smithi052.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T16:33:40.015 INFO:teuthology.orchestra.run.smithi052.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T16:33:40.015 INFO:teuthology.orchestra.run.smithi052.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-06-02T16:33:40.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-06-02T16:33:40.174 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-06-02T16:33:55.144 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-02T16:33:55.144 DEBUG:teuthology.orchestra.run.smithi114:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/config-6.9.0-gb9459a26b088 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-06-02T16:33:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-02T16:33:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-02T16:33:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-02T16:33:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-06-02T16:33:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-06-02T16:33:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-06-02T16:33:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-06-02T16:33:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-06-02T16:33:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-06-02T16:33:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-06-02T16:33:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-02T16:33:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-06-02T16:33:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-06-02T16:33:55.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-06-02T16:33:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-06-02T16:33:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-06-02T16:33:55.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-02T16:33:55.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-06-02T16:33:55.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-02T16:33:55.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-06-02T16:33:55.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-06-02T16:33:55.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-06-02T16:33:55.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-06-02T16:33:55.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-02T16:33:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-02T16:33:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-06-02T16:33:55.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-06-02T16:33:55.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-06-02T16:33:55.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-06-02T16:33:55.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-06-02T16:33:55.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-06-02T16:33:55.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-06-02T16:33:55.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-06-02T16:33:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-06-02T16:33:55.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-02T16:33:55.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-06-02T16:33:55.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-06-02T16:33:55.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-06-02T16:33:55.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-02T16:33:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-06-02T16:33:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-02T16:33:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-02T16:33:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-06-02T16:33:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-06-02T16:33:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-06-02T16:33:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-06-02T16:33:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-06-02T16:33:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-06-02T16:33:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-06-02T16:33:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-06-02T16:33:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-02T16:33:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-02T16:33:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-02T16:33:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-02T16:33:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-02T16:33:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-02T16:33:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-02T16:33:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-02T16:33:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-06-02T16:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-02T16:33:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-06-02T16:33:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-06-02T16:33:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-06-02T16:33:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-02T16:33:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-06-02T16:33:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-02T16:33:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-02T16:33:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-06-02T16:33:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-06-02T16:33:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-02T16:33:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-06-02T16:33:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-06-02T16:33:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-02T16:33:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-02T16:33:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-02T16:33:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-06-02T16:33:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-06-02T16:33:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-02T16:33:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-02T16:33:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-02T16:33:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-02T16:33:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-02T16:33:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-06-02T16:33:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-06-02T16:33:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-02T16:33:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-02T16:33:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-06-02T16:33:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-06-02T16:33:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-02T16:33:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-06-02T16:33:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-02T16:33:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-06-02T16:33:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-06-02T16:33:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-02T16:33:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-06-02T16:33:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-06-02T16:33:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-06-02T16:33:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-06-02T16:33:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-06-02T16:33:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-06-02T16:33:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-06-02T16:33:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-02T16:33:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-02T16:33:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-06-02T16:33:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-02T16:33:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-02T16:33:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-02T16:33:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-02T16:33:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-06-02T16:33:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-06-02T16:33:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-06-02T16:33:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-06-02T16:33:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-06-02T16:33:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-02T16:33:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-06-02T16:33:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-06-02T16:33:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-06-02T16:33:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-06-02T16:33:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-06-02T16:33:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-06-02T16:33:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-06-02T16:33:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-06-02T16:33:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-06-02T16:33:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-06-02T16:33:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-06-02T16:33:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-06-02T16:33:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-06-02T16:33:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-02T16:33:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-02T16:33:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-06-02T16:33:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-02T16:33:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-06-02T16:33:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-02T16:33:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-06-02T16:33:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-06-02T16:33:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-02T16:33:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-02T16:33:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-06-02T16:33:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-02T16:33:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-02T16:33:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-02T16:33:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-02T16:33:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-02T16:33:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-06-02T16:33:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-06-02T16:33:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-06-02T16:33:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-06-02T16:33:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-06-02T16:33:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-06-02T16:33:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-06-02T16:33:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-06-02T16:33:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-06-02T16:33:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-06-02T16:33:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-06-02T16:33:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-06-02T16:33:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-06-02T16:33:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-02T16:33:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-06-02T16:33:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-06-02T16:33:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-06-02T16:33:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-06-02T16:33:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-06-02T16:33:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T16:33:55.427 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-06-02T16:33:55.427 DEBUG:teuthology.orchestra.run.smithi114:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-02T16:33:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:postinstall scriptlet (using /bin/sh): 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:for file in vmlinuz System.map config; do 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: fi 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:done 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-06-02T16:33:55.450 INFO:teuthology.orchestra.run.smithi114.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-06-02T16:33:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2024-06-02T16:33:55.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 68.el9 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8264254 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2024-06-02T16:33:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2024-06-02T16:33:55.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:33:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T16:33:55.526 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T16:33:55.527 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 6.9.0-gb9459a26b088 2024-06-02T16:33:55.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T16:33:56.076 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-06-02T16:33:57.463 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T16:33:57.488 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-06-02T16:33:57.491 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-06-02T16:33:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.f46fh4flN6 2024-06-02T16:33:57.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f46fh4flN6 2024-06-02T16:33:57.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.f46fh4flN6 2024-06-02T16:33:57.705 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.f46fh4flN6 is 6KB 2024-06-02T16:33:57.754 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.f46fh4flN6 2024-06-02T16:33:57.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T16:33:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T16:33:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T16:33:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T16:33:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-06-02T16:33:57.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-06-02T16:33:57.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-06-02T16:34:10.190 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-02T16:34:10.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-06-02T16:34:10.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:34:27.991 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-06-02T16:34:27.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:34:27.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:35:02.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-06-02T16:35:10.198 DEBUG:teuthology.orchestra.remote:timed out 2024-06-02T16:35:11.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:35:11.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:35:19.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-06-02T16:35:19.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:35:19.563 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-06-02T16:35:20.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-06-02T16:35:20.191 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-06-02T16:35:20.191 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-06-02T16:35:20.233 INFO:teuthology.orchestra.run.smithi052.stdout:6.9.0-gb9459a26b088 2024-06-02T16:35:20.233 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-06-02T16:35:20.233 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T16:35:20.233 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T16:35:21.238 DEBUG:teuthology.parallel:result is None 2024-06-02T16:35:29.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-06-02T16:35:41.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:35:41.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:35:42.790 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-06-02T16:35:43.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:35:43.365 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-gb9459a26b088"... 2024-06-02T16:35:43.365 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-06-02T16:35:43.405 INFO:teuthology.orchestra.run.smithi114.stdout:6.9.0-gb9459a26b088 2024-06-02T16:35:43.405 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-06-02T16:35:43.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T16:35:43.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T16:35:44.407 DEBUG:teuthology.parallel:result is None 2024-06-02T16:35:44.407 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T16:35:44.414 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T16:35:44.415 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T16:35:44.424 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T16:35:44.478 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T16:35:44.488 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T16:35:44.511 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T16:35:44.511 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T16:35:44.519 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T16:35:44.587 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T16:35:44.595 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T16:35:44.595 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T16:35:44.600 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T16:35:44.756 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T16:35:44.766 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T16:35:44.813 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T16:35:44.829 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T16:35:44.834 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T16:35:44.841 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T16:35:44.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T16:35:44.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T16:35:44.930 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T16:35:44.940 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T16:35:44.940 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T16:35:44.948 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T16:35:44.997 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T16:35:45.083 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T16:35:45.183 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T16:35:45.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T16:35:45.363 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:35:45.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T16:35:45.452 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T16:35:45.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T16:35:45.599 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T16:35:45.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T16:35:45.750 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:35:45.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T16:35:45.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-06-02T16:35:45.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-06-02T16:35:45.956 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T16:35:45.969 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T16:35:46.479 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T16:35:46.489 INFO:teuthology.task.internal:Starting timer... 2024-06-02T16:35:46.490 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T16:35:46.514 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T16:35:46.548 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-02T16:35:46.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-06-02T16:35:46.653 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-06-02T16:35:46.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-06-02T16:35:46.774 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-06-02T16:35:46.778 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T16:35:46.778 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-06-02T16:35:46.837 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-06-02T16:35:46.837 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-06-02T16:35:46.894 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-06-02T16:35:46.894 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi114.front.sepia.ceph.com': 'permissive'} 2024-06-02T16:35:46.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T16:35:46.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:35:46.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T16:35:47.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:35:47.041 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T16:35:47.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-06-02T16:35:47.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-06-02T16:35:47.195 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T16:35:47.204 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T16:35:47.207 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T16:35:47.329 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T16:35:47.341 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T16:35:47.342 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T16:42:03.564 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2024-06-02T16:42:03.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-06-02T16:42:03.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:42:03.680 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-06-02T16:42:03.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-06-02T16:42:03.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:42:03.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T16:42:03.947 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-06-02T16:42:04.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-06-02T16:42:04.103 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T16:42:04.116 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T16:42:04.116 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T16:42:04.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T16:42:04.124 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T16:42:04.124 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T16:42:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T16:42:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T16:42:04.252 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T16:42:04.264 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T16:42:04.329 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-06-02T16:42:04.344 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-06-02T16:42:04.361 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-06-02T16:42:04.380 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-06-02T16:42:04.399 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T16:42:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T16:42:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T16:42:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T16:42:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-06-02T16:42:04.582 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T16:42:04.582 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-06-02T16:42:04.582 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.582 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.582 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.583 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.627 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.638 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:42:04.639 INFO:teuthology.run_tasks:Running task install... 2024-06-02T16:42:04.647 DEBUG:teuthology.task.install:project ceph 2024-06-02T16:42:04.648 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504'}} 2024-06-02T16:42:04.648 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504'} 2024-06-02T16:42:04.648 INFO:teuthology.task.install:Using flavor: default 2024-06-02T16:42:04.653 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T16:42:04.654 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T16:42:04.654 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504', 'tag': None, 'wait_for_package': False} 2024-06-02T16:42:04.654 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b7328fed0e2e9ab66b09f8134f3cebfc71214504 2024-06-02T16:42:04.657 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504', 'tag': None, 'wait_for_package': False} 2024-06-02T16:42:04.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b7328fed0e2e9ab66b09f8134f3cebfc71214504 2024-06-02T16:42:04.882 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/ 2024-06-02T16:42:04.883 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3882.gb7328fed 2024-06-02T16:42:04.887 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/ 2024-06-02T16:42:04.887 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3882.gb7328fed 2024-06-02T16:42:04.997 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T16:42:04.998 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:42:04.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T16:42:05.053 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b7328fed0e2e9ab66b09f8134f3cebfc71214504/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T16:42:05.053 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:42:05.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T16:42:05.094 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T16:42:05.094 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b7328fed0e2e9ab66b09f8134f3cebfc71214504/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T16:42:05.142 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T16:42:05.142 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b7328fed0e2e9ab66b09f8134f3cebfc71214504/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T16:42:05.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T16:42:05.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T16:42:05.346 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T16:42:05.383 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T16:42:05.430 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-06-02T16:42:05.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-06-02T16:42:05.463 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-06-02T16:42:05.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-06-02T16:42:05.760 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-06-02T16:42:05.786 INFO:teuthology.orchestra.run.smithi114.stdout:45 files removed 2024-06-02T16:42:05.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T16:42:05.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T16:42:06.817 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 146 kB/s | 84 kB 00:00 2024-06-02T16:42:06.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 145 kB/s | 84 kB 00:00 2024-06-02T16:42:07.393 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-06-02T16:42:07.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-06-02T16:42:07.927 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-06-02T16:42:07.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-06-02T16:42:08.858 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.1 MB 00:00 2024-06-02T16:42:08.885 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-02T16:42:10.776 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-06-02T16:42:11.038 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-06-02T16:42:15.671 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-06-02T16:42:17.061 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.2 MB 00:02 2024-06-02T16:42:17.588 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 17 kB 00:00 2024-06-02T16:42:18.490 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-06-02T16:42:20.045 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 17 kB 00:01 2024-06-02T16:42:21.530 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-06-02T16:42:24.682 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-06-02T16:42:27.275 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T16:42:27.277 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T16:42:27.298 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T16:42:27.299 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T16:42:27.300 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T16:42:27.302 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T16:42:27.304 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T16:42:27.308 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T16:42:27.309 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T16:42:27.381 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 6.6 k 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 5.4 M 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 890 k 2024-06-02T16:42:27.402 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 145 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 1.5 M 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 143 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 3.5 M 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 7.4 M 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 49 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 11 M 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 49 M 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 273 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 763 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 225 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 27 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 18 k 2024-06-02T16:42:27.403 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 32 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 747 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 127 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T16:42:27.404 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 161 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 320 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 300 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 100 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 85 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.1 M 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 170 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T16:42:27.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.4 M 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.1 M 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T16:42:27.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 21 M 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 34 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 2.4 M 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 274 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 4.7 M 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 17 M 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 16 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 25 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T16:42:27.407 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 163 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 501 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 5.4 M 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T16:42:27.408 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T16:42:27.409 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 45 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 135 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T16:42:27.410 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T16:42:27.411 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T16:42:27.412 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T16:42:27.413 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T16:42:27.414 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout:Install 148 Packages 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 11 Packages 2024-06-02T16:42:27.415 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:42:27.416 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 227 M 2024-06-02T16:42:27.416 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-06-02T16:42:27.971 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-06-02T16:42:28.459 INFO:teuthology.orchestra.run.smithi114.stdout:(1/159): ceph-19.0.0-3882.gb7328fed.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-06-02T16:42:28.925 INFO:teuthology.orchestra.run.smithi114.stdout:(2/159): ceph-base-19.0.0-3882.gb7328fed.el9.x8 6.8 MB/s | 5.4 MB 00:00 2024-06-02T16:42:28.992 INFO:teuthology.orchestra.run.smithi114.stdout:(3/159): ceph-immutable-object-cache-19.0.0-388 2.2 MB/s | 145 kB 00:00 2024-06-02T16:42:29.226 INFO:teuthology.orchestra.run.smithi114.stdout:(4/159): ceph-fuse-19.0.0-3882.gb7328fed.el9.x8 1.1 MB/s | 890 kB 00:00 2024-06-02T16:42:29.293 INFO:teuthology.orchestra.run.smithi114.stdout:(5/159): ceph-mds-19.0.0-3882.gb7328fed.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-06-02T16:42:29.860 INFO:teuthology.orchestra.run.smithi114.stdout:(6/159): ceph-mon-19.0.0-3882.gb7328fed.el9.x86 8.3 MB/s | 4.7 MB 00:00 2024-06-02T16:42:30.135 INFO:teuthology.orchestra.run.smithi114.stdout:(7/159): ceph-common-19.0.0-3882.gb7328fed.el9. 11 MB/s | 21 MB 00:01 2024-06-02T16:42:30.219 INFO:teuthology.orchestra.run.smithi114.stdout:(8/159): ceph-mgr-19.0.0-3882.gb7328fed.el9.x86 1.5 MB/s | 1.5 MB 00:00 2024-06-02T16:42:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:(9/159): ceph-selinux-19.0.0-3882.gb7328fed.el9 306 kB/s | 25 kB 00:00 2024-06-02T16:42:30.613 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T16:42:30.614 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T16:42:30.634 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T16:42:30.635 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T16:42:30.636 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T16:42:30.637 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T16:42:30.640 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T16:42:30.643 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T16:42:30.644 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T16:42:30.720 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-06-02T16:42:30.740 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-06-02T16:42:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 6.6 k 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 5.4 M 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 890 k 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 145 k 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 1.5 M 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 143 k 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 3.5 M 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 7.4 M 2024-06-02T16:42:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 49 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 11 M 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 49 M 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 273 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 763 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 225 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 27 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 18 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 32 k 2024-06-02T16:42:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 747 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 127 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 161 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 320 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 300 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 100 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 85 k 2024-06-02T16:42:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.1 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 170 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.4 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 3.1 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T16:42:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 21 M 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 34 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 2.4 M 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 274 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 4.7 M 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 17 M 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3882.gb7328fed.el9 ceph-noarch 16 k 2024-06-02T16:42:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 25 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 163 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T16:42:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 501 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 5.4 M 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T16:42:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 45 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.0.0-3882.gb7328fed.el9 ceph 135 k 2024-06-02T16:42:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T16:42:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T16:42:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T16:42:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T16:42:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T16:42:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:Install 148 Packages 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 11 Packages 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 227 M 2024-06-02T16:42:30.754 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-06-02T16:42:30.961 INFO:teuthology.orchestra.run.smithi114.stdout:(10/159): ceph-radosgw-19.0.0-3882.gb7328fed.el 13 MB/s | 11 MB 00:00 2024-06-02T16:42:31.036 INFO:teuthology.orchestra.run.smithi114.stdout:(11/159): cephfs-mirror-19.0.0-3882.gb7328fed.e 3.0 MB/s | 225 kB 00:00 2024-06-02T16:42:31.095 INFO:teuthology.orchestra.run.smithi114.stdout:(12/159): cephfs-shell-19.0.0-3882.gb7328fed.el 471 kB/s | 27 kB 00:00 2024-06-02T16:42:31.153 INFO:teuthology.orchestra.run.smithi114.stdout:(13/159): libcephfs-devel-19.0.0-3882.gb7328fed 553 kB/s | 32 kB 00:00 2024-06-02T16:42:31.254 INFO:teuthology.orchestra.run.smithi114.stdout:(14/159): libcephfs2-19.0.0-3882.gb7328fed.el9. 7.4 MB/s | 747 kB 00:00 2024-06-02T16:42:31.312 INFO:teuthology.orchestra.run.smithi114.stdout:(15/159): libcephsqlite-19.0.0-3882.gb7328fed.e 2.8 MB/s | 163 kB 00:00 2024-06-02T16:42:31.580 INFO:teuthology.orchestra.run.smithi114.stdout:(16/159): ceph-osd-19.0.0-3882.gb7328fed.el9.x8 9.8 MB/s | 17 MB 00:01 2024-06-02T16:42:31.613 INFO:teuthology.orchestra.run.smithi114.stdout:(17/159): librados-devel-19.0.0-3882.gb7328fed. 422 kB/s | 127 kB 00:00 2024-06-02T16:42:31.655 INFO:teuthology.orchestra.run.smithi114.stdout:(18/159): libradosstriper1-19.0.0-3882.gb7328fe 6.6 MB/s | 501 kB 00:00 2024-06-02T16:42:31.705 INFO:teuthology.orchestra.run.smithi114.stdout:(19/159): python3-ceph-argparse-19.0.0-3882.gb7 927 kB/s | 45 kB 00:00 2024-06-02T16:42:31.781 INFO:teuthology.orchestra.run.smithi114.stdout:(20/159): python3-ceph-common-19.0.0-3882.gb732 1.8 MB/s | 135 kB 00:00 2024-06-02T16:42:31.798 INFO:teuthology.orchestra.run.smithi052.stdout:(1/159): ceph-19.0.0-3882.gb7328fed.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-06-02T16:42:31.856 INFO:teuthology.orchestra.run.smithi114.stdout:(21/159): python3-cephfs-19.0.0-3882.gb7328fed. 2.1 MB/s | 161 kB 00:00 2024-06-02T16:42:31.981 INFO:teuthology.orchestra.run.smithi114.stdout:(22/159): librgw2-19.0.0-3882.gb7328fed.el9.x86 15 MB/s | 5.4 MB 00:00 2024-06-02T16:42:32.015 INFO:teuthology.orchestra.run.smithi114.stdout:(23/159): python3-rados-19.0.0-3882.gb7328fed.e 2.0 MB/s | 320 kB 00:00 2024-06-02T16:42:32.057 INFO:teuthology.orchestra.run.smithi114.stdout:(24/159): python3-rbd-19.0.0-3882.gb7328fed.el9 3.9 MB/s | 300 kB 00:00 2024-06-02T16:42:32.090 INFO:teuthology.orchestra.run.smithi114.stdout:(25/159): python3-rgw-19.0.0-3882.gb7328fed.el9 1.3 MB/s | 100 kB 00:00 2024-06-02T16:42:32.116 INFO:teuthology.orchestra.run.smithi114.stdout:(26/159): rbd-fuse-19.0.0-3882.gb7328fed.el9.x8 1.4 MB/s | 85 kB 00:00 2024-06-02T16:42:32.148 INFO:teuthology.orchestra.run.smithi052.stdout:(2/159): ceph-fuse-19.0.0-3882.gb7328fed.el9.x8 2.5 MB/s | 890 kB 00:00 2024-06-02T16:42:32.182 INFO:teuthology.orchestra.run.smithi114.stdout:(27/159): rbd-nbd-19.0.0-3882.gb7328fed.el9.x86 2.5 MB/s | 170 kB 00:00 2024-06-02T16:42:32.223 INFO:teuthology.orchestra.run.smithi052.stdout:(3/159): ceph-immutable-object-cache-19.0.0-388 1.9 MB/s | 145 kB 00:00 2024-06-02T16:42:32.241 INFO:teuthology.orchestra.run.smithi114.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3882.g 596 kB/s | 34 kB 00:00 2024-06-02T16:42:32.317 INFO:teuthology.orchestra.run.smithi114.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3882.gb7328fe 1.9 MB/s | 143 kB 00:00 2024-06-02T16:42:32.408 INFO:teuthology.orchestra.run.smithi114.stdout:(30/159): rbd-mirror-19.0.0-3882.gb7328fed.el9. 9.8 MB/s | 3.1 MB 00:00 2024-06-02T16:42:32.624 INFO:teuthology.orchestra.run.smithi052.stdout:(4/159): ceph-mds-19.0.0-3882.gb7328fed.el9.x86 5.9 MB/s | 2.4 MB 00:00 2024-06-02T16:42:32.717 INFO:teuthology.orchestra.run.smithi114.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3882.gb7328 8.9 MB/s | 3.5 MB 00:00 2024-06-02T16:42:32.826 INFO:teuthology.orchestra.run.smithi114.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3882.gb7 2.5 MB/s | 274 kB 00:00 2024-06-02T16:42:32.893 INFO:teuthology.orchestra.run.smithi114.stdout:(33/159): ceph-mgr-rook-19.0.0-3882.gb7328fed.e 750 kB/s | 49 kB 00:00 2024-06-02T16:42:32.907 INFO:teuthology.orchestra.run.smithi052.stdout:(5/159): ceph-mgr-19.0.0-3882.gb7328fed.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-06-02T16:42:32.951 INFO:teuthology.orchestra.run.smithi114.stdout:(34/159): ceph-prometheus-alerts-19.0.0-3882.gb 286 kB/s | 16 kB 00:00 2024-06-02T16:42:33.060 INFO:teuthology.orchestra.run.smithi114.stdout:(35/159): ceph-volume-19.0.0-3882.gb7328fed.el9 2.5 MB/s | 273 kB 00:00 2024-06-02T16:42:33.268 INFO:teuthology.orchestra.run.smithi114.stdout:(36/159): cephadm-19.0.0-3882.gb7328fed.el9.noa 3.6 MB/s | 763 kB 00:00 2024-06-02T16:42:33.310 INFO:teuthology.orchestra.run.smithi114.stdout:(37/159): cephfs-top-19.0.0-3882.gb7328fed.el9. 445 kB/s | 18 kB 00:00 2024-06-02T16:42:33.341 INFO:teuthology.orchestra.run.smithi052.stdout:(6/159): ceph-base-19.0.0-3882.gb7328fed.el9.x8 2.8 MB/s | 5.4 MB 00:01 2024-06-02T16:42:33.444 INFO:teuthology.orchestra.run.smithi114.stdout:(38/159): ceph-mgr-diskprediction-local-19.0.0- 7.1 MB/s | 7.4 MB 00:01 2024-06-02T16:42:33.550 INFO:teuthology.orchestra.run.smithi052.stdout:(7/159): ceph-mon-19.0.0-3882.gb7328fed.el9.x86 7.3 MB/s | 4.7 MB 00:00 2024-06-02T16:42:33.561 INFO:teuthology.orchestra.run.smithi114.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 322 kB/s | 80 kB 00:00 2024-06-02T16:42:33.653 INFO:teuthology.orchestra.run.smithi114.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-06-02T16:42:33.695 INFO:teuthology.orchestra.run.smithi114.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-06-02T16:42:33.729 INFO:teuthology.orchestra.run.smithi114.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-06-02T16:42:33.779 INFO:teuthology.orchestra.run.smithi114.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-06-02T16:42:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-06-02T16:42:33.863 INFO:teuthology.orchestra.run.smithi114.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-06-02T16:42:33.880 INFO:teuthology.orchestra.run.smithi114.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-06-02T16:42:33.947 INFO:teuthology.orchestra.run.smithi114.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-06-02T16:42:34.039 INFO:teuthology.orchestra.run.smithi114.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 689 kB 00:00 2024-06-02T16:42:34.081 INFO:teuthology.orchestra.run.smithi114.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 107 kB 00:00 2024-06-02T16:42:34.139 INFO:teuthology.orchestra.run.smithi114.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-06-02T16:42:34.165 INFO:teuthology.orchestra.run.smithi114.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 262 kB/s | 22 kB 00:00 2024-06-02T16:42:34.198 INFO:teuthology.orchestra.run.smithi114.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-06-02T16:42:34.224 INFO:teuthology.orchestra.run.smithi114.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 566 kB/s | 33 kB 00:00 2024-06-02T16:42:34.266 INFO:teuthology.orchestra.run.smithi114.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 446 kB/s | 18 kB 00:00 2024-06-02T16:42:34.323 INFO:teuthology.orchestra.run.smithi114.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 196 kB/s | 11 kB 00:00 2024-06-02T16:42:34.375 INFO:teuthology.orchestra.run.smithi114.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-02T16:42:34.450 INFO:teuthology.orchestra.run.smithi114.stdout:(57/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-06-02T16:42:34.475 INFO:teuthology.orchestra.run.smithi114.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 455 kB/s | 45 kB 00:00 2024-06-02T16:42:34.517 INFO:teuthology.orchestra.run.smithi114.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 662 kB 00:00 2024-06-02T16:42:34.567 INFO:teuthology.orchestra.run.smithi114.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-06-02T16:42:34.593 INFO:teuthology.orchestra.run.smithi114.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 342 kB/s | 25 kB 00:00 2024-06-02T16:42:34.616 INFO:teuthology.orchestra.run.smithi052.stdout:(8/159): ceph-radosgw-19.0.0-3882.gb7328fed.el9 10 MB/s | 11 MB 00:01 2024-06-02T16:42:34.618 INFO:teuthology.orchestra.run.smithi114.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 960 kB/s | 47 kB 00:00 2024-06-02T16:42:34.651 INFO:teuthology.orchestra.run.smithi114.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-06-02T16:42:34.685 INFO:teuthology.orchestra.run.smithi114.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-06-02T16:42:34.708 INFO:teuthology.orchestra.run.smithi052.stdout:(9/159): ceph-selinux-19.0.0-3882.gb7328fed.el9 277 kB/s | 25 kB 00:00 2024-06-02T16:42:34.710 INFO:teuthology.orchestra.run.smithi114.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 610 kB/s | 35 kB 00:00 2024-06-02T16:42:34.872 INFO:teuthology.orchestra.run.smithi114.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-06-02T16:42:34.969 INFO:teuthology.orchestra.run.smithi114.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-06-02T16:42:35.045 INFO:teuthology.orchestra.run.smithi114.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-06-02T16:42:35.086 INFO:teuthology.orchestra.run.smithi114.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 7.7 MB/s | 911 kB 00:00 2024-06-02T16:42:35.120 INFO:teuthology.orchestra.run.smithi114.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.8 MB/s | 133 kB 00:00 2024-06-02T16:42:35.196 INFO:teuthology.orchestra.run.smithi114.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-06-02T16:42:35.238 INFO:teuthology.orchestra.run.smithi114.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-06-02T16:42:35.363 INFO:teuthology.orchestra.run.smithi114.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-06-02T16:42:35.405 INFO:teuthology.orchestra.run.smithi114.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.5 MB/s | 61 kB 00:00 2024-06-02T16:42:35.455 INFO:teuthology.orchestra.run.smithi114.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-02T16:42:35.506 INFO:teuthology.orchestra.run.smithi114.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-06-02T16:42:35.622 INFO:teuthology.orchestra.run.smithi114.stdout:(77/159): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-06-02T16:42:35.648 INFO:teuthology.orchestra.run.smithi114.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-06-02T16:42:35.665 INFO:teuthology.orchestra.run.smithi114.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 466 kB/s | 19 kB 00:00 2024-06-02T16:42:35.698 INFO:teuthology.orchestra.run.smithi114.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-02T16:42:35.723 INFO:teuthology.orchestra.run.smithi114.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-06-02T16:42:35.774 INFO:teuthology.orchestra.run.smithi114.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-06-02T16:42:35.824 INFO:teuthology.orchestra.run.smithi114.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-06-02T16:42:35.858 INFO:teuthology.orchestra.run.smithi114.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 2.3 MB/s | 77 kB 00:00 2024-06-02T16:42:35.900 INFO:teuthology.orchestra.run.smithi114.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-06-02T16:42:35.900 INFO:teuthology.orchestra.run.smithi052.stdout:(10/159): ceph-common-19.0.0-3882.gb7328fed.el9 4.7 MB/s | 21 MB 00:04 2024-06-02T16:42:35.950 INFO:teuthology.orchestra.run.smithi114.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 5.4 MB/s | 269 kB 00:00 2024-06-02T16:42:36.050 INFO:teuthology.orchestra.run.smithi114.stdout:(87/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-06-02T16:42:36.084 INFO:teuthology.orchestra.run.smithi114.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-06-02T16:42:36.118 INFO:teuthology.orchestra.run.smithi114.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-06-02T16:42:36.126 INFO:teuthology.orchestra.run.smithi052.stdout:(11/159): ceph-osd-19.0.0-3882.gb7328fed.el9.x8 6.0 MB/s | 17 MB 00:02 2024-06-02T16:42:36.143 INFO:teuthology.orchestra.run.smithi114.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 883 kB/s | 51 kB 00:00 2024-06-02T16:42:36.159 INFO:teuthology.orchestra.run.smithi052.stdout:(12/159): cephfs-mirror-19.0.0-3882.gb7328fed.e 873 kB/s | 225 kB 00:00 2024-06-02T16:42:36.168 INFO:teuthology.orchestra.run.smithi114.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-06-02T16:42:36.193 INFO:teuthology.orchestra.run.smithi052.stdout:(13/159): cephfs-shell-19.0.0-3882.gb7328fed.el 412 kB/s | 27 kB 00:00 2024-06-02T16:42:36.210 INFO:teuthology.orchestra.run.smithi114.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-06-02T16:42:36.218 INFO:teuthology.orchestra.run.smithi052.stdout:(14/159): libcephfs-devel-19.0.0-3882.gb7328fed 551 kB/s | 32 kB 00:00 2024-06-02T16:42:36.252 INFO:teuthology.orchestra.run.smithi114.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-06-02T16:42:36.277 INFO:teuthology.orchestra.run.smithi052.stdout:(15/159): libcephsqlite-19.0.0-3882.gb7328fed.e 2.8 MB/s | 163 kB 00:00 2024-06-02T16:42:36.294 INFO:teuthology.orchestra.run.smithi114.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 5.3 MB/s | 221 kB 00:00 2024-06-02T16:42:36.336 INFO:teuthology.orchestra.run.smithi114.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 878 kB/s | 36 kB 00:00 2024-06-02T16:42:36.352 INFO:teuthology.orchestra.run.smithi052.stdout:(16/159): libcephfs2-19.0.0-3882.gb7328fed.el9. 4.6 MB/s | 747 kB 00:00 2024-06-02T16:42:36.378 INFO:teuthology.orchestra.run.smithi114.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T16:42:36.385 INFO:teuthology.orchestra.run.smithi052.stdout:(17/159): librados-devel-19.0.0-3882.gb7328fed. 1.1 MB/s | 127 kB 00:00 2024-06-02T16:42:36.428 INFO:teuthology.orchestra.run.smithi114.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 6.1 MB/s | 305 kB 00:00 2024-06-02T16:42:36.461 INFO:teuthology.orchestra.run.smithi052.stdout:(18/159): libradosstriper1-19.0.0-3882.gb7328fe 4.5 MB/s | 501 kB 00:00 2024-06-02T16:42:36.470 INFO:teuthology.orchestra.run.smithi114.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-06-02T16:42:36.512 INFO:teuthology.orchestra.run.smithi114.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-06-02T16:42:36.519 INFO:teuthology.orchestra.run.smithi052.stdout:(19/159): python3-ceph-argparse-19.0.0-3882.gb7 786 kB/s | 45 kB 00:00 2024-06-02T16:42:36.554 INFO:teuthology.orchestra.run.smithi114.stdout:(100/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-02T16:42:36.586 INFO:teuthology.orchestra.run.smithi052.stdout:(20/159): python3-ceph-common-19.0.0-3882.gb732 2.0 MB/s | 135 kB 00:00 2024-06-02T16:42:36.596 INFO:teuthology.orchestra.run.smithi114.stdout:(101/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-06-02T16:42:36.662 INFO:teuthology.orchestra.run.smithi052.stdout:(21/159): python3-cephfs-19.0.0-3882.gb7328fed. 2.1 MB/s | 161 kB 00:00 2024-06-02T16:42:36.680 INFO:teuthology.orchestra.run.smithi114.stdout:(102/159): lua-devel-5.4.4-4.el9.x86_64.rpm 271 kB/s | 22 kB 00:00 2024-06-02T16:42:36.762 INFO:teuthology.orchestra.run.smithi052.stdout:(22/159): python3-rados-19.0.0-3882.gb7328fed.e 3.2 MB/s | 320 kB 00:00 2024-06-02T16:42:36.862 INFO:teuthology.orchestra.run.smithi052.stdout:(23/159): python3-rbd-19.0.0-3882.gb7328fed.el9 3.0 MB/s | 300 kB 00:00 2024-06-02T16:42:36.914 INFO:teuthology.orchestra.run.smithi114.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-06-02T16:42:36.938 INFO:teuthology.orchestra.run.smithi052.stdout:(24/159): python3-rgw-19.0.0-3882.gb7328fed.el9 1.3 MB/s | 100 kB 00:00 2024-06-02T16:42:37.005 INFO:teuthology.orchestra.run.smithi052.stdout:(25/159): rbd-fuse-19.0.0-3882.gb7328fed.el9.x8 1.3 MB/s | 85 kB 00:00 2024-06-02T16:42:37.022 INFO:teuthology.orchestra.run.smithi114.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-06-02T16:42:37.181 INFO:teuthology.orchestra.run.smithi114.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-06-02T16:42:37.235 INFO:teuthology.orchestra.run.smithi052.stdout:(26/159): librgw2-19.0.0-3882.gb7328fed.el9.x86 6.3 MB/s | 5.4 MB 00:00 2024-06-02T16:42:37.239 INFO:teuthology.orchestra.run.smithi114.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 338 kB/s | 19 kB 00:00 2024-06-02T16:42:37.273 INFO:teuthology.orchestra.run.smithi114.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-06-02T16:42:37.297 INFO:teuthology.orchestra.run.smithi052.stdout:(27/159): rbd-nbd-19.0.0-3882.gb7328fed.el9.x86 2.7 MB/s | 170 kB 00:00 2024-06-02T16:42:37.332 INFO:teuthology.orchestra.run.smithi114.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 452 kB/s | 26 kB 00:00 2024-06-02T16:42:37.356 INFO:teuthology.orchestra.run.smithi052.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3882.g 596 kB/s | 34 kB 00:00 2024-06-02T16:42:37.390 INFO:teuthology.orchestra.run.smithi114.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 848 kB/s | 49 kB 00:00 2024-06-02T16:42:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3882.gb7328fe 1.9 MB/s | 143 kB 00:00 2024-06-02T16:42:37.499 INFO:teuthology.orchestra.run.smithi114.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-06-02T16:42:37.524 INFO:teuthology.orchestra.run.smithi114.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2024-06-02T16:42:37.558 INFO:teuthology.orchestra.run.smithi114.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-06-02T16:42:37.565 INFO:teuthology.orchestra.run.smithi052.stdout:(30/159): rbd-mirror-19.0.0-3882.gb7328fed.el9. 5.5 MB/s | 3.1 MB 00:00 2024-06-02T16:42:37.675 INFO:teuthology.orchestra.run.smithi114.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-06-02T16:42:37.742 INFO:teuthology.orchestra.run.smithi114.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-06-02T16:42:37.767 INFO:teuthology.orchestra.run.smithi114.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 477 kB/s | 43 kB 00:00 2024-06-02T16:42:37.792 INFO:teuthology.orchestra.run.smithi114.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 653 kB/s | 32 kB 00:00 2024-06-02T16:42:37.818 INFO:teuthology.orchestra.run.smithi114.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 301 kB/s | 15 kB 00:00 2024-06-02T16:42:37.851 INFO:teuthology.orchestra.run.smithi114.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-06-02T16:42:37.885 INFO:teuthology.orchestra.run.smithi114.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-06-02T16:42:37.918 INFO:teuthology.orchestra.run.smithi114.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-06-02T16:42:37.952 INFO:teuthology.orchestra.run.smithi114.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-06-02T16:42:38.011 INFO:teuthology.orchestra.run.smithi114.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2024-06-02T16:42:38.073 INFO:teuthology.orchestra.run.smithi052.stdout:(31/159): ceph-mgr-dashboard-19.0.0-3882.gb7328 5.5 MB/s | 3.5 MB 00:00 2024-06-02T16:42:38.094 INFO:teuthology.orchestra.run.smithi114.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-06-02T16:42:38.120 INFO:teuthology.orchestra.run.smithi114.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-06-02T16:42:38.170 INFO:teuthology.orchestra.run.smithi114.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 238 kB/s | 18 kB 00:00 2024-06-02T16:42:38.190 INFO:teuthology.orchestra.run.smithi052.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3882.gb7 2.3 MB/s | 274 kB 00:00 2024-06-02T16:42:38.195 INFO:teuthology.orchestra.run.smithi114.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 311 kB/s | 23 kB 00:00 2024-06-02T16:42:38.229 INFO:teuthology.orchestra.run.smithi114.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 336 kB/s | 19 kB 00:00 2024-06-02T16:42:38.249 INFO:teuthology.orchestra.run.smithi052.stdout:(33/159): ceph-mgr-rook-19.0.0-3882.gb7328fed.e 863 kB/s | 49 kB 00:00 2024-06-02T16:42:38.263 INFO:teuthology.orchestra.run.smithi114.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-06-02T16:42:38.299 INFO:teuthology.orchestra.run.smithi052.stdout:(34/159): ceph-prometheus-alerts-19.0.0-3882.gb 334 kB/s | 16 kB 00:00 2024-06-02T16:42:38.321 INFO:teuthology.orchestra.run.smithi114.stdout:(129/159): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-06-02T16:42:38.347 INFO:teuthology.orchestra.run.smithi114.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 559 kB/s | 46 kB 00:00 2024-06-02T16:42:38.380 INFO:teuthology.orchestra.run.smithi114.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-06-02T16:42:38.400 INFO:teuthology.orchestra.run.smithi052.stdout:(35/159): ceph-volume-19.0.0-3882.gb7328fed.el9 2.7 MB/s | 273 kB 00:00 2024-06-02T16:42:38.405 INFO:teuthology.orchestra.run.smithi114.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 997 kB/s | 58 kB 00:00 2024-06-02T16:42:38.439 INFO:teuthology.orchestra.run.smithi114.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-06-02T16:42:38.464 INFO:teuthology.orchestra.run.smithi114.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2024-06-02T16:42:38.506 INFO:teuthology.orchestra.run.smithi114.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-06-02T16:42:38.560 INFO:teuthology.orchestra.run.smithi114.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 297 kB/s | 28 kB 00:00 2024-06-02T16:42:38.590 INFO:teuthology.orchestra.run.smithi114.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 372 kB/s | 31 kB 00:00 2024-06-02T16:42:38.592 INFO:teuthology.orchestra.run.smithi052.stdout:(36/159): cephadm-19.0.0-3882.gb7328fed.el9.noa 3.9 MB/s | 763 kB 00:00 2024-06-02T16:42:38.624 INFO:teuthology.orchestra.run.smithi114.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 3.0 MB/s | 188 kB 00:00 2024-06-02T16:42:38.642 INFO:teuthology.orchestra.run.smithi052.stdout:(37/159): cephfs-top-19.0.0-3882.gb7328fed.el9. 373 kB/s | 18 kB 00:00 2024-06-02T16:42:38.649 INFO:teuthology.orchestra.run.smithi114.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-06-02T16:42:38.691 INFO:teuthology.orchestra.run.smithi114.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 541 kB/s | 36 kB 00:00 2024-06-02T16:42:38.716 INFO:teuthology.orchestra.run.smithi114.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 770 kB/s | 51 kB 00:00 2024-06-02T16:42:38.758 INFO:teuthology.orchestra.run.smithi114.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-06-02T16:42:38.784 INFO:teuthology.orchestra.run.smithi114.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-06-02T16:42:38.784 INFO:teuthology.orchestra.run.smithi052.stdout:(38/159): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-06-02T16:42:38.826 INFO:teuthology.orchestra.run.smithi114.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-06-02T16:42:38.851 INFO:teuthology.orchestra.run.smithi114.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 302 kB/s | 20 kB 00:00 2024-06-02T16:42:38.885 INFO:teuthology.orchestra.run.smithi114.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-06-02T16:42:38.960 INFO:teuthology.orchestra.run.smithi114.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-02T16:42:39.260 INFO:teuthology.orchestra.run.smithi114.stdout:(148/159): librados2-19.0.0-3882.gb7328fed.el9. 9.1 MB/s | 3.4 MB 00:00 2024-06-02T16:42:39.309 INFO:teuthology.orchestra.run.smithi052.stdout:(39/159): ceph-test-19.0.0-3882.gb7328fed.el9.x 11 MB/s | 49 MB 00:04 2024-06-02T16:42:39.335 INFO:teuthology.orchestra.run.smithi052.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 116 kB/s | 80 kB 00:00 2024-06-02T16:42:39.402 INFO:teuthology.orchestra.run.smithi114.stdout:(149/159): librbd1-19.0.0-3882.gb7328fed.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-06-02T16:42:39.410 INFO:teuthology.orchestra.run.smithi052.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-06-02T16:42:39.435 INFO:teuthology.orchestra.run.smithi052.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-06-02T16:42:39.469 INFO:teuthology.orchestra.run.smithi052.stdout:(43/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-06-02T16:42:39.494 INFO:teuthology.orchestra.run.smithi052.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-02T16:42:39.527 INFO:teuthology.orchestra.run.smithi052.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-06-02T16:42:39.561 INFO:teuthology.orchestra.run.smithi052.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-02T16:42:39.595 INFO:teuthology.orchestra.run.smithi052.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-06-02T16:42:39.627 INFO:teuthology.orchestra.run.smithi114.stdout:(150/159): NetworkManager-1.47.91-1.el9.x86_64. 6.3 MB/s | 2.3 MB 00:00 2024-06-02T16:42:39.645 INFO:teuthology.orchestra.run.smithi052.stdout:(48/159): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-06-02T16:42:39.686 INFO:teuthology.orchestra.run.smithi114.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 722 kB/s | 41 kB 00:00 2024-06-02T16:42:39.770 INFO:teuthology.orchestra.run.smithi114.stdout:(152/159): NetworkManager-libnm-1.47.91-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-06-02T16:42:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 804 kB/s | 107 kB 00:00 2024-06-02T16:42:39.803 INFO:teuthology.orchestra.run.smithi114.stdout:(153/159): NetworkManager-tui-1.47.91-1.el9.x86 2.1 MB/s | 248 kB 00:00 2024-06-02T16:42:39.820 INFO:teuthology.orchestra.run.smithi052.stdout:(50/159): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-06-02T16:42:39.828 INFO:teuthology.orchestra.run.smithi114.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 635 kB/s | 37 kB 00:00 2024-06-02T16:42:39.837 INFO:teuthology.orchestra.run.smithi052.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 376 kB/s | 22 kB 00:00 2024-06-02T16:42:39.862 INFO:teuthology.orchestra.run.smithi114.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-02T16:42:39.879 INFO:teuthology.orchestra.run.smithi052.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-06-02T16:42:39.896 INFO:teuthology.orchestra.run.smithi114.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 3.8 MB/s | 260 kB 00:00 2024-06-02T16:42:39.938 INFO:teuthology.orchestra.run.smithi052.stdout:(53/159): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-06-02T16:42:39.980 INFO:teuthology.orchestra.run.smithi052.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-06-02T16:42:40.013 INFO:teuthology.orchestra.run.smithi114.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 1.3 MB 00:00 2024-06-02T16:42:40.022 INFO:teuthology.orchestra.run.smithi052.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 272 kB/s | 11 kB 00:00 2024-06-02T16:42:40.114 INFO:teuthology.orchestra.run.smithi052.stdout:(56/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-06-02T16:42:40.130 INFO:teuthology.orchestra.run.smithi114.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-06-02T16:42:40.147 INFO:teuthology.orchestra.run.smithi052.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-06-02T16:42:40.164 INFO:teuthology.orchestra.run.smithi052.stdout:(58/159): flexiblas-3.0.4-8.el9.x86_64.rpm 100 kB/s | 33 kB 00:00 2024-06-02T16:42:40.181 INFO:teuthology.orchestra.run.smithi052.stdout:(59/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 682 kB/s | 45 kB 00:00 2024-06-02T16:42:40.223 INFO:teuthology.orchestra.run.smithi052.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-06-02T16:42:40.240 INFO:teuthology.orchestra.run.smithi052.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 444 kB/s | 25 kB 00:00 2024-06-02T16:42:40.266 INFO:teuthology.orchestra.run.smithi052.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T16:42:40.299 INFO:teuthology.orchestra.run.smithi052.stdout:(63/159): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-06-02T16:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-06-02T16:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 714 kB/s | 35 kB 00:00 2024-06-02T16:42:40.383 INFO:teuthology.orchestra.run.smithi052.stdout:(66/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-06-02T16:42:40.509 INFO:teuthology.orchestra.run.smithi052.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-02T16:42:40.601 INFO:teuthology.orchestra.run.smithi052.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 9.8 MB/s | 911 kB 00:00 2024-06-02T16:42:40.710 INFO:teuthology.orchestra.run.smithi052.stdout:(69/159): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-06-02T16:42:40.818 INFO:teuthology.orchestra.run.smithi052.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-06-02T16:42:40.852 INFO:teuthology.orchestra.run.smithi052.stdout:(71/159): postgresql-private-libs-13.14-1.el9.x 533 kB/s | 133 kB 00:00 2024-06-02T16:42:40.902 INFO:teuthology.orchestra.run.smithi052.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-06-02T16:42:41.003 INFO:teuthology.orchestra.run.smithi052.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-06-02T16:42:41.069 INFO:teuthology.orchestra.run.smithi052.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 932 kB/s | 61 kB 00:00 2024-06-02T16:42:41.128 INFO:teuthology.orchestra.run.smithi052.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.2 MB/s | 244 kB 00:00 2024-06-02T16:42:41.253 INFO:teuthology.orchestra.run.smithi052.stdout:(76/159): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-06-02T16:42:41.287 INFO:teuthology.orchestra.run.smithi052.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-06-02T16:42:41.304 INFO:teuthology.orchestra.run.smithi052.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 521 kB/s | 26 kB 00:00 2024-06-02T16:42:41.329 INFO:teuthology.orchestra.run.smithi052.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 467 kB/s | 19 kB 00:00 2024-06-02T16:42:41.373 INFO:teuthology.orchestra.run.smithi052.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-06-02T16:42:41.388 INFO:teuthology.orchestra.run.smithi052.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 600 kB/s | 35 kB 00:00 2024-06-02T16:42:41.505 INFO:teuthology.orchestra.run.smithi052.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-06-02T16:42:41.539 INFO:teuthology.orchestra.run.smithi052.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-06-02T16:42:41.572 INFO:teuthology.orchestra.run.smithi052.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-06-02T16:42:41.598 INFO:teuthology.orchestra.run.smithi052.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-02T16:42:41.614 INFO:teuthology.orchestra.run.smithi052.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-06-02T16:42:41.656 INFO:teuthology.orchestra.run.smithi052.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-06-02T16:42:41.724 INFO:teuthology.orchestra.run.smithi052.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-06-02T16:42:41.765 INFO:teuthology.orchestra.run.smithi052.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-06-02T16:42:41.899 INFO:teuthology.orchestra.run.smithi052.stdout:(90/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.7 MB/s | 5.1 MB 00:00 2024-06-02T16:42:41.916 INFO:teuthology.orchestra.run.smithi052.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 358 kB/s | 54 kB 00:00 2024-06-02T16:42:42.008 INFO:teuthology.orchestra.run.smithi052.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 457 kB/s | 42 kB 00:00 2024-06-02T16:42:42.058 INFO:teuthology.orchestra.run.smithi052.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 897 kB/s | 44 kB 00:00 2024-06-02T16:42:42.117 INFO:teuthology.orchestra.run.smithi052.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-06-02T16:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 880 kB/s | 36 kB 00:00 2024-06-02T16:42:42.201 INFO:teuthology.orchestra.run.smithi052.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T16:42:42.276 INFO:teuthology.orchestra.run.smithi052.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-06-02T16:42:42.318 INFO:teuthology.orchestra.run.smithi052.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-06-02T16:42:42.368 INFO:teuthology.orchestra.run.smithi052.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-06-02T16:42:42.419 INFO:teuthology.orchestra.run.smithi052.stdout:(100/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-06-02T16:42:42.644 INFO:teuthology.orchestra.run.smithi052.stdout:(101/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-06-02T16:42:42.669 INFO:teuthology.orchestra.run.smithi052.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 179 kB/s | 45 kB 00:00 2024-06-02T16:42:42.686 INFO:teuthology.orchestra.run.smithi052.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 546 kB/s | 22 kB 00:00 2024-06-02T16:42:42.712 INFO:teuthology.orchestra.run.smithi052.stdout:(104/159): python3-pyasn1-0.4.8-6.el9.noarch.rp 145 kB/s | 159 kB 00:01 2024-06-02T16:42:42.762 INFO:teuthology.orchestra.run.smithi052.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-06-02T16:42:43.137 INFO:teuthology.orchestra.run.smithi052.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 76 kB/s | 19 kB 00:00 2024-06-02T16:42:43.237 INFO:teuthology.orchestra.run.smithi052.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 997 kB/s | 548 kB 00:00 2024-06-02T16:42:43.304 INFO:teuthology.orchestra.run.smithi052.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 522 kB/s | 309 kB 00:00 2024-06-02T16:42:43.330 INFO:teuthology.orchestra.run.smithi052.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-06-02T16:42:43.380 INFO:teuthology.orchestra.run.smithi052.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 652 kB/s | 49 kB 00:00 2024-06-02T16:42:43.397 INFO:teuthology.orchestra.run.smithi052.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-06-02T16:42:43.413 INFO:teuthology.orchestra.run.smithi114.stdout:(159/159): ceph-test-19.0.0-3882.gb7328fed.el9. 3.8 MB/s | 49 MB 00:13 2024-06-02T16:42:43.421 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-06-02T16:42:43.422 INFO:teuthology.orchestra.run.smithi114.stdout:Total 14 MB/s | 227 MB 00:16 2024-06-02T16:42:43.472 INFO:teuthology.orchestra.run.smithi052.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-06-02T16:42:43.567 INFO:teuthology.orchestra.run.smithi052.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-06-02T16:42:43.623 INFO:teuthology.orchestra.run.smithi052.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-06-02T16:42:43.648 INFO:teuthology.orchestra.run.smithi052.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 542 kB/s | 43 kB 00:00 2024-06-02T16:42:43.698 INFO:teuthology.orchestra.run.smithi052.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 433 kB/s | 32 kB 00:00 2024-06-02T16:42:43.724 INFO:teuthology.orchestra.run.smithi052.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-06-02T16:42:43.832 INFO:teuthology.orchestra.run.smithi052.stdout:(118/159): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-06-02T16:42:43.874 INFO:teuthology.orchestra.run.smithi052.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 982 kB/s | 172 kB 00:00 2024-06-02T16:42:43.908 INFO:teuthology.orchestra.run.smithi052.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-06-02T16:42:43.941 INFO:teuthology.orchestra.run.smithi052.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-06-02T16:42:43.975 INFO:teuthology.orchestra.run.smithi052.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-06-02T16:42:44.017 INFO:teuthology.orchestra.run.smithi052.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-06-02T16:42:44.042 INFO:teuthology.orchestra.run.smithi052.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-06-02T16:42:44.076 INFO:teuthology.orchestra.run.smithi052.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-06-02T16:42:44.135 INFO:teuthology.orchestra.run.smithi052.stdout:(126/159): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-06-02T16:42:44.152 INFO:teuthology.orchestra.run.smithi052.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-06-02T16:42:44.169 INFO:teuthology.orchestra.run.smithi052.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-06-02T16:42:44.202 INFO:teuthology.orchestra.run.smithi052.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 297 kB/s | 20 kB 00:00 2024-06-02T16:42:44.227 INFO:teuthology.orchestra.run.smithi052.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 806 kB/s | 46 kB 00:00 2024-06-02T16:42:44.294 INFO:teuthology.orchestra.run.smithi052.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-06-02T16:42:44.320 INFO:teuthology.orchestra.run.smithi052.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 676 kB/s | 79 kB 00:00 2024-06-02T16:42:44.337 INFO:teuthology.orchestra.run.smithi052.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 535 kB/s | 58 kB 00:00 2024-06-02T16:42:44.378 INFO:teuthology.orchestra.run.smithi052.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-02T16:42:44.395 INFO:teuthology.orchestra.run.smithi052.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-06-02T16:42:44.421 INFO:teuthology.orchestra.run.smithi052.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-06-02T16:42:44.471 INFO:teuthology.orchestra.run.smithi052.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-06-02T16:42:44.488 INFO:teuthology.orchestra.run.smithi052.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2024-06-02T16:42:44.521 INFO:teuthology.orchestra.run.smithi052.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-06-02T16:42:44.547 INFO:teuthology.orchestra.run.smithi052.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 793 kB/s | 59 kB 00:00 2024-06-02T16:42:44.564 INFO:teuthology.orchestra.run.smithi052.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-06-02T16:42:44.581 INFO:teuthology.orchestra.run.smithi052.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 876 kB/s | 51 kB 00:00 2024-06-02T16:42:44.639 INFO:teuthology.orchestra.run.smithi052.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-06-02T16:42:44.665 INFO:teuthology.orchestra.run.smithi052.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 896 kB/s | 90 kB 00:00 2024-06-02T16:42:44.698 INFO:teuthology.orchestra.run.smithi052.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-06-02T16:42:44.723 INFO:teuthology.orchestra.run.smithi052.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-06-02T16:42:44.757 INFO:teuthology.orchestra.run.smithi052.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-06-02T16:42:44.840 INFO:teuthology.orchestra.run.smithi052.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-02T16:42:45.033 INFO:teuthology.orchestra.run.smithi052.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-06-02T16:42:45.133 INFO:teuthology.orchestra.run.smithi052.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-06-02T16:42:45.175 INFO:teuthology.orchestra.run.smithi052.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-06-02T16:42:45.261 INFO:teuthology.orchestra.run.smithi052.stdout:(152/159): librados2-19.0.0-3882.gb7328fed.el9. 6.4 MB/s | 3.4 MB 00:00 2024-06-02T16:42:45.354 INFO:teuthology.orchestra.run.smithi052.stdout:(153/159): librbd1-19.0.0-3882.gb7328fed.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-06-02T16:42:45.384 INFO:teuthology.orchestra.run.smithi052.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 295 kB/s | 37 kB 00:00 2024-06-02T16:42:45.418 INFO:teuthology.orchestra.run.smithi052.stdout:(155/159): NetworkManager-tui-1.47.91-1.el9.x86 1.0 MB/s | 248 kB 00:00 2024-06-02T16:42:45.451 INFO:teuthology.orchestra.run.smithi052.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 2.1 MB/s | 207 kB 00:00 2024-06-02T16:42:45.485 INFO:teuthology.orchestra.run.smithi052.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 2.5 MB/s | 260 kB 00:00 2024-06-02T16:42:45.560 INFO:teuthology.orchestra.run.smithi052.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 1.3 MB 00:00 2024-06-02T16:42:45.636 INFO:teuthology.orchestra.run.smithi052.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-06-02T16:42:45.648 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-06-02T16:42:45.649 INFO:teuthology.orchestra.run.smithi052.stdout:Total 15 MB/s | 227 MB 00:14 2024-06-02T16:42:46.613 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-06-02T16:42:46.867 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-06-02T16:42:46.867 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-06-02T16:42:49.034 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-06-02T16:42:49.308 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-06-02T16:42:49.308 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-06-02T16:42:49.468 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-06-02T16:42:49.470 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-06-02T16:42:51.988 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-06-02T16:42:51.989 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-06-02T16:42:56.164 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-06-02T16:42:56.261 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T16:42:56.336 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T16:42:56.441 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T16:42:56.498 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T16:42:56.530 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T16:42:56.635 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T16:42:57.056 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T16:42:57.169 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:42:57.336 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:42:57.370 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:42:57.495 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:42:57.528 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 10/170 2024-06-02T16:42:57.595 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T16:42:57.938 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T16:42:58.009 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T16:42:58.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:42:58.197 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:42:58.235 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 15/170 2024-06-02T16:42:58.321 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 15/170 2024-06-02T16:42:58.353 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T16:42:58.426 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T16:42:58.726 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T16:42:58.826 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-06-02T16:42:58.926 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T16:42:59.002 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T16:42:59.112 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T16:42:59.173 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T16:42:59.211 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T16:42:59.214 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T16:42:59.323 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T16:42:59.521 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T16:42:59.615 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T16:42:59.757 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T16:42:59.802 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:42:59.859 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:42:59.921 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:43:00.073 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:43:00.110 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:43:00.247 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:43:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:43:00.328 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 10/170 2024-06-02T16:43:00.396 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T16:43:00.429 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T16:43:00.459 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T16:43:00.511 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-06-02T16:43:00.614 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-06-02T16:43:00.674 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-06-02T16:43:00.712 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T16:43:00.735 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/170 2024-06-02T16:43:00.784 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/170 2024-06-02T16:43:00.790 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T16:43:00.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:43:00.824 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/170 2024-06-02T16:43:00.930 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/170 2024-06-02T16:43:00.968 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:43:01.000 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 15/170 2024-06-02T16:43:01.001 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/170 2024-06-02T16:43:01.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/170 2024-06-02T16:43:01.087 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/170 2024-06-02T16:43:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 15/170 2024-06-02T16:43:01.160 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T16:43:01.185 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/170 2024-06-02T16:43:01.221 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.0.0-3882.gb7328fed.el9. 33/170 2024-06-02T16:43:01.230 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T16:43:01.269 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el 34/170 2024-06-02T16:43:01.302 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_6 35/170 2024-06-02T16:43:01.492 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T16:43:01.619 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/170 2024-06-02T16:43:01.685 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/170 2024-06-02T16:43:01.793 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/170 2024-06-02T16:43:01.855 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T16:43:01.967 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/170 2024-06-02T16:43:02.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/170 2024-06-02T16:43:02.059 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T16:43:02.146 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T16:43:02.298 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:43:02.419 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:43:02.716 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/170 2024-06-02T16:43:02.734 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T16:43:02.822 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/170 2024-06-02T16:43:02.859 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/170 2024-06-02T16:43:02.902 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/170 2024-06-02T16:43:02.911 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T16:43:02.950 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T16:43:02.964 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 45/170 2024-06-02T16:43:02.998 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-06-02T16:43:03.018 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_6 46/170 2024-06-02T16:43:03.099 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/170 2024-06-02T16:43:03.101 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-06-02T16:43:03.162 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-06-02T16:43:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/170 2024-06-02T16:43:03.275 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/170 2024-06-02T16:43:03.329 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 48/170 2024-06-02T16:43:03.345 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/170 2024-06-02T16:43:03.396 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 49/170 2024-06-02T16:43:03.477 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/170 2024-06-02T16:43:03.528 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/170 2024-06-02T16:43:03.565 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/170 2024-06-02T16:43:03.601 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/170 2024-06-02T16:43:03.601 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/170 2024-06-02T16:43:03.659 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/170 2024-06-02T16:43:03.723 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T16:43:03.763 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T16:43:03.771 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/170 2024-06-02T16:43:03.801 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T16:43:03.812 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.0.0-3882.gb7328fed.el9. 33/170 2024-06-02T16:43:03.863 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el 34/170 2024-06-02T16:43:03.869 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T16:43:03.894 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_6 35/170 2024-06-02T16:43:03.919 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T16:43:03.982 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T16:43:04.014 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/170 2024-06-02T16:43:04.040 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T16:43:04.074 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/170 2024-06-02T16:43:04.178 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/170 2024-06-02T16:43:04.236 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T16:43:04.279 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T16:43:04.323 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T16:43:04.382 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/170 2024-06-02T16:43:04.449 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T16:43:04.461 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/170 2024-06-02T16:43:04.512 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T16:43:04.580 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T16:43:04.620 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T16:43:04.652 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T16:43:04.835 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T16:43:05.012 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T16:43:05.049 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T16:43:05.094 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T16:43:05.133 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T16:43:05.189 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T16:43:05.244 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T16:43:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T16:43:05.342 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/170 2024-06-02T16:43:05.349 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T16:43:05.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T16:43:05.448 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/170 2024-06-02T16:43:05.474 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T16:43:05.485 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/170 2024-06-02T16:43:05.522 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T16:43:05.524 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/170 2024-06-02T16:43:05.578 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 45/170 2024-06-02T16:43:05.626 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_6 46/170 2024-06-02T16:43:05.665 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T16:43:05.697 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/170 2024-06-02T16:43:05.736 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T16:43:05.788 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T16:43:05.862 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T16:43:05.937 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 48/170 2024-06-02T16:43:06.006 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 49/170 2024-06-02T16:43:06.015 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T16:43:06.091 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T16:43:06.151 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/170 2024-06-02T16:43:06.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/170 2024-06-02T16:43:06.326 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T16:43:06.372 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T16:43:06.410 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T16:43:06.479 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T16:43:06.520 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T16:43:06.582 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T16:43:06.660 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T16:43:06.880 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T16:43:06.948 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T16:43:07.004 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T16:43:07.081 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T16:43:07.149 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T16:43:07.159 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T16:43:07.183 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T16:43:07.198 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T16:43:07.246 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T16:43:07.279 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T16:43:07.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T16:43:07.308 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T16:43:07.365 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T16:43:07.419 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T16:43:07.494 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T16:43:07.527 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T16:43:07.567 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T16:43:07.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T16:43:07.727 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T16:43:07.767 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T16:43:07.802 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T16:43:07.829 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T16:43:07.834 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T16:43:07.898 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T16:43:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T16:43:07.960 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T16:43:08.008 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T16:43:08.063 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T16:43:08.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T16:43:08.191 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T16:43:08.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T16:43:08.395 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T16:43:08.459 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T16:43:08.500 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T16:43:08.573 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T16:43:08.736 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T16:43:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T16:43:08.814 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T16:43:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T16:43:09.837 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T16:43:09.887 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T16:43:09.920 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T16:43:10.052 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T16:43:10.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T16:43:10.168 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T16:43:10.282 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T16:43:10.339 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T16:43:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T16:43:10.585 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T16:43:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T16:43:10.619 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T16:43:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T16:43:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T16:43:10.728 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T16:43:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T16:43:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 103/170 2024-06-02T16:43:11.223 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 103/170 2024-06-02T16:43:11.250 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 104/170 2024-06-02T16:43:11.305 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T16:43:11.611 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T16:43:11.756 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T16:43:11.857 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T16:43:11.889 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 107/170 2024-06-02T16:43:12.005 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 107/170 2024-06-02T16:43:12.033 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 108/170 2024-06-02T16:43:13.463 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T16:43:13.559 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T16:43:13.596 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T16:43:13.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T16:43:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T16:43:14.122 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 103/170 2024-06-02T16:43:14.260 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 103/170 2024-06-02T16:43:14.305 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 104/170 2024-06-02T16:43:14.369 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T16:43:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:14.762 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:14.981 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T16:43:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 107/170 2024-06-02T16:43:15.110 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 107/170 2024-06-02T16:43:15.143 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 108/170 2024-06-02T16:43:15.398 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 110/170 2024-06-02T16:43:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 110/170 2024-06-02T16:43:15.628 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T16:43:15.628 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T16:43:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:15.666 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 111/170 2024-06-02T16:43:18.199 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:18.248 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:18.924 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 109/170 2024-06-02T16:43:18.969 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 110/170 2024-06-02T16:43:19.136 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 110/170 2024-06-02T16:43:19.136 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T16:43:19.137 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T16:43:19.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:19.169 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 111/170 2024-06-02T16:43:28.887 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 111/170 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-06-02T16:43:28.888 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:29.118 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 112/170 2024-06-02T16:43:29.164 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 112/170 2024-06-02T16:43:29.164 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:29.164 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T16:43:29.164 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:30.769 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 113/170 2024-06-02T16:43:30.848 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 113/170 2024-06-02T16:43:30.849 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:30.849 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T16:43:30.849 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T16:43:30.849 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T16:43:30.849 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:31.094 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 114/170 2024-06-02T16:43:31.165 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 114/170 2024-06-02T16:43:31.166 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:31.166 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T16:43:31.166 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T16:43:31.166 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T16:43:31.166 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:31.720 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 115/170 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 115/170 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T16:43:31.789 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:31.938 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T16:43:32.002 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T16:43:32.075 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 111/170 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-06-02T16:43:32.296 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:32.305 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T16:43:32.359 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T16:43:32.446 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T16:43:32.546 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 112/170 2024-06-02T16:43:32.556 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T16:43:32.601 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 112/170 2024-06-02T16:43:32.601 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:32.601 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T16:43:32.601 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:32.723 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T16:43:32.770 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T16:43:32.813 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T16:43:32.843 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T16:43:33.477 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 127/170 2024-06-02T16:43:33.529 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 127/170 2024-06-02T16:43:33.584 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.e 128/170 2024-06-02T16:43:33.695 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed. 129/170 2024-06-02T16:43:33.732 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 130/170 2024-06-02T16:43:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 113/170 2024-06-02T16:43:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 113/170 2024-06-02T16:43:34.375 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:34.376 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T16:43:34.376 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T16:43:34.376 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T16:43:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 114/170 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 114/170 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T16:43:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:34.993 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 130/170 2024-06-02T16:43:35.033 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 131/170 2024-06-02T16:43:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 115/170 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 115/170 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T16:43:35.283 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:35.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T16:43:35.488 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T16:43:35.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T16:43:35.824 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T16:43:35.887 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T16:43:35.977 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T16:43:36.096 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T16:43:36.130 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 131/170 2024-06-02T16:43:36.158 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 132/170 2024-06-02T16:43:36.276 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T16:43:36.318 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 132/170 2024-06-02T16:43:36.329 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T16:43:36.376 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T16:43:36.409 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T16:43:36.514 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el 133/170 2024-06-02T16:43:36.552 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 134/170 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 134/170 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T16:43:36.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:36.686 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 135/170 2024-06-02T16:43:36.724 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 135/170 2024-06-02T16:43:36.867 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 136/170 2024-06-02T16:43:36.934 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 137/170 2024-06-02T16:43:37.192 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 127/170 2024-06-02T16:43:37.230 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 127/170 2024-06-02T16:43:37.287 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.e 128/170 2024-06-02T16:43:37.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed. 129/170 2024-06-02T16:43:37.430 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 130/170 2024-06-02T16:43:37.974 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T16:43:38.022 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 139/170 2024-06-02T16:43:38.092 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 139/170 2024-06-02T16:43:38.092 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:38.092 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T16:43:38.092 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T16:43:38.093 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T16:43:38.093 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:38.156 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3882.gb7328 140/170 2024-06-02T16:43:38.229 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3882.gb7328 140/170 2024-06-02T16:43:38.229 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:38.229 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T16:43:38.229 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:38.298 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 141/170 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 141/170 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T16:43:38.375 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:38.741 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 142/170 2024-06-02T16:43:38.812 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 142/170 2024-06-02T16:43:38.813 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:38.813 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T16:43:38.813 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T16:43:38.813 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T16:43:38.813 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:38.816 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 130/170 2024-06-02T16:43:38.865 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 131/170 2024-06-02T16:43:40.035 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 131/170 2024-06-02T16:43:40.073 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 132/170 2024-06-02T16:43:40.241 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 132/170 2024-06-02T16:43:40.428 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el 133/170 2024-06-02T16:43:40.476 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 134/170 2024-06-02T16:43:40.552 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 134/170 2024-06-02T16:43:40.552 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:40.552 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T16:43:40.552 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T16:43:40.553 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T16:43:40.553 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:40.610 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 135/170 2024-06-02T16:43:40.650 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 135/170 2024-06-02T16:43:40.789 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 136/170 2024-06-02T16:43:40.861 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 137/170 2024-06-02T16:43:41.950 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T16:43:41.987 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 139/170 2024-06-02T16:43:42.058 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 139/170 2024-06-02T16:43:42.058 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:42.058 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T16:43:42.058 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T16:43:42.059 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T16:43:42.059 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:42.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3882.gb7328 140/170 2024-06-02T16:43:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3882.gb7328 140/170 2024-06-02T16:43:42.189 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:42.189 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T16:43:42.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:42.289 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 141/170 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 141/170 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T16:43:42.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:42.764 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 142/170 2024-06-02T16:43:42.847 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 142/170 2024-06-02T16:43:42.848 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T16:43:42.848 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T16:43:42.848 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T16:43:42.848 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T16:43:42.848 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:43.796 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 143/170 2024-06-02T16:43:43.873 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 144/170 2024-06-02T16:43:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 145/170 2024-06-02T16:43:43.971 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T16:43:44.009 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T16:43:44.281 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 148/170 2024-06-02T16:43:44.334 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T16:43:44.367 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_ 150/170 2024-06-02T16:43:44.398 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T16:43:44.444 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T16:43:44.508 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T16:43:45.409 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:45.462 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:45.523 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:46.889 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 155/170 2024-06-02T16:43:46.994 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T16:43:47.047 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T16:43:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T16:43:47.230 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T16:43:47.262 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T16:43:47.297 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T16:43:47.339 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T16:43:47.339 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T16:43:47.496 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T16:43:47.542 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T16:43:47.542 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T16:43:47.662 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T16:43:47.701 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T16:43:47.738 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:47.738 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:48.081 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:48.081 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T16:43:48.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 143/170 2024-06-02T16:43:48.189 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 144/170 2024-06-02T16:43:48.227 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T16:43:48.245 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 145/170 2024-06-02T16:43:48.270 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T16:43:48.286 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T16:43:48.325 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T16:43:48.391 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T16:43:48.638 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 148/170 2024-06-02T16:43:48.647 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T16:43:48.647 INFO:teuthology.orchestra.run.smithi114.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-02T16:43:48.647 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:48.699 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T16:43:48.732 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_ 150/170 2024-06-02T16:43:48.771 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T16:43:48.819 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T16:43:48.873 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T16:43:49.764 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:49.819 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:49.878 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T16:43:51.305 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 155/170 2024-06-02T16:43:51.542 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T16:43:51.609 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T16:43:51.754 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T16:43:51.793 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T16:43:51.834 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T16:43:51.868 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T16:43:51.909 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T16:43:51.909 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T16:43:52.052 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T16:43:52.131 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T16:43:52.131 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T16:43:52.268 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T16:43:52.307 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T16:43:52.341 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:52.342 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:52.678 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T16:43:52.678 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T16:43:52.824 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T16:43:52.868 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T16:43:52.990 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T16:43:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T16:43:53.237 INFO:teuthology.orchestra.run.smithi052.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-02T16:43:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 1/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 2/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 3/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 4/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3882.gb7328 5/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 6/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 7/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:43:54.484 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 10/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 11/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 12/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 13/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_ 15/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 16/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 17/170 2024-06-02T16:43:54.485 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_6 18/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 19/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 20/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el 21/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.0.0-3882.gb7328fed.el9. 22/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_6 23/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 24/170 2024-06-02T16:43:54.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 25/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 26/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 27/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 28/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 29/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed. 30/170 2024-06-02T16:43:54.487 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 31/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 32/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 33/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el 34/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 35/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.e 36/170 2024-06-02T16:43:54.488 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 37/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 38/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 39/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T16:43:54.489 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T16:43:54.490 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T16:43:54.491 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T16:43:54.491 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T16:43:54.491 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T16:43:54.491 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T16:43:54.492 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T16:43:54.492 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T16:43:54.492 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T16:43:54.492 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T16:43:54.493 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T16:43:54.494 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T16:43:54.494 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T16:43:54.495 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T16:43:54.495 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T16:43:54.495 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T16:43:54.495 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T16:43:54.496 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T16:43:54.496 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T16:43:54.496 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T16:43:54.496 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T16:43:54.496 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T16:43:54.497 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T16:43:54.498 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T16:43:54.499 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T16:43:54.499 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T16:43:54.499 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T16:43:54.499 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T16:43:54.499 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T16:43:54.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T16:43:54.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T16:43:54.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T16:43:54.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T16:43:54.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T16:43:54.501 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T16:43:54.502 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T16:43:54.502 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T16:43:54.502 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T16:43:54.502 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T16:43:54.503 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T16:43:54.504 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T16:43:54.505 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T16:43:54.506 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 149/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 151/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T16:43:54.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T16:43:54.508 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T16:43:56.695 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T16:43:56.696 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T16:43:56.697 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.698 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.699 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T16:43:56.700 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T16:43:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T16:43:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T16:43:56.703 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T16:43:56.704 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T16:43:56.705 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.706 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T16:43:56.707 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T16:43:56.708 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T16:43:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T16:43:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T16:43:56.709 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:43:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-06-02T16:43:57.402 DEBUG:teuthology.parallel:result is None 2024-06-02T16:43:59.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 1/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 2/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 3/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 4/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3882.gb7328 5/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 6/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 7/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 8/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 9/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 10/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 11/170 2024-06-02T16:43:59.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 12/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 13/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 14/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_ 15/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 16/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 17/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_6 18/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86 19/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 20/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el 21/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.0.0-3882.gb7328fed.el9. 22/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_6 23/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 24/170 2024-06-02T16:43:59.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 25/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 26/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 27/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 28/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 29/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed. 30/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noa 31/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.n 32/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3882.gb73 33/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el 34/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 35/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.e 36/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 37/170 2024-06-02T16:43:59.023 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 38/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 39/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T16:43:59.024 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T16:43:59.025 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T16:43:59.026 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T16:43:59.027 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T16:43:59.028 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T16:43:59.029 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T16:43:59.030 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T16:43:59.031 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 149/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 151/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T16:43:59.032 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T16:43:59.033 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T16:44:01.320 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.321 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.322 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.323 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.0.0-3882.gb7328fed.el9.noarch 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T16:44:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T16:44:01.325 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T16:44:01.326 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T16:44:01.327 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T16:44:01.328 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T16:44:01.329 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T16:44:01.330 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T16:44:01.331 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T16:44:01.332 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.0.0-3882.gb7328fed.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T16:44:01.333 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T16:44:01.334 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T16:44:01.334 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:01.334 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-06-02T16:44:01.977 DEBUG:teuthology.parallel:result is None 2024-06-02T16:44:01.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b7328fed0e2e9ab66b09f8134f3cebfc71214504 2024-06-02T16:44:02.194 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T16:44:02.254 INFO:teuthology.orchestra.run.smithi052.stdout:19.0.0-3882.gb7328fed.el9 2024-06-02T16:44:02.255 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3882.gb7328fed.el9 2024-06-02T16:44:02.255 INFO:teuthology.task.install:The correct ceph version 19.0.0-3882.gb7328fed is installed. 2024-06-02T16:44:02.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b7328fed0e2e9ab66b09f8134f3cebfc71214504 2024-06-02T16:44:02.475 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T16:44:02.538 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-3882.gb7328fed.el9 2024-06-02T16:44:02.538 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3882.gb7328fed.el9 2024-06-02T16:44:02.538 INFO:teuthology.task.install:The correct ceph version 19.0.0-3882.gb7328fed is installed. 2024-06-02T16:44:02.540 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T16:44:02.540 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:02.540 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T16:44:02.612 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:02.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T16:44:02.688 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T16:44:02.688 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:02.688 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T16:44:02.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T16:44:02.858 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:02.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T16:44:02.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T16:44:03.039 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T16:44:03.039 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:03.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T16:44:03.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T16:44:03.216 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:03.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T16:44:03.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T16:44:03.396 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T16:44:03.397 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:03.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T16:44:03.462 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T16:44:03.568 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:03.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T16:44:03.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T16:44:03.750 INFO:teuthology.run_tasks:Running task ceph... 2024-06-02T16:44:03.839 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-02T16:44:03.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-06-02T16:44:03.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-06-02T16:44:03.925 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-02T16:44:03.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T16:44:03.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T16:44:04.010 INFO:tasks.ceph:Creating extra log directories... 2024-06-02T16:44:04.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T16:44:04.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T16:44:04.106 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-06-02T16:44:04.106 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-06-02T16:44:04.107 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-06-02T16:44:04.107 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:04.107 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T16:44:04.149 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:04.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:04.388 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:04.388 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T16:44:04.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:04.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:04.770 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-02T16:44:04.770 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-02T16:44:04.770 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7720992', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '7aec00165b4b073a25396fd0279151d2b2fa23fe'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6827, 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504', 'sleep_before_teardown': 0, 'subset': '382/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7aec00165b4b073a25396fd0279151d2b2fa23fe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5GE6YoqUBP0ncobsyouAxYllfuMWwGiN2SISInS7wnj1eA2mS3pO/6vFqCGz6RMDzdBrTbT0MHHks9GYRhBBw=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInQY9SYK8j4ZrGvDvSMUZgSrY0sWmcj7AHTG71ToFO6CP4MCJsel22BfAd/+fHspFcFt8tBFdEtUVoY0jFC9yk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b7328fed0e2e9ab66b09f8134f3cebfc71214504', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a', 'timestamp': '2024-05-22_20:24:16', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-02T16:44:04.771 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T16:44:04.775 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T16:44:04.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T16:44:04.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T16:44:04.947 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:04.948 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T16:44:04.986 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T16:44:04.987 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-06-02 16:43:53.730007805 +0000 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-06-02 16:41:13.076839555 +0000 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-06-02 16:41:13.076839555 +0000 2024-06-02T16:44:05.066 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-06-02 16:41:13.076839555 +0000 2024-06-02T16:44:05.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T16:44:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-06-02T16:44:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-06-02T16:44:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000259569 s, 2.0 MB/s 2024-06-02T16:44:05.170 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T16:44:05.213 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-06-02T16:44:05.293 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T16:44:05.293 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:05.293 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-06-02T16:44:05.293 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:05.293 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:05.294 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-06-02 16:43:53.731007792 +0000 2024-06-02T16:44:05.294 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-06-02 16:41:13.684831999 +0000 2024-06-02T16:44:05.294 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-06-02 16:41:13.684831999 +0000 2024-06-02T16:44:05.294 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-06-02 16:41:13.684831999 +0000 2024-06-02T16:44:05.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T16:44:05.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-06-02T16:44:05.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-06-02T16:44:05.396 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000178889 s, 2.9 MB/s 2024-06-02T16:44:05.399 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T16:44:05.439 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:05.522 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-06-02 16:43:53.732007780 +0000 2024-06-02T16:44:05.523 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-06-02 16:41:14.279824605 +0000 2024-06-02T16:44:05.523 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-06-02 16:41:14.279824605 +0000 2024-06-02T16:44:05.523 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-06-02 16:41:14.279824605 +0000 2024-06-02T16:44:05.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T16:44:05.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-06-02T16:44:05.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-06-02T16:44:05.624 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000180131 s, 2.8 MB/s 2024-06-02T16:44:05.627 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T16:44:05.666 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-06-02T16:44:05.747 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T16:44:05.747 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:05.747 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-06-02T16:44:05.747 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:05.747 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:05.748 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-06-02 16:43:53.732007780 +0000 2024-06-02T16:44:05.748 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-06-02 16:41:14.887817050 +0000 2024-06-02T16:44:05.748 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-06-02 16:41:14.887817050 +0000 2024-06-02T16:44:05.748 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-06-02 16:41:14.887817050 +0000 2024-06-02T16:44:05.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T16:44:05.852 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-06-02T16:44:05.852 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-06-02T16:44:05.853 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000192246 s, 2.7 MB/s 2024-06-02T16:44:05.856 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T16:44:05.909 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:05.909 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:05.909 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T16:44:05.966 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T16:44:05.966 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-06-02T16:44:06.016 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-06-02 16:43:49.122261294 +0000 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-06-02 16:41:09.763662099 +0000 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-06-02 16:41:09.763662099 +0000 2024-06-02T16:44:06.017 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-06-02 16:41:09.763662099 +0000 2024-06-02T16:44:06.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T16:44:06.098 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-06-02T16:44:06.098 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-06-02T16:44:06.098 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000435879 s, 1.2 MB/s 2024-06-02T16:44:06.102 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T16:44:06.163 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-06-02T16:44:06.268 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T16:44:06.268 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-06-02 16:43:49.122261294 +0000 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-06-02 16:41:10.353649810 +0000 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-06-02 16:41:10.354649789 +0000 2024-06-02T16:44:06.269 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-06-02 16:41:10.353649810 +0000 2024-06-02T16:44:06.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T16:44:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-06-02T16:44:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-06-02T16:44:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000358745 s, 1.4 MB/s 2024-06-02T16:44:06.353 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T16:44:06.409 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-06-02T16:44:06.464 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T16:44:06.464 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:06.464 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-06-02T16:44:06.464 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:06.465 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:06.465 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-06-02 16:43:49.123261274 +0000 2024-06-02T16:44:06.465 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-06-02 16:41:10.908638249 +0000 2024-06-02T16:44:06.465 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-06-02 16:41:10.908638249 +0000 2024-06-02T16:44:06.465 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-06-02 16:41:10.908638249 +0000 2024-06-02T16:44:06.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T16:44:06.545 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-06-02T16:44:06.545 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-06-02T16:44:06.545 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000380911 s, 1.3 MB/s 2024-06-02T16:44:06.548 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T16:44:06.604 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-06-02T16:44:06.654 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T16:44:06.654 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T16:44:06.654 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-06-02 16:43:49.124261253 +0000 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-06-02 16:41:11.526625376 +0000 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-06-02 16:41:11.526625376 +0000 2024-06-02T16:44:06.655 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-06-02 16:41:11.526625376 +0000 2024-06-02T16:44:06.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T16:44:06.731 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-06-02T16:44:06.731 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-06-02T16:44:06.731 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00048035 s, 1.1 MB/s 2024-06-02T16:44:06.735 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T16:44:06.791 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:06.791 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T16:44:06.791 INFO:tasks.ceph:Generating config... 2024-06-02T16:44:06.792 INFO:tasks.ceph:[client] client mount timeout = 600 2024-06-02T16:44:06.793 INFO:tasks.ceph:[client] debug client = 20 2024-06-02T16:44:06.793 INFO:tasks.ceph:[client] debug ms = 1 2024-06-02T16:44:06.793 INFO:tasks.ceph:[client] pid file = 2024-06-02T16:44:06.793 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-06-02T16:44:06.793 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-06-02T16:44:06.793 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] debug mds = 20 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] debug ms = 1 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] mds debug frag = True 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-06-02T16:44:06.793 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mgr] debug client = 20 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-06-02T16:44:06.794 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-06-02T16:44:06.794 INFO:tasks.ceph:[osd] bdev async discard = True 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-02T16:44:06.795 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-06-02T16:44:06.796 INFO:tasks.ceph:Setting up mon.a... 2024-06-02T16:44:06.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-02T16:44:06.949 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-06-02T16:44:06.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-02T16:44:07.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T16:44:07.171 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.114'), ('mon.c', '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]')] 2024-06-02T16:44:07.171 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-06-02T16:44:07.172 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:07.172 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T16:44:07.229 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.114 --addv c '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 39df44fa-6b94-46ae-87c4-569eff4461cc 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 39df44fa-6b94-46ae-87c4-569eff4461cc 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-06-02T16:44:07.390030+0000 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-06-02T16:44:07.390030+0000 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-06-02T16:44:07.388 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] mon.c 2024-06-02T16:44:07.389 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-02T16:44:07.391 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T16:44:07.435 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 39df44fa-6b94-46ae-87c4-569eff4461cc... 2024-06-02T16:44:07.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T16:44:07.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T16:44:07.620 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-06-02T16:44:07.620 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-06-02T16:44:07.620 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T16:44:07.621 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-06-02T16:44:07.622 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-06-02T16:44:07.623 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.52,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 39df44fa-6b94-46ae-87c4-569eff4461cc 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-06-02T16:44:07.624 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-06-02T16:44:07.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-06-02T16:44:07.626 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-06-02T16:44:07.627 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T16:44:07.628 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-06-02T16:44:07.629 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-06-02T16:44:07.630 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds cache max size = 1000 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds log max segments = 1 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-06-02T16:44:07.631 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.632 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-06-02T16:44:07.633 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-06-02T16:44:07.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 39df44fa-6b94-46ae-87c4-569eff4461cc 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.635 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.636 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-06-02T16:44:07.637 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-06-02T16:44:07.638 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-06-02T16:44:07.639 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-06-02T16:44:07.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: mon down mkfs grace = 300 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T16:44:07.641 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-06-02T16:44:07.642 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds cache max size = 1000 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds log max segments = 1 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-06-02T16:44:07.643 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-06-02T16:44:07.658 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-02T16:44:07.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-02T16:44:07.798 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-02T16:44:07.798 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:07.798 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-02T16:44:07.856 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:07.856 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-02T16:44:07.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:44:07.909 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:07.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T16:44:07.910 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T16:44:08.042 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:08.043 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:08.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:44:08.143 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:08.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T16:44:08.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T16:44:08.262 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:08.262 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:08.358 INFO:tasks.ceph:Setting up mon nodes... 2024-06-02T16:44:08.358 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-02T16:44:08.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T16:44:08.538 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T16:44:08.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T16:44:08.708 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T16:44:08.718 INFO:tasks.ceph:Setting up mds nodes... 2024-06-02T16:44:08.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T16:44:08.898 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T16:44:08.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-02T16:44:08.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T16:44:09.155 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T16:44:09.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-06-02T16:44:09.256 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T16:44:09.421 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T16:44:09.430 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-06-02T16:44:09.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T16:44:09.646 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T16:44:09.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-06-02T16:44:09.738 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-02T16:44:09.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T16:44:09.866 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-02T16:44:09.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-06-02T16:44:10.038 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-06-02T16:44:10.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-02T16:44:10.202 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-02T16:44:10.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-06-02T16:44:10.367 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-06-02T16:44:10.408 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-02T16:44:10.408 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T16:44:10.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-02T16:44:10.502 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:10.502 INFO:tasks.ceph:role: osd.0 2024-06-02T16:44:10.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:44:10.502 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T16:44:10.592 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:10.592 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:10.592 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:10.593 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:10.625 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-06-02T16:44:10.631 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-06-02T16:44:10.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-02T16:44:10.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-02T16:44:10.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-02T16:44:10.883 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:10.883 INFO:tasks.ceph:role: osd.1 2024-06-02T16:44:10.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:44:10.883 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T16:44:10.959 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:10.959 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:10.960 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:10.993 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-06-02T16:44:10.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-06-02T16:44:10.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-02T16:44:11.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-02T16:44:11.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-02T16:44:11.266 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:11.267 INFO:tasks.ceph:role: osd.2 2024-06-02T16:44:11.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:44:11.267 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:11.349 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:11.350 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:11.350 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:11.350 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:11.383 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-06-02T16:44:11.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-06-02T16:44:11.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-02T16:44:11.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-02T16:44:11.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-02T16:44:11.865 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:11.865 INFO:tasks.ceph:role: osd.3 2024-06-02T16:44:11.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:44:11.865 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T16:44:11.953 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:11.953 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:11.953 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:11.953 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:11.987 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-06-02T16:44:11.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-06-02T16:44:11.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-02T16:44:12.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-02T16:44:12.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:12.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.328+0000 7f91e800d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-02T16:44:12.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.329+0000 7f91e800d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-02T16:44:12.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.329+0000 7f91e800d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T16:44:12.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.329+0000 7f91e800d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T16:44:12.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.329+0000 7f91e800d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T16:44:12.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:12.333+0000 7f91e800d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-02T16:44:15.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T16:44:15.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.780+0000 7f762820d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-02T16:44:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.780+0000 7f762820d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-02T16:44:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.780+0000 7f762820d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T16:44:15.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.781+0000 7f762820d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T16:44:15.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.781+0000 7f762820d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T16:44:15.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:15.783+0000 7f762820d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-02T16:44:18.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T16:44:18.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.989+0000 7f7b3d413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-02T16:44:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.989+0000 7f7b3d413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-02T16:44:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.989+0000 7f7b3d413640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T16:44:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.989+0000 7f7b3d413640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T16:44:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.990+0000 7f7b3d413640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T16:44:18.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:18.992+0000 7f7b3d413640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-02T16:44:22.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T16:44:22.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:22.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.441+0000 7f08732b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-02T16:44:22.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.442+0000 7f08732b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-02T16:44:22.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.442+0000 7f08732b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T16:44:22.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.442+0000 7f08732b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T16:44:22.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.442+0000 7f08732b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T16:44:22.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:22.445+0000 7f08732b3640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-02T16:44:25.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T16:44:25.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-02T16:44:25.575 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:25.575 INFO:tasks.ceph:role: osd.4 2024-06-02T16:44:25.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:44:25.575 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:25.664 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:25.665 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:25.665 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:25.665 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:26.078 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-06-02T16:44:26.084 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-06-02T16:44:26.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-02T16:44:26.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-02T16:44:26.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-02T16:44:26.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:26.386 INFO:tasks.ceph:role: osd.5 2024-06-02T16:44:26.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:44:26.386 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T16:44:26.469 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:26.825 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-06-02T16:44:26.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-06-02T16:44:26.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-02T16:44:26.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-02T16:44:27.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-02T16:44:27.073 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:27.073 INFO:tasks.ceph:role: osd.6 2024-06-02T16:44:27.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:44:27.074 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:27.146 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:27.147 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:27.147 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:27.147 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:27.524 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-06-02T16:44:27.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-06-02T16:44:27.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-02T16:44:27.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-02T16:44:27.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-02T16:44:27.770 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T16:44:27.770 INFO:tasks.ceph:role: osd.7 2024-06-02T16:44:27.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:44:27.770 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T16:44:27.846 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T16:44:27.847 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T16:44:28.251 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-06-02T16:44:28.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-06-02T16:44:28.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-02T16:44:28.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-02T16:44:28.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.625+0000 7f3f9f414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-02T16:44:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.626+0000 7f3f9f414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-02T16:44:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.626+0000 7f3f9f414640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T16:44:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.626+0000 7f3f9f414640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T16:44:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.626+0000 7f3f9f414640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T16:44:28.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:28.629+0000 7f3f9f414640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-02T16:44:31.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T16:44:31.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:31.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.789+0000 7f6d5820e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-02T16:44:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.789+0000 7f6d5820e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-02T16:44:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.789+0000 7f6d5820e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T16:44:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.789+0000 7f6d5820e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T16:44:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.789+0000 7f6d5820e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T16:44:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:31.792+0000 7f6d5820e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-02T16:44:34.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T16:44:34.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:34.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:44:34.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:34.998+0000 7f436fe14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-02T16:44:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:34.998+0000 7f436fe14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-02T16:44:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:34.998+0000 7f436fe14640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T16:44:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:34.998+0000 7f436fe14640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T16:44:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:34.998+0000 7f436fe14640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T16:44:34.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:35.001+0000 7f436fe14640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-02T16:44:37.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-02T16:44:38.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:38.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.152+0000 7fe69fba7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-02T16:44:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.153+0000 7fe69fba7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-02T16:44:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.153+0000 7fe69fba7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T16:44:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.153+0000 7fe69fba7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T16:44:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.153+0000 7fe69fba7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T16:44:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:38.156+0000 7fe69fba7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-02T16:44:41.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-02T16:44:41.188 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-02T16:44:41.188 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-02T16:44:41.281 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-02T16:44:41.370 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-06-02T16:44:41.458 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-02T16:44:41.549 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-02T16:44:41.638 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.638 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-02T16:44:41.725 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:41.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-02T16:44:41.815 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:41.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-02T16:44:41.902 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:41.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-06-02T16:44:41.985 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:41.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-06-02T16:44:42.069 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-02T16:44:42.153 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-02T16:44:42.238 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-02T16:44:42.319 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-02T16:44:42.396 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:42.396 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-02T16:44:42.457 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:42.457 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-06-02T16:44:42.516 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.517 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-02T16:44:42.574 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:42.574 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-06-02T16:44:42.627 INFO:tasks.ceph:Adding keys to all mons... 2024-06-02T16:44:42.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T16:44:42.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T16:44:42.714 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-06-02T16:44:42.714 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBYoVxmkKoxIBAAqO4kNYlr+tMKK3s4ubHuVA== 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBYoVxmkrauNRAAtSub8IGAOmQ8jfF/xTX67A== 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmjEFeCRAA+YqDS+DB83q8NUpSJ8FO6A== 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcoVxmbTuuExAAAzEdHpKz4dpD5YaxsFcPmQ== 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBfoVxmUW6eLhAA0LnI1X4gkZleDKWEsNX3tg== 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-06-02T16:44:42.715 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBioVxmAv0SOxAAlLO2sN1rvUm/UC4BoqAtZQ== 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBmoVxmw9NuGhAAqFXZzV11Daf/s4vHmrz0Jw== 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBYoVxmeV9VKhAAWRGPPyEnG/7idTtgebGCKA== 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmIbxBGRAAG68t8uJC+GuNbFc+SC8/NA== 2024-06-02T16:44:42.716 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmjpKiJhAAWpU4lunYnPmsz9zy/PDTdg== 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBsoVxmqFpWJRAAOA2Nsp5qjzyy+QUEl17VqA== 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBvoVxmh40YLxAAE/CjbilEWfYvm9s981NWFg== 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQByoVxmfLmLOxAAKVMtkROjbvvGefI4R322Dw== 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2024-06-02T16:44:42.717 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB2oVxm4PEpCRAAnsHEBG7RsSY+jEhAyuN9ww== 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ== 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout:[client.2] 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBaoVxmHDpvAhAAzdzaT56O4WUkRLNYHP3fnw== 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBaoVxmRyQ6DBAA81tsOoBRr09hbKxgg/1YuQ== 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout:[client.3] 2024-06-02T16:44:42.718 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBaoVxm29IKFhAA3bLnZJX2M0CykpQt+g2JHA== 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBYoVxmkKoxIBAAqO4kNYlr+tMKK3s4ubHuVA== 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBYoVxmkrauNRAAtSub8IGAOmQ8jfF/xTX67A== 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZoVxmjEFeCRAA+YqDS+DB83q8NUpSJ8FO6A== 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-06-02T16:44:42.722 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBcoVxmbTuuExAAAzEdHpKz4dpD5YaxsFcPmQ== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBfoVxmUW6eLhAA0LnI1X4gkZleDKWEsNX3tg== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBioVxmAv0SOxAAlLO2sN1rvUm/UC4BoqAtZQ== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBmoVxmw9NuGhAAqFXZzV11Daf/s4vHmrz0Jw== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBYoVxmeV9VKhAAWRGPPyEnG/7idTtgebGCKA== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZoVxmIbxBGRAAG68t8uJC+GuNbFc+SC8/NA== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZoVxmjpKiJhAAWpU4lunYnPmsz9zy/PDTdg== 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-06-02T16:44:42.723 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBsoVxmqFpWJRAAOA2Nsp5qjzyy+QUEl17VqA== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBvoVxmh40YLxAAE/CjbilEWfYvm9s981NWFg== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQByoVxmfLmLOxAAKVMtkROjbvvGefI4R322Dw== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB2oVxm4PEpCRAAnsHEBG7RsSY+jEhAyuN9ww== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBaoVxmHDpvAhAAzdzaT56O4WUkRLNYHP3fnw== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBaoVxmRyQ6DBAA81tsOoBRr09hbKxgg/1YuQ== 2024-06-02T16:44:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2024-06-02T16:44:42.725 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBaoVxm29IKFhAA3bLnZJX2M0CykpQt+g2JHA== 2024-06-02T16:44:42.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T16:44:42.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T16:44:42.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:42.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:43.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:43.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:43.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.636 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:43.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T16:44:43.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T16:44:43.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:43.917 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:44.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:44.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T16:44:44.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T16:44:44.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:44.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:44.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:44.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:45.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:45.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:45.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:45.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T16:44:45.328 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-02T16:44:45.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-02T16:44:45.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T16:44:45.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-02T16:44:45.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-02T16:44:45.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T16:44:45.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-02T16:44:45.982 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-02T16:44:46.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T16:44:46.211 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-02T16:44:46.287 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:46.295 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T16:44:46.348 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-02T16:44:46.349 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-02T16:44:46.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-02T16:44:46.354 INFO:tasks.ceph.mon.a:Started 2024-06-02T16:44:46.354 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-02T16:44:46.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-02T16:44:46.359 INFO:tasks.ceph.mon.b:Started 2024-06-02T16:44:46.359 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-02T16:44:46.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-02T16:44:46.363 INFO:tasks.ceph.mon.c:Started 2024-06-02T16:44:46.364 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-02T16:44:46.364 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-02T16:44:46.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-02T16:44:46.369 INFO:tasks.ceph.mgr.y:Started 2024-06-02T16:44:46.369 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-02T16:44:46.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-02T16:44:46.374 INFO:tasks.ceph.mgr.x:Started 2024-06-02T16:44:46.374 INFO:tasks.ceph:Setting crush tunables to default 2024-06-02T16:44:46.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-06-02T16:44:46.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.550+0000 7faf6bc00640 1 Processor -- start 2024-06-02T16:44:46.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.550+0000 7faf6bc00640 1 -- start start 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.551+0000 7faf6bc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.551+0000 7faf6bc00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf6bc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6409eec0 con 0x7faf640b0610 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf6bc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7faf6406ebd0 con 0x7faf640ae5c0 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf6bc00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf6415e490 con 0x7faf6415ec80 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:43182/0 (socket says 172.21.15.52:43182) 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 learned_addr learned my addr 172.21.15.52:0/3083798895 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:50468/0 (socket says 172.21.15.52:50468) 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 msgr2=0x7faf6415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 msgr2=0x7faf6415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 msgr2=0x7faf6415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 msgr2=0x7faf6415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf69c00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T16:44:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.552+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T16:44:46.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.570+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056614051 0 0) 0x7faf6409eec0 con 0x7faf640b0610 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.570+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf4c003520 con 0x7faf640b0610 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3517331849 0 0) 0x7faf4c003520 con 0x7faf640b0610 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 msgr2=0x7faf6415ddf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf6415ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 msgr2=0x7faf6415d8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 --2- 172.21.15.52:0/3083798895 >> v2:172.21.15.114:3300/0 conn(0x7faf640ae5c0 0x7faf6415d8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6415e770 con 0x7faf640b0610 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7faf58001710 con 0x7faf640b0610 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 >> v1:172.21.15.52:6789/0 conn(0x7faf640b0610 legacy=0x7faf640adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c003a50 0x7faf4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf4c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf6406ebd0 con 0x7faf4c004800 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf6415e490 con 0x7faf4c003a50 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf4c00bc00 con 0x7faf6415ec80 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.571+0000 7faf69200640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c003a50 0x7faf4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf69c00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf4c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 msgr2=0x7faf4c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf6415ec80 0x7faf4c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c003a50 msgr2=0x7faf4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c003a50 0x7faf4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf63e00640 1 -- 172.21.15.52:0/3083798895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c003520 con 0x7faf4c004800 2024-06-02T16:44:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.572+0000 7faf69200640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c003a50 0x7faf4c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:44:46.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.573+0000 7faf63e00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf4c004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf50009890 tx=0x7faf4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87c7bb1e74a9178 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:46.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.574+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50037070 con 0x7faf4c004800 2024-06-02T16:44:46.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.574+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5002ad00 con 0x7faf4c004800 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.574+0000 7faf63400640 1 -- 172.21.15.52:0/3083798895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5000f040 con 0x7faf4c004800 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.574+0000 7faf6bc00640 1 -- 172.21.15.52:0/3083798895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 msgr2=0x7faf4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.574+0000 7faf6bc00640 1 --2- 172.21.15.52:0/3083798895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf4c004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf50009890 tx=0x7faf4c005830 comp rx=0 tx=0).stop 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.575+0000 7faf69c00640 1 -- 172.21.15.52:0/3083798895 reap_dead start 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.575+0000 7faf6bc00640 1 -- 172.21.15.52:0/3083798895 shutdown_connections 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.575+0000 7faf6bc00640 1 -- 172.21.15.52:0/3083798895 >> 172.21.15.52:0/3083798895 conn(0x7faf640b3200 msgr2=0x7faf640d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.575+0000 7faf6bc00640 1 -- 172.21.15.52:0/3083798895 shutdown_connections 2024-06-02T16:44:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.575+0000 7faf6bc00640 1 -- 172.21.15.52:0/3083798895 wait complete. 2024-06-02T16:44:46.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.577+0000 7faf6bc00640 1 Processor -- start 2024-06-02T16:44:46.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.577+0000 7faf6bc00640 1 -- start start 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf640ca250 0x7faf6414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf64073570 0x7faf64073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf6415ddf0 con 0x7faf4c004800 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf6406e860 con 0x7faf64073570 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf6bc00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf6415df70 con 0x7faf640ca250 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf69200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf69200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46668/0 (socket says 172.21.15.52:46668) 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf69200640 1 -- 172.21.15.52:0/2330254305 learned_addr learned my addr 172.21.15.52:0/2330254305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf63e00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf640ca250 0x7faf6414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.578+0000 7faf69c00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf64073570 0x7faf64073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 -- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf640ca250 msgr2=0x7faf6414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf640ca250 0x7faf6414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 -- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf64073570 msgr2=0x7faf64073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf64073570 0x7faf64073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 -- 172.21.15.52:0/2330254305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf64151560 con 0x7faf4c004800 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf69200640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e6d0 tx=0x7faf5800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf580050d0 con 0x7faf4c004800 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf58018070 con 0x7faf4c004800 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58005470 con 0x7faf4c004800 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.579+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf640ca750 con 0x7faf4c004800 2024-06-02T16:44:46.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.580+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf640cad10 con 0x7faf4c004800 2024-06-02T16:44:46.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.580+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faf5800c8d0 con 0x7faf4c004800 2024-06-02T16:44:46.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.580+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faf5801d460 con 0x7faf4c004800 2024-06-02T16:44:46.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.581+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf64069520 con 0x7faf4c004800 2024-06-02T16:44:46.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.584+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faf64151560 con 0x7faf4c004800 2024-06-02T16:44:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.657+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7faf640d1cb0 con 0x7faf4c004800 2024-06-02T16:44:46.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.660+0000 7faf60c00640 1 -- 172.21.15.52:0/2330254305 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faf5800cd50 con 0x7faf4c004800 2024-06-02T16:44:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-06-02T16:44:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.661+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 msgr2=0x7faf64151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.661+0000 7faf6bc00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e6d0 tx=0x7faf5800eb90 comp rx=0 tx=0).stop 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 shutdown_connections 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf64073570 0x7faf64073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf640ca250 0x7faf6414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 --2- 172.21.15.52:0/2330254305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf4c004800 0x7faf64151020 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 >> 172.21.15.52:0/2330254305 conn(0x7faf640b3200 msgr2=0x7faf6415cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 shutdown_connections 2024-06-02T16:44:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:46.662+0000 7faf6bc00640 1 -- 172.21.15.52:0/2330254305 wait complete. 2024-06-02T16:44:46.678 INFO:tasks.ceph:check_enable_crimson: False 2024-06-02T16:44:46.678 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-02T16:44:46.678 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:46.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-02T16:44:46.754 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:46.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-02T16:44:46.866 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:46.868+0000 7fc0d048c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T16:44:46.868 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:46.869+0000 7f0279e12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T16:44:46.871 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:46.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-02T16:44:46.992 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:44:46.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-02T16:44:47.061 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:47.062+0000 7f0279e12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T16:44:47.091 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:47.092+0000 7fc0d048c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T16:44:47.121 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:47.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-02T16:44:47.129 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:47.128+0000 7f0279e12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T16:44:47.156 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:47.157+0000 7fc0d048c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T16:44:47.200 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:47.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-02T16:44:47.269 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:47.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-02T16:44:47.391 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:44:47.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-02T16:44:47.453 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:47.455+0000 7f0279e12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T16:44:47.456 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:47.457+0000 7fc0d048c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T16:44:47.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 96fa31bd-dccc-4411-8b0c-cc23aa6d8571 0 2024-06-02T16:44:47.511 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:47.512+0000 7f0279e12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T16:44:47.512 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:47.513+0000 7fc0d048c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T16:44:47.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.692+0000 7f9916000640 1 Processor -- start 2024-06-02T16:44:47.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.692+0000 7f9916000640 1 -- start start 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9916000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100731f0 0x7f99100cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9916000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99100cfd90 0x7f99100b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9916000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100d0580 con 0x7f991015f5d0 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9916000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f99100d0860 con 0x7f99100cfd90 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9916000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f99100d0b40 con 0x7f99100731f0 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100731f0 0x7f99100cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100731f0 0x7f99100cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51228/0 (socket says 172.21.15.114:51228) 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 -- 172.21.15.114:0/3515622877 learned_addr learned my addr 172.21.15.114:0/3515622877 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f9915600640 1 --2- 172.21.15.114:0/3515622877 >> v2:172.21.15.52:3300/0 conn(0x7f99100cfd90 0x7f99100b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 -- 172.21.15.114:0/3515622877 >> v2:172.21.15.52:3300/0 conn(0x7f99100cfd90 msgr2=0x7f99100b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 --2- 172.21.15.114:0/3515622877 >> v2:172.21.15.52:3300/0 conn(0x7f99100cfd90 0x7f99100b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 -- 172.21.15.114:0/3515622877 >> v1:172.21.15.52:6789/0 conn(0x7f991015f5d0 legacy=0x7f9910072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:47.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.694+0000 7f990fe00640 1 -- 172.21.15.114:0/3515622877 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99100d0e20 con 0x7f99100731f0 2024-06-02T16:44:47.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.695+0000 7f990fe00640 1 --2- 172.21.15.114:0/3515622877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100731f0 0x7f99100cf850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f991006f8e0 tx=0x7f98fc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e83cc2983940a83 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:47.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f990f400640 1 -- 172.21.15.114:0/3515622877 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc037070 con 0x7f99100731f0 2024-06-02T16:44:47.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f990f400640 1 -- 172.21.15.114:0/3515622877 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc032440 con 0x7f99100731f0 2024-06-02T16:44:47.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f990f400640 1 -- 172.21.15.114:0/3515622877 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc032810 con 0x7f99100731f0 2024-06-02T16:44:47.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 -- 172.21.15.114:0/3515622877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100731f0 msgr2=0x7f99100cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 --2- 172.21.15.114:0/3515622877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100731f0 0x7f99100cf850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f991006f8e0 tx=0x7f98fc02a1a0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 -- 172.21.15.114:0/3515622877 shutdown_connections 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 --2- 172.21.15.114:0/3515622877 >> v2:172.21.15.52:3300/0 conn(0x7f99100cfd90 0x7f99100b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 --2- 172.21.15.114:0/3515622877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100731f0 0x7f99100cf850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 -- 172.21.15.114:0/3515622877 >> 172.21.15.114:0/3515622877 conn(0x7f99100b3c80 msgr2=0x7f99100d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 -- 172.21.15.114:0/3515622877 shutdown_connections 2024-06-02T16:44:47.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.696+0000 7f9916000640 1 -- 172.21.15.114:0/3515622877 wait complete. 2024-06-02T16:44:47.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.698+0000 7f9916000640 1 Processor -- start 2024-06-02T16:44:47.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.698+0000 7f9916000640 1 -- start start 2024-06-02T16:44:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99100731f0 0x7f99101f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f991015f5d0 0x7f99100c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99100b4c40 con 0x7f991015f5d0 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99100d0220 con 0x7f99100cfd90 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9916000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f99100b4dc0 con 0x7f99100731f0 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f990fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f990fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51234/0 (socket says 172.21.15.114:51234) 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f990fe00640 1 -- 172.21.15.114:0/3536845644 learned_addr learned my addr 172.21.15.114:0/3536845644 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.699+0000 7f9914c00640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99100731f0 0x7f99101f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f9915600640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f991015f5d0 0x7f99100c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 -- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99100731f0 msgr2=0x7f99101f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99100731f0 0x7f99101f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 -- 172.21.15.114:0/3536845644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f991015f5d0 msgr2=0x7f99100c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f991015f5d0 0x7f99100c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 -- 172.21.15.114:0/3536845644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99101f5460 con 0x7f99100cfd90 2024-06-02T16:44:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990fe00640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02a1e0 tx=0x7f98fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc041020 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0306c0 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.700+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99101f5740 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.701+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc037040 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.701+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99101f5d00 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.701+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f98fc044020 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.701+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f98fc03dd10 con 0x7f99100cfd90 2024-06-02T16:44:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.702+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99100507e0 con 0x7f99100cfd90 2024-06-02T16:44:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.704+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f98fc04b030 con 0x7f99100cfd90 2024-06-02T16:44:47.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.783+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96fa31bd-dccc-4411-8b0c-cc23aa6d8571", "id": 0} v 0) -- 0x7f991015c560 con 0x7f99100cfd90 2024-06-02T16:44:47.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.788+0000 7f990cc00640 1 -- 172.21.15.114:0/3536845644 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96fa31bd-dccc-4411-8b0c-cc23aa6d8571", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f98fc03d420 con 0x7f99100cfd90 2024-06-02T16:44:47.787 INFO:teuthology.orchestra.run.smithi114.stdout:0 2024-06-02T16:44:47.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.789+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 msgr2=0x7f991015b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.789+0000 7f9916000640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02a1e0 tx=0x7f98fc0046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 shutdown_connections 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f991015f5d0 0x7f99100c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100cfd90 0x7f991015b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 --2- 172.21.15.114:0/3536845644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99100731f0 0x7f99101f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 >> 172.21.15.114:0/3536845644 conn(0x7f99100b3c80 msgr2=0x7f99100b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 shutdown_connections 2024-06-02T16:44:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.790+0000 7f9916000640 1 -- 172.21.15.114:0/3536845644 wait complete. 2024-06-02T16:44:47.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 23cc19f6-c092-4eff-8f8a-3685fde25ca0 1 2024-06-02T16:44:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.974+0000 7f247ac00640 1 Processor -- start 2024-06-02T16:44:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.974+0000 7f247ac00640 1 -- start start 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f247ac00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 0x7f24740b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f247ac00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740cf9e0 con 0x7f24740ce440 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f247ac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740ce940 con 0x7f247406ca90 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f247ac00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f24740cf550 con 0x7f2474162da0 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f2478c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f247406ca90 0x7f24740cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56708/0 (socket says 172.21.15.114:56708) 2024-06-02T16:44:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f2478c00640 1 -- 172.21.15.114:0/3363454353 learned_addr learned my addr 172.21.15.114:0/3363454353 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-06-02T16:44:47.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f2473e00640 1 --2- 172.21.15.114:0/3363454353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 0x7f24740b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.976+0000 7f2472a00640 1 -- 172.21.15.114:0/3363454353 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771396547 0 0) 0x7f24740ce940 con 0x7f247406ca90 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.977+0000 7f2472a00640 1 -- 172.21.15.114:0/3363454353 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2458003520 con 0x7f247406ca90 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.977+0000 7f2473e00640 1 -- 172.21.15.114:0/3363454353 >> v1:172.21.15.114:6789/0 conn(0x7f247406ca90 legacy=0x7f24740cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.977+0000 7f2473e00640 1 -- 172.21.15.114:0/3363454353 >> v1:172.21.15.52:6789/0 conn(0x7f24740ce440 legacy=0x7f247406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.977+0000 7f2473e00640 1 -- 172.21.15.114:0/3363454353 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24740cec20 con 0x7f2474162da0 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.978+0000 7f2473e00640 1 --2- 172.21.15.114:0/3363454353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 0x7f24740b3470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24640097d0 tx=0x7f246402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a310570083071e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.978+0000 7f2472a00640 1 -- 172.21.15.114:0/3363454353 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464037070 con 0x7f2474162da0 2024-06-02T16:44:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.978+0000 7f2472a00640 1 -- 172.21.15.114:0/3363454353 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2464032440 con 0x7f2474162da0 2024-06-02T16:44:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.978+0000 7f2472a00640 1 -- 172.21.15.114:0/3363454353 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464032810 con 0x7f2474162da0 2024-06-02T16:44:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 -- 172.21.15.114:0/3363454353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 msgr2=0x7f24740b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 --2- 172.21.15.114:0/3363454353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 0x7f24740b3470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24640097d0 tx=0x7f246402a180 comp rx=0 tx=0).stop 2024-06-02T16:44:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 -- 172.21.15.114:0/3363454353 shutdown_connections 2024-06-02T16:44:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 --2- 172.21.15.114:0/3363454353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2474162da0 0x7f24740b3470 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 -- 172.21.15.114:0/3363454353 >> 172.21.15.114:0/3363454353 conn(0x7f247409b9c0 msgr2=0x7f24740b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 -- 172.21.15.114:0/3363454353 shutdown_connections 2024-06-02T16:44:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.979+0000 7f247ac00640 1 -- 172.21.15.114:0/3363454353 wait complete. 2024-06-02T16:44:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.980+0000 7f247ac00640 1 Processor -- start 2024-06-02T16:44:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 -- start start 2024-06-02T16:44:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24740ce440 0x7f24741f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 0x7f24740c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2474163180 con 0x7f2474162da0 2024-06-02T16:44:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f24740cf1e0 con 0x7f247406ca90 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.981+0000 7f247ac00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f24740b39b0 con 0x7f24740ce440 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24740ce440 0x7f24741f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51248/0 (socket says 172.21.15.114:51248) 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 -- 172.21.15.114:0/1757149421 learned_addr learned my addr 172.21.15.114:0/1757149421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2478c00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 0x7f24740c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 -- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24740ce440 msgr2=0x7f24741f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24740ce440 0x7f24741f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 -- 172.21.15.114:0/1757149421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 msgr2=0x7f24740c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 0x7f24740c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 -- 172.21.15.114:0/1757149421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24741f9770 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2478c00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 0x7f24740c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.982+0000 7f2473e00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24640097d0 tx=0x7f24640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464037040 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640304c0 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24740b1d50 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464030890 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24740b2310 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2464044020 con 0x7f247406ca90 2024-06-02T16:44:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.983+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f246403bc40 con 0x7f247406ca90 2024-06-02T16:44:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.984+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474069c30 con 0x7f247406ca90 2024-06-02T16:44:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:47.986+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f246404b020 con 0x7f247406ca90 2024-06-02T16:44:48.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.065+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23cc19f6-c092-4eff-8f8a-3685fde25ca0", "id": 1} v 0) -- 0x7f247406edf0 con 0x7f247406ca90 2024-06-02T16:44:48.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.070+0000 7f246be00640 1 -- 172.21.15.114:0/1757149421 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23cc19f6-c092-4eff-8f8a-3685fde25ca0", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f246403b430 con 0x7f247406ca90 2024-06-02T16:44:48.069 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 msgr2=0x7f24740b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24640097d0 tx=0x7f24640046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 shutdown_connections 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474162da0 0x7f24740c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24740ce440 0x7f24741f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 --2- 172.21.15.114:0/1757149421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f247406ca90 0x7f24740b7a40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 >> 172.21.15.114:0/1757149421 conn(0x7f247409b9c0 msgr2=0x7f24740d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 shutdown_connections 2024-06-02T16:44:48.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.071+0000 7f247ac00640 1 -- 172.21.15.114:0/1757149421 wait complete. 2024-06-02T16:44:48.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 8e498c04-0cdc-4a4d-ae96-69bb461818a6 2 2024-06-02T16:44:48.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.263+0000 7f3934800640 1 Processor -- start 2024-06-02T16:44:48.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.263+0000 7f3934800640 1 -- start start 2024-06-02T16:44:48.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.264+0000 7f3934800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 0x7f392c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3934800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0cff50 con 0x7f392c15f910 2024-06-02T16:44:48.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3934800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0d01f0 con 0x7f392c15f530 2024-06-02T16:44:48.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3934800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0d0490 con 0x7f392c0d60a0 2024-06-02T16:44:48.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3931400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 0x7f392c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3931e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f392c15f530 0x7f392c0d2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56714/0 (socket says 172.21.15.114:56714) 2024-06-02T16:44:48.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3931e00640 1 -- 172.21.15.114:0/714478570 learned_addr learned my addr 172.21.15.114:0/714478570 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3930a00640 1 -- 172.21.15.114:0/714478570 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390844072 0 0) 0x7f392c0d01f0 con 0x7f392c15f530 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3930a00640 1 -- 172.21.15.114:0/714478570 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3914003520 con 0x7f392c15f530 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3931400640 1 -- 172.21.15.114:0/714478570 >> v1:172.21.15.114:6789/0 conn(0x7f392c15f530 legacy=0x7f392c0d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.265+0000 7f3931400640 1 -- 172.21.15.114:0/714478570 >> v1:172.21.15.52:6789/0 conn(0x7f392c15f910 legacy=0x7f392c169650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.266+0000 7f3931400640 1 -- 172.21.15.114:0/714478570 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0d0770 con 0x7f392c0d60a0 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.266+0000 7f3931400640 1 --2- 172.21.15.114:0/714478570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 0x7f392c0d3a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f392c0d0120 tx=0x7f391c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897ba35e0258abbd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.267+0000 7f3930a00640 1 -- 172.21.15.114:0/714478570 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c037070 con 0x7f392c0d60a0 2024-06-02T16:44:48.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.267+0000 7f3930a00640 1 -- 172.21.15.114:0/714478570 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c032440 con 0x7f392c0d60a0 2024-06-02T16:44:48.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.267+0000 7f3930a00640 1 -- 172.21.15.114:0/714478570 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c032810 con 0x7f392c0d60a0 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.267+0000 7f3934800640 1 -- 172.21.15.114:0/714478570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 msgr2=0x7f392c0d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.267+0000 7f3934800640 1 --2- 172.21.15.114:0/714478570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 0x7f392c0d3a20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f392c0d0120 tx=0x7f391c02a1e0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.268+0000 7f3934800640 1 -- 172.21.15.114:0/714478570 shutdown_connections 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.268+0000 7f3934800640 1 --2- 172.21.15.114:0/714478570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c0d60a0 0x7f392c0d3a20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.268+0000 7f3934800640 1 -- 172.21.15.114:0/714478570 >> 172.21.15.114:0/714478570 conn(0x7f392c08cf50 msgr2=0x7f392c0d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.268+0000 7f3934800640 1 -- 172.21.15.114:0/714478570 shutdown_connections 2024-06-02T16:44:48.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.268+0000 7f3934800640 1 -- 172.21.15.114:0/714478570 wait complete. 2024-06-02T16:44:48.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.269+0000 7f3934800640 1 Processor -- start 2024-06-02T16:44:48.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.269+0000 7f3934800640 1 -- start start 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c0d60a0 0x7f392c0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c15f910 0x7f392c162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0d1250 con 0x7f392c0d60a0 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0d0d30 con 0x7f392c15f910 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.270+0000 7f3934800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f392c160b90 con 0x7f392c15f530 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53430/0 (socket says 172.21.15.114:53430) 2024-06-02T16:44:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 -- 172.21.15.114:0/1234987703 learned_addr learned my addr 172.21.15.114:0/1234987703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3932800640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c15f910 0x7f392c162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931e00640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c0d60a0 0x7f392c0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 -- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c15f910 msgr2=0x7f392c162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c15f910 0x7f392c162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 -- 172.21.15.114:0/1234987703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c0d60a0 msgr2=0x7f392c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c0d60a0 0x7f392c0cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 -- 172.21.15.114:0/1234987703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1f55f0 con 0x7f392c15f530 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.271+0000 7f3931400640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f391c035040 tx=0x7f391c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c041020 con 0x7f392c15f530 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c030720 con 0x7f392c15f530 2024-06-02T16:44:48.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c037040 con 0x7f392c15f530 2024-06-02T16:44:48.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c1f58d0 con 0x7f392c15f530 2024-06-02T16:44:48.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c160e70 con 0x7f392c15f530 2024-06-02T16:44:48.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f391c044020 con 0x7f392c15f530 2024-06-02T16:44:48.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.272+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f391c03d420 con 0x7f392c15f530 2024-06-02T16:44:48.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.273+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c069520 con 0x7f392c15f530 2024-06-02T16:44:48.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.276+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f391c04b030 con 0x7f392c15f530 2024-06-02T16:44:48.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.356+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e498c04-0cdc-4a4d-ae96-69bb461818a6", "id": 2} v 0) -- 0x7f392c0d2c50 con 0x7f392c15f530 2024-06-02T16:44:48.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.362+0000 7f3926000640 1 -- 172.21.15.114:0/1234987703 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e498c04-0cdc-4a4d-ae96-69bb461818a6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f391c03d700 con 0x7f392c15f530 2024-06-02T16:44:48.361 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-06-02T16:44:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 msgr2=0x7f392c15a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f391c035040 tx=0x7f391c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 shutdown_connections 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c15f910 0x7f392c162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c15f530 0x7f392c15a8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 --2- 172.21.15.114:0/1234987703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c0d60a0 0x7f392c0cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 >> 172.21.15.114:0/1234987703 conn(0x7f392c08cf50 msgr2=0x7f392c0d3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 shutdown_connections 2024-06-02T16:44:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.363+0000 7f3934800640 1 -- 172.21.15.114:0/1234987703 wait complete. 2024-06-02T16:44:48.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new bbc4d9ec-d916-4055-9013-bbc9e229f5de 3 2024-06-02T16:44:48.448 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.449+0000 7f0279e12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T16:44:48.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.551+0000 7f7eb8c00640 1 Processor -- start 2024-06-02T16:44:48.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.551+0000 7f7eb8c00640 1 -- start start 2024-06-02T16:44:48.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.552+0000 7f7eb8c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7eb4163100 0x7f7eb406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.552+0000 7f7eb8c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb8c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb4163b30 con 0x7f7eb40d1820 2024-06-02T16:44:48.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb8c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7eb4163e10 con 0x7f7eb4163100 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb8c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb415fd20 con 0x7f7eb41635b0 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7eb4163100 0x7f7eb406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7eb4163100 0x7f7eb406c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51262/0 (socket says 172.21.15.114:51262) 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 -- 172.21.15.114:0/2719085939 learned_addr learned my addr 172.21.15.114:0/2719085939 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 -- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 msgr2=0x7f7eb406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 --2- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb406c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 -- 172.21.15.114:0/2719085939 >> v1:172.21.15.114:6789/0 conn(0x7f7eb40d1820 legacy=0x7f7eb4160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.553+0000 7f7eb2a00640 1 -- 172.21.15.114:0/2719085939 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb4160000 con 0x7f7eb4163100 2024-06-02T16:44:48.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.554+0000 7f7eb2a00640 1 --2- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb406c380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28fe10a75bf6f29e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb2000640 1 -- 172.21.15.114:0/2719085939 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0037070 con 0x7f7eb4163100 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb2000640 1 -- 172.21.15.114:0/2719085939 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea0032440 con 0x7f7eb4163100 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb2000640 1 -- 172.21.15.114:0/2719085939 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0032810 con 0x7f7eb4163100 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 -- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 msgr2=0x7f7eb406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb406c380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002a1d0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 -- 172.21.15.114:0/2719085939 shutdown_connections 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/2719085939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb406c380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 -- 172.21.15.114:0/2719085939 >> 172.21.15.114:0/2719085939 conn(0x7f7eb40b3c30 msgr2=0x7f7eb40b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.555+0000 7f7eb8c00640 1 -- 172.21.15.114:0/2719085939 shutdown_connections 2024-06-02T16:44:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.556+0000 7f7eb8c00640 1 -- 172.21.15.114:0/2719085939 wait complete. 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.557+0000 7f7eb8c00640 1 Processor -- start 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.557+0000 7f7eb8c00640 1 -- start start 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eb40d1820 0x7f7eb41575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb41e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40d1d80 con 0x7f7eb40d1820 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40d1c00 con 0x7f7eb4163100 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.558+0000 7f7eb8c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb40ce8b0 con 0x7f7eb41635b0 2024-06-02T16:44:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb41e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51266/0 (socket says 172.21.15.114:51266) 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 -- 172.21.15.114:0/3227386224 learned_addr learned my addr 172.21.15.114:0/3227386224 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb3400640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eb40d1820 0x7f7eb41575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 -- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 msgr2=0x7f7eb41e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb41e9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 -- 172.21.15.114:0/3227386224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eb40d1820 msgr2=0x7f7eb41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eb40d1820 0x7f7eb41575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 -- 172.21.15.114:0/3227386224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb41eab60 con 0x7f7eb4163100 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.559+0000 7f7eb2a00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0000c00 tx=0x7f7ea00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0037040 con 0x7f7eb4163100 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea0042070 con 0x7f7eb4163100 2024-06-02T16:44:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb41eae40 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0030880 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb41eb400 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7ea0030a20 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.560+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7ea0030d10 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.561+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb40507e0 con 0x7f7eb4163100 2024-06-02T16:44:48.562 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.562+0000 7f0279e12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T16:44:48.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.564+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7ea0047460 con 0x7f7eb4163100 2024-06-02T16:44:48.585 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:48.586+0000 7fc0d048c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T16:44:48.616 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.617+0000 7f0279e12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T16:44:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.643+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bbc4d9ec-d916-4055-9013-bbc9e229f5de", "id": 3} v 0) -- 0x7f7eb414f050 con 0x7f7eb4163100 2024-06-02T16:44:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.651+0000 7f7eab400640 1 -- 172.21.15.114:0/3227386224 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbc4d9ec-d916-4055-9013-bbc9e229f5de", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7ea00476e0 con 0x7f7eb4163100 2024-06-02T16:44:48.650 INFO:teuthology.orchestra.run.smithi114.stdout:3 2024-06-02T16:44:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.652+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 msgr2=0x7f7eb41e8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.652+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0000c00 tx=0x7f7ea00046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 shutdown_connections 2024-06-02T16:44:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eb41635b0 0x7f7eb41e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb4163100 0x7f7eb41e8e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 --2- 172.21.15.114:0/3227386224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eb40d1820 0x7f7eb41575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 >> 172.21.15.114:0/3227386224 conn(0x7f7eb40b3c30 msgr2=0x7f7eb4158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 shutdown_connections 2024-06-02T16:44:48.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.653+0000 7f7eb8c00640 1 -- 172.21.15.114:0/3227386224 wait complete. 2024-06-02T16:44:48.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new ee74c34b-3243-4d0d-a9e4-493e8ab9252c 4 2024-06-02T16:44:48.695 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:48.697+0000 7fc0d048c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T16:44:48.748 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:48.750+0000 7fc0d048c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T16:44:48.824 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.825+0000 7f0279e12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T16:44:48.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.846+0000 7f662be00640 1 Processor -- start 2024-06-02T16:44:48.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.846+0000 7f662be00640 1 -- start start 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f662c0d4d10 0x7f662c0b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662c0d3c70 con 0x7f662c15f430 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662be00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662c0d3f50 con 0x7f662c0b7150 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662be00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f662c0b75a0 con 0x7f662c0d4d10 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f662c0b7150 0x7f662c0b82c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56720/0 (socket says 172.21.15.114:56720) 2024-06-02T16:44:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.847+0000 7f662b400640 1 -- 172.21.15.114:0/209881401 learned_addr learned my addr 172.21.15.114:0/209881401 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f6623e00640 1 --2- 172.21.15.114:0/209881401 >> v2:172.21.15.52:3300/0 conn(0x7f662c0d4d10 0x7f662c0b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208289769 0 0) 0x7f662c0d3f50 con 0x7f662c0b7150 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6610003520 con 0x7f662c0b7150 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1458308891 0 0) 0x7f6610003520 con 0x7f662c0b7150 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 >> v2:172.21.15.52:3300/0 conn(0x7f662c0d4d10 msgr2=0x7f662c0b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 --2- 172.21.15.114:0/209881401 >> v2:172.21.15.52:3300/0 conn(0x7f662c0d4d10 0x7f662c0b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 >> v1:172.21.15.52:6789/0 conn(0x7f662c15f430 legacy=0x7f662c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c0d4230 con 0x7f662c0b7150 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f6624001a70 con 0x7f662c0b7150 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 >> v1:172.21.15.114:6789/0 conn(0x7f662c0b7150 legacy=0x7f662c0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 0x7f6610003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6610004800 0x7f6610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610005210 0x7f661000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f662c0b75a0 con 0x7f6610004800 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f661000c160 con 0x7f6610003aa0 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.848+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f661000c360 con 0x7f6610005210 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662b400640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610005210 0x7f661000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 0x7f6610003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f6623e00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6610004800 0x7f6610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 -- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610005210 msgr2=0x7f661000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610005210 0x7f661000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 -- 172.21.15.114:0/209881401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6610004800 msgr2=0x7f6610004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6610004800 0x7f6610004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662aa00640 1 -- 172.21.15.114:0/209881401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6610003520 con 0x7f6610003aa0 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662b400640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610005210 0x7f661000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:44:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.849+0000 7f662b400640 1 -- 172.21.15.114:0/209881401 reap_dead start 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.850+0000 7f662aa00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 0x7f6610003ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f661c001760 tx=0x7f6610005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da98157682f54877 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.850+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c0013b0 con 0x7f6610003aa0 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.850+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c0052d0 con 0x7f6610003aa0 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.850+0000 7f662a000640 1 -- 172.21.15.114:0/209881401 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c02aa50 con 0x7f6610003aa0 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 -- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 msgr2=0x7f6610003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 0x7f6610003ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f661c001760 tx=0x7f6610005830 comp rx=0 tx=0).stop 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 -- 172.21.15.114:0/209881401 shutdown_connections 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 --2- 172.21.15.114:0/209881401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6610003aa0 0x7f6610003ec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 -- 172.21.15.114:0/209881401 >> 172.21.15.114:0/209881401 conn(0x7f662c0741f0 msgr2=0x7f662c0d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 -- 172.21.15.114:0/209881401 shutdown_connections 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.851+0000 7f662be00640 1 -- 172.21.15.114:0/209881401 wait complete. 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.853+0000 7f662be00640 1 Processor -- start 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.853+0000 7f662be00640 1 -- start start 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662c0c9c20 0x7f662c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f662c15f990 0x7f662c15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f662c15f810 con 0x7f662c0c9c20 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f662c0d47f0 con 0x7f662c15f990 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662be00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f662c0bac70 con 0x7f6610003aa0 2024-06-02T16:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662aa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662aa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53478/0 (socket says 172.21.15.114:53478) 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662aa00640 1 -- 172.21.15.114:0/1867762416 learned_addr learned my addr 172.21.15.114:0/1867762416 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f662b400640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f662c15f990 0x7f662c15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.854+0000 7f6623e00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662c0c9c20 0x7f662c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 -- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f662c15f990 msgr2=0x7f662c15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f662c15f990 0x7f662c15fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 -- 172.21.15.114:0/1867762416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662c0c9c20 msgr2=0x7f662c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662c0c9c20 0x7f662c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 -- 172.21.15.114:0/1867762416 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c162500 con 0x7f6610003aa0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662aa00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f661c005040 tx=0x7f661c001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c042070 con 0x7f6610003aa0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c005480 con 0x7f6610003aa0 2024-06-02T16:44:48.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c037040 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c1627e0 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.855+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c0cd840 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.856+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f661c045070 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.856+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f661c0035f0 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.857+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662c162d00 con 0x7f6610003aa0 2024-06-02T16:44:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.859+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f661c04c070 con 0x7f6610003aa0 2024-06-02T16:44:48.921 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.922+0000 7f0279e12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T16:44:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.948+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ee74c34b-3243-4d0d-a9e4-493e8ab9252c", "id": 4} v 0) -- 0x7f662c0b7a90 con 0x7f6610003aa0 2024-06-02T16:44:48.950 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:48.952+0000 7fc0d048c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T16:44:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.954+0000 7f6622a00640 1 -- 172.21.15.114:0/1867762416 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee74c34b-3243-4d0d-a9e4-493e8ab9252c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f662c0b7a90 con 0x7f6610003aa0 2024-06-02T16:44:48.953 INFO:teuthology.orchestra.run.smithi114.stdout:4 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 msgr2=0x7f662c14b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f661c005040 tx=0x7f661c001120 comp rx=0 tx=0).stop 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 shutdown_connections 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f662c15f990 0x7f662c15fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662c0c9c20 0x7f662c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 --2- 172.21.15.114:0/1867762416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6610003aa0 0x7f662c14b620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.955+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 >> 172.21.15.114:0/1867762416 conn(0x7f662c0741f0 msgr2=0x7f662c0b9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.956+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 shutdown_connections 2024-06-02T16:44:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:48.956+0000 7f662be00640 1 -- 172.21.15.114:0/1867762416 wait complete. 2024-06-02T16:44:48.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new d5f17596-59e9-4922-93e2-6a4d563055a5 5 2024-06-02T16:44:48.990 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:48.992+0000 7f0279e12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T16:44:49.009 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:49.011+0000 7fc0d048c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T16:44:49.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:49.075+0000 7fc0d048c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T16:44:49.130 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:49.131+0000 7f0279e12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T16:44:49.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.150+0000 7f873f200640 1 Processor -- start 2024-06-02T16:44:49.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.151+0000 7f873f200640 1 -- start start 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f873f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f873f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 0x7f87380d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f873f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87380d05a0 con 0x7f873815f790 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f873f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f873815fb70 con 0x7f87380b7370 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f873f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f87380d11b0 con 0x7f87380cff30 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f872fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f872fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53480/0 (socket says 172.21.15.114:53480) 2024-06-02T16:44:49.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.152+0000 7f872fe00640 1 -- 172.21.15.114:0/1072324269 learned_addr learned my addr 172.21.15.114:0/1072324269 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f873d200640 1 --2- 172.21.15.114:0/1072324269 >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 0x7f87380d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f872fe00640 1 -- 172.21.15.114:0/1072324269 >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 msgr2=0x7f87380d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:49.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f872fe00640 1 --2- 172.21.15.114:0/1072324269 >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 0x7f87380d2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f872fe00640 1 -- 172.21.15.114:0/1072324269 >> v1:172.21.15.52:6789/0 conn(0x7f873815f790 legacy=0x7f87380d5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:49.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f872fe00640 1 -- 172.21.15.114:0/1072324269 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87380d0880 con 0x7f87380cff30 2024-06-02T16:44:49.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.153+0000 7f873d200640 1 --2- 172.21.15.114:0/1072324269 >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 0x7f87380d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:44:49.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.154+0000 7f872fe00640 1 --2- 172.21.15.114:0/1072324269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8720009870 tx=0x7f872002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba60c19163200e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.154+0000 7f8737400640 1 -- 172.21.15.114:0/1072324269 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720037070 con 0x7f87380cff30 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.154+0000 7f8737400640 1 -- 172.21.15.114:0/1072324269 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8720032440 con 0x7f87380cff30 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.154+0000 7f8737400640 1 -- 172.21.15.114:0/1072324269 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720032810 con 0x7f87380cff30 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 -- 172.21.15.114:0/1072324269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 msgr2=0x7f87380b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 --2- 172.21.15.114:0/1072324269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8720009870 tx=0x7f872002a1c0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 -- 172.21.15.114:0/1072324269 shutdown_connections 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 --2- 172.21.15.114:0/1072324269 >> v2:172.21.15.52:3300/0 conn(0x7f87380b7370 0x7f87380d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 --2- 172.21.15.114:0/1072324269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380cff30 0x7f87380b6e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 -- 172.21.15.114:0/1072324269 >> 172.21.15.114:0/1072324269 conn(0x7f873809e710 msgr2=0x7f87380d53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 -- 172.21.15.114:0/1072324269 shutdown_connections 2024-06-02T16:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.155+0000 7f873f200640 1 -- 172.21.15.114:0/1072324269 wait complete. 2024-06-02T16:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.157+0000 7f873f200640 1 Processor -- start 2024-06-02T16:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.157+0000 7f873f200640 1 -- start start 2024-06-02T16:44:49.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 0x7f873815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 0x7f87380b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87380d3510 con 0x7f873815f790 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f87380d0e40 con 0x7f87380cff30 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f87380d3690 con 0x7f87380b7370 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f8737e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 0x7f873815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f872fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f872fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51300/0 (socket says 172.21.15.114:51300) 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f8737e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 0x7f873815c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53494/0 (socket says 172.21.15.114:53494) 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f872fe00640 1 -- 172.21.15.114:0/2666458620 learned_addr learned my addr 172.21.15.114:0/2666458620 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.158+0000 7f873d200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 0x7f87380b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 -- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 msgr2=0x7f873815c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 0x7f873815c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 -- 172.21.15.114:0/2666458620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 msgr2=0x7f87380b9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 0x7f87380b9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 -- 172.21.15.114:0/2666458620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873815c910 con 0x7f87380cff30 2024-06-02T16:44:49.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f873d200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 0x7f87380b9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:44:49.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f872fe00640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f87200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720037040 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8720042070 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720030bd0 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873815cbf0 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.159+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873815d1b0 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.160+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f872002ad10 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.160+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8720047be0 con 0x7f87380cff30 2024-06-02T16:44:49.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.160+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8738069c30 con 0x7f87380cff30 2024-06-02T16:44:49.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.163+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8720030d70 con 0x7f87380cff30 2024-06-02T16:44:49.208 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:49.209+0000 7fc0d048c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T16:44:49.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.238+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5f17596-59e9-4922-93e2-6a4d563055a5", "id": 5} v 0) -- 0x7f87380d27b0 con 0x7f87380cff30 2024-06-02T16:44:49.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.244+0000 7f8734c00640 1 -- 172.21.15.114:0/2666458620 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5f17596-59e9-4922-93e2-6a4d563055a5", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8720047460 con 0x7f87380cff30 2024-06-02T16:44:49.243 INFO:teuthology.orchestra.run.smithi114.stdout:5 2024-06-02T16:44:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 msgr2=0x7f8738151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f87200046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 shutdown_connections 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f873815f790 0x7f87380b9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87380cff30 0x7f8738151bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 --2- 172.21.15.114:0/2666458620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87380b7370 0x7f873815c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 >> 172.21.15.114:0/2666458620 conn(0x7f873809e710 msgr2=0x7f873806edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 shutdown_connections 2024-06-02T16:44:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.245+0000 7f873f200640 1 -- 172.21.15.114:0/2666458620 wait complete. 2024-06-02T16:44:49.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 08595a16-fa09-4df3-8868-189aabb6bbe9 6 2024-06-02T16:44:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.484+0000 7f909d200640 1 Processor -- start 2024-06-02T16:44:49.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.485+0000 7f909d200640 1 -- start start 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f909d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 0x7f90980d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f909d200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f909d200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90980cfd50 con 0x7f909815f680 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f909d200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f90980cfff0 con 0x7f909815f2a0 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f909d200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f90980d4220 con 0x7f90980d3600 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f9097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f9097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53510/0 (socket says 172.21.15.114:53510) 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.486+0000 7f9097e00640 1 -- 172.21.15.114:0/3646729782 learned_addr learned my addr 172.21.15.114:0/3646729782 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097400640 1 --2- 172.21.15.114:0/3646729782 >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 0x7f90980d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097e00640 1 -- 172.21.15.114:0/3646729782 >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 msgr2=0x7f90980d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097e00640 1 --2- 172.21.15.114:0/3646729782 >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 0x7f90980d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097e00640 1 -- 172.21.15.114:0/3646729782 >> v1:172.21.15.52:6789/0 conn(0x7f909815f680 legacy=0x7f90980d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097e00640 1 -- 172.21.15.114:0/3646729782 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90980d3c60 con 0x7f90980d3600 2024-06-02T16:44:49.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.487+0000 7f9097400640 1 --2- 172.21.15.114:0/3646729782 >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 0x7f90980d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.488+0000 7f9097e00640 1 --2- 172.21.15.114:0/3646729782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9090009e50 tx=0x7f909002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1341e07146e54ab7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.488+0000 7f9096000640 1 -- 172.21.15.114:0/3646729782 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090036070 con 0x7f90980d3600 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.488+0000 7f9096000640 1 -- 172.21.15.114:0/3646729782 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9090031600 con 0x7f90980d3600 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.488+0000 7f9096000640 1 -- 172.21.15.114:0/3646729782 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90900319d0 con 0x7f90980d3600 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 -- 172.21.15.114:0/3646729782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 msgr2=0x7f90980d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 --2- 172.21.15.114:0/3646729782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9090009e50 tx=0x7f909002a680 comp rx=0 tx=0).stop 2024-06-02T16:44:49.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 -- 172.21.15.114:0/3646729782 shutdown_connections 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 --2- 172.21.15.114:0/3646729782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90980d3600 0x7f90980d5460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 --2- 172.21.15.114:0/3646729782 >> v2:172.21.15.52:3300/0 conn(0x7f909815f2a0 0x7f90980d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 -- 172.21.15.114:0/3646729782 >> 172.21.15.114:0/3646729782 conn(0x7f909808ebf0 msgr2=0x7f909809e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 -- 172.21.15.114:0/3646729782 shutdown_connections 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.489+0000 7f909d200640 1 -- 172.21.15.114:0/3646729782 wait complete. 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.490+0000 7f909d200640 1 Processor -- start 2024-06-02T16:44:49.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.491+0000 7f909d200640 1 -- start start 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.491+0000 7f909d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90980d3600 0x7f90981f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.491+0000 7f909d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f909815f2a0 0x7f909815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.491+0000 7f909d200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f909d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90980d07b0 con 0x7f90980d3600 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f909d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f90980d0290 con 0x7f909815f2a0 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f909d200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f90980d0930 con 0x7f909815f680 2024-06-02T16:44:49.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53526/0 (socket says 172.21.15.114:53526) 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 -- 172.21.15.114:0/1855236889 learned_addr learned my addr 172.21.15.114:0/1855236889 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9096a00640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f909815f2a0 0x7f909815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097400640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90980d3600 0x7f90981f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 -- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f909815f2a0 msgr2=0x7f909815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f909815f2a0 0x7f909815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 -- 172.21.15.114:0/1855236889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90980d3600 msgr2=0x7f90981f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90980d3600 0x7f90981f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.492+0000 7f9097e00640 1 -- 172.21.15.114:0/1855236889 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90981f85e0 con 0x7f909815f680 2024-06-02T16:44:49.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f9097e00640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f909002ac70 tx=0x7f9090004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090041020 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9090008710 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090036040 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9098153990 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9098161400 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9090044020 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.493+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f9090008b00 con 0x7f909815f680 2024-06-02T16:44:49.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.494+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90980507e0 con 0x7f909815f680 2024-06-02T16:44:49.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.498+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f909004b020 con 0x7f909815f680 2024-06-02T16:44:49.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.574+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "08595a16-fa09-4df3-8868-189aabb6bbe9", "id": 6} v 0) -- 0x7f90980b7890 con 0x7f909815f680 2024-06-02T16:44:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.587+0000 7f908f400640 1 -- 172.21.15.114:0/1855236889 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08595a16-fa09-4df3-8868-189aabb6bbe9", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9098153990 con 0x7f909815f680 2024-06-02T16:44:49.587 INFO:teuthology.orchestra.run.smithi114.stdout:6 2024-06-02T16:44:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 msgr2=0x7f90980b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f909002ac70 tx=0x7f9090004a40 comp rx=0 tx=0).stop 2024-06-02T16:44:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 shutdown_connections 2024-06-02T16:44:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f909815f680 0x7f90980b2b70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f909815f2a0 0x7f909815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 --2- 172.21.15.114:0/1855236889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90980d3600 0x7f90981f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 >> 172.21.15.114:0/1855236889 conn(0x7f909808ebf0 msgr2=0x7f90980b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.589+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 shutdown_connections 2024-06-02T16:44:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.590+0000 7f909d200640 1 -- 172.21.15.114:0/1855236889 wait complete. 2024-06-02T16:44:49.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 4daf185b-aa66-49c7-9671-f24480d1d244 7 2024-06-02T16:44:49.618 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:49.618+0000 7f0279e12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T16:44:49.690 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:49.691+0000 7fc0d048c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T16:44:49.779 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:49.780+0000 7f0279e12040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-02T16:44:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.782+0000 7f50dd000640 1 Processor -- start 2024-06-02T16:44:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.782+0000 7f50dd000640 1 -- start start 2024-06-02T16:44:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50dd000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 0x7f50d80b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50dd000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50d81631f0 0x7f50d80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50dd000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d80b7b20 con 0x7f50d80d5f10 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50dd000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f50d80b7e00 con 0x7f50d80b7130 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50dd000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f50d806ee90 con 0x7f50d81631f0 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50d6800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50d81631f0 0x7f50d80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50d6800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50d81631f0 0x7f50d80b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51314/0 (socket says 172.21.15.114:51314) 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.783+0000 7f50d6800640 1 -- 172.21.15.114:0/3857699835 learned_addr learned my addr 172.21.15.114:0/3857699835 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d5e00640 1 --2- 172.21.15.114:0/3857699835 >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 0x7f50d80b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d6800640 1 -- 172.21.15.114:0/3857699835 >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 msgr2=0x7f50d80b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d6800640 1 --2- 172.21.15.114:0/3857699835 >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 0x7f50d80b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d6800640 1 -- 172.21.15.114:0/3857699835 >> v1:172.21.15.114:6789/0 conn(0x7f50d80d5f10 legacy=0x7f50d8162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d6800640 1 -- 172.21.15.114:0/3857699835 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d806f170 con 0x7f50d81631f0 2024-06-02T16:44:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.784+0000 7f50d5e00640 1 --2- 172.21.15.114:0/3857699835 >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 0x7f50d80b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:44:49.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.785+0000 7f50d6800640 1 --2- 172.21.15.114:0/3857699835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d81631f0 0x7f50d80b42b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50d80cc430 tx=0x7f50d002a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=925a906626145126 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.785+0000 7f50d5400640 1 -- 172.21.15.114:0/3857699835 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0036070 con 0x7f50d81631f0 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.785+0000 7f50d5400640 1 -- 172.21.15.114:0/3857699835 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0031600 con 0x7f50d81631f0 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.785+0000 7f50d5400640 1 -- 172.21.15.114:0/3857699835 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d00319d0 con 0x7f50d81631f0 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 -- 172.21.15.114:0/3857699835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d81631f0 msgr2=0x7f50d80b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 --2- 172.21.15.114:0/3857699835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d81631f0 0x7f50d80b42b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50d80cc430 tx=0x7f50d002a6b0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 -- 172.21.15.114:0/3857699835 shutdown_connections 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 --2- 172.21.15.114:0/3857699835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d81631f0 0x7f50d80b42b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 --2- 172.21.15.114:0/3857699835 >> v2:172.21.15.52:3300/0 conn(0x7f50d80b7130 0x7f50d80b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 -- 172.21.15.114:0/3857699835 >> 172.21.15.114:0/3857699835 conn(0x7f50d808cf50 msgr2=0x7f50d80d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 -- 172.21.15.114:0/3857699835 shutdown_connections 2024-06-02T16:44:49.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.786+0000 7f50dd000640 1 -- 172.21.15.114:0/3857699835 wait complete. 2024-06-02T16:44:49.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.787+0000 7f50dd000640 1 Processor -- start 2024-06-02T16:44:49.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 -- start start 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50d80b7130 0x7f50d81f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80d5f10 0x7f50d80b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50d80d4270 con 0x7f50d80b7130 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50d80b49f0 con 0x7f50d80d5f10 2024-06-02T16:44:49.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.788+0000 7f50dd000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f50d80d43f0 con 0x7f50d81631f0 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80d5f10 0x7f50d80b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:53534/0 (socket says 172.21.15.114:53534) 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 -- 172.21.15.114:0/2578802089 learned_addr learned my addr 172.21.15.114:0/2578802089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d5e00640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50d80b7130 0x7f50d81f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 -- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80d5f10 msgr2=0x7f50d80b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80d5f10 0x7f50d80b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 -- 172.21.15.114:0/2578802089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50d80b7130 msgr2=0x7f50d81f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50d80b7130 0x7f50d81f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.789+0000 7f50d6800640 1 -- 172.21.15.114:0/2578802089 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d80b86d0 con 0x7f50d81631f0 2024-06-02T16:44:49.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50d6800640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50d002aca0 tx=0x7f50d0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d003f020 con 0x7f50d81631f0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0037040 con 0x7f50d81631f0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0036070 con 0x7f50d81631f0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d80b89b0 con 0x7f50d81631f0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d80b8f70 con 0x7f50d81631f0 2024-06-02T16:44:49.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f50d0042020 con 0x7f50d81631f0 2024-06-02T16:44:49.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.790+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f50d0007bd0 con 0x7f50d81631f0 2024-06-02T16:44:49.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.791+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d80d6590 con 0x7f50d81631f0 2024-06-02T16:44:49.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.793+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f50d80d6590 con 0x7f50d81631f0 2024-06-02T16:44:49.852 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:49.854+0000 7fc0d048c040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-02T16:44:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.869+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4daf185b-aa66-49c7-9671-f24480d1d244", "id": 7} v 0) -- 0x7f50d8069520 con 0x7f50d81631f0 2024-06-02T16:44:49.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.881+0000 7f50ce000640 1 -- 172.21.15.114:0/2578802089 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4daf185b-aa66-49c7-9671-f24480d1d244", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f50d0049030 con 0x7f50d81631f0 2024-06-02T16:44:49.881 INFO:teuthology.orchestra.run.smithi114.stdout:7 2024-06-02T16:44:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 msgr2=0x7f50d80ba270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50d002aca0 tx=0x7f50d0004a40 comp rx=0 tx=0).stop 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 shutdown_connections 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d81631f0 0x7f50d80ba270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80d5f10 0x7f50d80b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 --2- 172.21.15.114:0/2578802089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50d80b7130 0x7f50d81f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 >> 172.21.15.114:0/2578802089 conn(0x7f50d808cf50 msgr2=0x7f50d80cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 shutdown_connections 2024-06-02T16:44:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:44:49.882+0000 7f50dd000640 1 -- 172.21.15.114:0/2578802089 wait complete. 2024-06-02T16:44:49.898 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-02T16:44:49.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-02T16:44:49.906 INFO:tasks.ceph.osd.0:Started 2024-06-02T16:44:49.906 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-02T16:44:49.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-02T16:44:49.913 INFO:tasks.ceph.osd.1:Started 2024-06-02T16:44:49.913 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-02T16:44:49.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-02T16:44:49.918 INFO:tasks.ceph.osd.2:Started 2024-06-02T16:44:49.919 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-02T16:44:49.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-02T16:44:49.924 INFO:tasks.ceph.osd.3:Started 2024-06-02T16:44:49.925 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-02T16:44:49.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-02T16:44:49.945 INFO:tasks.ceph.osd.4:Started 2024-06-02T16:44:49.945 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-02T16:44:49.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-02T16:44:49.954 INFO:tasks.ceph.osd.5:Started 2024-06-02T16:44:49.955 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-02T16:44:49.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-02T16:44:49.959 INFO:tasks.ceph.osd.6:Started 2024-06-02T16:44:49.959 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-02T16:44:49.959 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-02T16:44:49.964 INFO:tasks.ceph.osd.7:Started 2024-06-02T16:44:49.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:44:50.121 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.122+0000 7f0279e12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T16:44:50.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.169+0000 7fce5b200640 1 Processor -- start 2024-06-02T16:44:50.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.169+0000 7fce5b200640 1 -- start start 2024-06-02T16:44:50.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.170+0000 7fce5b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fce54162850 0x7fce54162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:50.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.170+0000 7fce5b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce540d5fa0 con 0x7fce54163860 2024-06-02T16:44:50.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.170+0000 7fce5b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5406f090 con 0x7fce540b43d0 2024-06-02T16:44:50.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.170+0000 7fce5b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fce540d6210 con 0x7fce54162850 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce53e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce54163860 0x7fce540d3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38154/0 (socket says 172.21.15.52:38154) 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce53e00640 1 -- 172.21.15.52:0/1627116703 learned_addr learned my addr 172.21.15.52:0/1627116703 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce59200640 1 --2- 172.21.15.52:0/1627116703 >> v2:172.21.15.114:3300/0 conn(0x7fce54162850 0x7fce54162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce59200640 1 -- 172.21.15.52:0/1627116703 >> v1:172.21.15.114:6789/0 conn(0x7fce540b43d0 legacy=0x7fce54163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce59200640 1 -- 172.21.15.52:0/1627116703 >> v1:172.21.15.52:6789/0 conn(0x7fce54163860 legacy=0x7fce540d3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.171+0000 7fce59200640 1 -- 172.21.15.52:0/1627116703 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5406f370 con 0x7fce54162850 2024-06-02T16:44:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.172+0000 7fce59200640 1 --2- 172.21.15.52:0/1627116703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce54162850 0x7fce54162c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009d90 tx=0x7fce4c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec488580e94b5ecb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce53400640 1 -- 172.21.15.52:0/1627116703 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c007740 con 0x7fce54162850 2024-06-02T16:44:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce53400640 1 -- 172.21.15.52:0/1627116703 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c0078e0 con 0x7fce54162850 2024-06-02T16:44:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce53400640 1 -- 172.21.15.52:0/1627116703 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c007cb0 con 0x7fce54162850 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 -- 172.21.15.52:0/1627116703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce54162850 msgr2=0x7fce54162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 --2- 172.21.15.52:0/1627116703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce54162850 0x7fce54162c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009d90 tx=0x7fce4c02a660 comp rx=0 tx=0).stop 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 -- 172.21.15.52:0/1627116703 shutdown_connections 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 --2- 172.21.15.52:0/1627116703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce54162850 0x7fce54162c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 -- 172.21.15.52:0/1627116703 >> 172.21.15.52:0/1627116703 conn(0x7fce5408cf50 msgr2=0x7fce540d55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 -- 172.21.15.52:0/1627116703 shutdown_connections 2024-06-02T16:44:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.173+0000 7fce5b200640 1 -- 172.21.15.52:0/1627116703 wait complete. 2024-06-02T16:44:50.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.175+0000 7fce5b200640 1 Processor -- start 2024-06-02T16:44:50.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.175+0000 7fce5b200640 1 -- start start 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 0x7fce540a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 0x7fce540d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 0x7fce54157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce541644d0 con 0x7fce54162850 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce54164350 con 0x7fce540b43d0 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce5b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fce541631c0 con 0x7fce54163860 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce53e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 0x7fce540a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce53e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 0x7fce540a2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:43232/0 (socket says 172.21.15.52:43232) 2024-06-02T16:44:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce53e00640 1 -- 172.21.15.52:0/2235016544 learned_addr learned my addr 172.21.15.52:0/2235016544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:44:50.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.176+0000 7fce4be00640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 0x7fce540d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:50.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce59200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 0x7fce54157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 -- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 msgr2=0x7fce54157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 0x7fce54157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 -- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 msgr2=0x7fce540a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 0x7fce540a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 -- 172.21.15.52:0/2235016544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce54157dc0 con 0x7fce54162850 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce59200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 0x7fce54157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.177+0000 7fce4be00640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 0x7fce540d0950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c3c0 tx=0x7fce3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.178+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c017070 con 0x7fce54162850 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.178+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce540d0e90 con 0x7fce54162850 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.178+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c0052d0 con 0x7fce54162850 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.178+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c003830 con 0x7fce54162850 2024-06-02T16:44:50.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.178+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce540b84e0 con 0x7fce54162850 2024-06-02T16:44:50.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.179+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce3c01a070 con 0x7fce54162850 2024-06-02T16:44:50.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.179+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fce3c011590 con 0x7fce54162850 2024-06-02T16:44:50.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.179+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce54069520 con 0x7fce54162850 2024-06-02T16:44:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.184+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fce3c011790 con 0x7fce54162850 2024-06-02T16:44:50.194 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.195+0000 7f0279e12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T16:44:50.231 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:50.233+0000 7fc0d048c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T16:44:50.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.251+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce540d5890 con 0x7fce54162850 2024-06-02T16:44:50.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.252+0000 7fce50c00640 1 -- 172.21.15.52:0/2235016544 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fce3c011c20 con 0x7fce54162850 2024-06-02T16:44:50.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:44:50.251 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:44:49.872971+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:44:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.253+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 msgr2=0x7fce540d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.253+0000 7fce5b200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 0x7fce540d0950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c3c0 tx=0x7fce3c00c880 comp rx=0 tx=0).stop 2024-06-02T16:44:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.253+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 shutdown_connections 2024-06-02T16:44:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.253+0000 7fce5b200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fce54163860 0x7fce54157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.254+0000 7fce5b200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54162850 0x7fce540d0950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.254+0000 7fce5b200640 1 --2- 172.21.15.52:0/2235016544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce540b43d0 0x7fce540a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.254+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 >> 172.21.15.52:0/2235016544 conn(0x7fce5408cf50 msgr2=0x7fce5406ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.254+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 shutdown_connections 2024-06-02T16:44:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:44:50.254+0000 7fce5b200640 1 -- 172.21.15.52:0/2235016544 wait complete. 2024-06-02T16:44:50.268 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-02T16:44:50.268 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-02T16:44:50.297 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:50.299+0000 7fc0d048c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T16:44:50.326 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.327+0000 7f0279e12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T16:44:50.436 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:50.437+0000 7fc0d048c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T16:44:50.613 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-06-02T16:44:50.615+0000 7fc938b01640 -1 Falling back to public interface 2024-06-02T16:44:50.624 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-06-02T16:44:50.626+0000 7f75e99d4640 -1 Falling back to public interface 2024-06-02T16:44:50.624 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-06-02T16:44:50.626+0000 7f927aa30640 -1 Falling back to public interface 2024-06-02T16:44:50.628 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-06-02T16:44:50.630+0000 7f50800f0640 -1 Falling back to public interface 2024-06-02T16:44:50.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2024-06-02T16:44:50.638+0000 7f622aed7640 -1 Falling back to public interface 2024-06-02T16:44:50.653 INFO:tasks.ceph.osd.5.smithi114.stderr:2024-06-02T16:44:50.654+0000 7f9e09dd6640 -1 Falling back to public interface 2024-06-02T16:44:50.661 INFO:tasks.ceph.osd.7.smithi114.stderr:2024-06-02T16:44:50.662+0000 7f011d614640 -1 Falling back to public interface 2024-06-02T16:44:50.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2024-06-02T16:44:50.670+0000 7f23b5033640 -1 Falling back to public interface 2024-06-02T16:44:50.676 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.677+0000 7f0279e12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T16:44:50.736 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.736+0000 7f0279e12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T16:44:50.799 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:50.800+0000 7fc0d048c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T16:44:50.858 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:50.859+0000 7fc0d048c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T16:44:50.925 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:50.925+0000 7f0279e12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T16:44:51.050 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:51.052+0000 7fc0d048c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T16:44:51.073 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T16:44:51.092 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.092+0000 7f0279e12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T16:44:51.149 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.149+0000 7f0279e12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T16:44:51.228 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:51.230+0000 7fc0d048c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T16:44:51.231 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.231+0000 7f0279e12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T16:44:51.236 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.238+0000 7f6f02c00640 1 Processor -- start 2024-06-02T16:44:51.237 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.238+0000 7f6f02c00640 1 -- start start 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.239+0000 7f6f02c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 0x7f6efc0d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.239+0000 7f6f02c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6efc0cfd80 con 0x7f6efc0d3d20 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.239+0000 7f6f02c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6efc160350 con 0x7f6efc0b6840 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.239+0000 7f6f02c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6efc0d2620 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f02200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6efc0d3d20 0x7f6efc0d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38162/0 (socket says 172.21.15.52:38162) 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f02200640 1 -- 172.21.15.52:0/1208880017 learned_addr learned my addr 172.21.15.52:0/1208880017 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:44:51.238 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f00e00640 1 --2- 172.21.15.52:0/1208880017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 0x7f6efc0d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:51.239 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6efbe00640 1 -- 172.21.15.52:0/1208880017 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955823921 0 0) 0x7f6efc0cfd80 con 0x7f6efc0d3d20 2024-06-02T16:44:51.239 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f00e00640 1 -- 172.21.15.52:0/1208880017 >> v1:172.21.15.114:6789/0 conn(0x7f6efc0b6840 legacy=0x7f6efc160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.239 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f00e00640 1 -- 172.21.15.52:0/1208880017 >> v1:172.21.15.52:6789/0 conn(0x7f6efc0d3d20 legacy=0x7f6efc0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.239 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.240+0000 7f6f00e00640 1 -- 172.21.15.52:0/1208880017 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc160630 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.240 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.241+0000 7f6f00e00640 1 --2- 172.21.15.52:0/1208880017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 0x7f6efc0d37e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80097d0 tx=0x7f6ee802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4a6e0379d308f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:51.240 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.241+0000 7f6efbe00640 1 -- 172.21.15.52:0/1208880017 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8037070 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.240 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.241+0000 7f6efbe00640 1 -- 172.21.15.52:0/1208880017 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8032440 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.240 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.241+0000 7f6efbe00640 1 -- 172.21.15.52:0/1208880017 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8032810 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 -- 172.21.15.52:0/1208880017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 msgr2=0x7f6efc0d37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 --2- 172.21.15.52:0/1208880017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 0x7f6efc0d37e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80097d0 tx=0x7f6ee802a210 comp rx=0 tx=0).stop 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 -- 172.21.15.52:0/1208880017 shutdown_connections 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 --2- 172.21.15.52:0/1208880017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d2fe0 0x7f6efc0d37e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 -- 172.21.15.52:0/1208880017 >> 172.21.15.52:0/1208880017 conn(0x7f6efc09e540 msgr2=0x7f6efc0d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 -- 172.21.15.52:0/1208880017 shutdown_connections 2024-06-02T16:44:51.241 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.242+0000 7f6f02c00640 1 -- 172.21.15.52:0/1208880017 wait complete. 2024-06-02T16:44:51.243 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.245+0000 7f6f02c00640 1 Processor -- start 2024-06-02T16:44:51.243 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.245+0000 7f6f02c00640 1 -- start start 2024-06-02T16:44:51.245 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 0x7f6efc09fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 0x7f6efc06e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc15fe60 con 0x7f6efc0b6840 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc0d0020 con 0x7f6efc0d2fe0 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6efc15ffe0 con 0x7f6efc0d3d20 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f00e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f01800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 0x7f6efc09fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f00e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:43234/0 (socket says 172.21.15.52:43234) 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f00e00640 1 -- 172.21.15.52:0/2495263769 learned_addr learned my addr 172.21.15.52:0/2495263769 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:44:51.246 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f02200640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 0x7f6efc06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f01800640 1 -- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 msgr2=0x7f6efc06e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.247+0000 7f6f01800640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 0x7f6efc06e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f01800640 1 -- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 msgr2=0x7f6efc0a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f01800640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f01800640 1 -- 172.21.15.52:0/2495263769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc1f71e0 con 0x7f6efc0b6840 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f00e00640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f02200640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 0x7f6efc06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f01800640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 0x7f6efc09fff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c430 tx=0x7f6eec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:51.248 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec017070 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec0052d0 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec003810 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc1f74c0 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.248+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1f7a80 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.249+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6eec01a070 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.249+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6eec011c90 con 0x7f6efc0b6840 2024-06-02T16:44:51.249 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.249+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc0769c0 con 0x7f6efc0b6840 2024-06-02T16:44:51.250 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.252+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6eec011590 con 0x7f6efc0b6840 2024-06-02T16:44:51.286 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.286+0000 7f0279e12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T16:44:51.294 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:51.295+0000 7fc0d048c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T16:44:51.317 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.319+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6efc0d5910 con 0x7f6efc0b6840 2024-06-02T16:44:51.318 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.320+0000 7f6ef9600640 1 -- 172.21.15.52:0/2495263769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6eec0039b0 con 0x7f6efc0b6840 2024-06-02T16:44:51.319 INFO:teuthology.misc.health.smithi052.stdout: 2024-06-02T16:44:51.319 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:44:49.872971+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:44:51.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 msgr2=0x7f6efc09fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:51.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 0x7f6efc09fff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c430 tx=0x7f6eec00c8f0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 shutdown_connections 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6efc0d3d20 0x7f6efc06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc0d2fe0 0x7f6efc0a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 --2- 172.21.15.52:0/2495263769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6efc0b6840 0x7f6efc09fff0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 >> 172.21.15.52:0/2495263769 conn(0x7f6efc09e540 msgr2=0x7f6efc0d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 shutdown_connections 2024-06-02T16:44:51.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:51.321+0000 7f6f02c00640 1 -- 172.21.15.52:0/2495263769 wait complete. 2024-06-02T16:44:51.332 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-02T16:44:51.381 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:51.382+0000 7fc0d048c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T16:44:51.437 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:51.438+0000 7fc0d048c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T16:44:51.828 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.829+0000 7f0279e12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T16:44:51.959 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:51.959+0000 7f0279e12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T16:44:52.007 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:52.009+0000 7fc0d048c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T16:44:52.147 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-06-02T16:44:52.149+0000 7fc0d048c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T16:44:52.992 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:52.992+0000 7f0219000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-02T16:44:52.992 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-06-02T16:44:52.993+0000 7f0219000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-02T16:44:53.285 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-06-02T16:44:53.287+0000 7f927aa30640 -1 osd.1 0 log_to_monitors true 2024-06-02T16:44:54.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2024-06-02T16:44:54.077+0000 7f011d614640 -1 osd.7 0 log_to_monitors true 2024-06-02T16:44:54.203 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-06-02T16:44:54.204+0000 7fc938b01640 -1 osd.2 0 log_to_monitors true 2024-06-02T16:44:54.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2024-06-02T16:44:54.206+0000 7f622aed7640 -1 osd.4 0 log_to_monitors true 2024-06-02T16:44:54.225 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-06-02T16:44:54.227+0000 7f75e99d4640 -1 osd.3 0 log_to_monitors true 2024-06-02T16:44:54.240 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-06-02T16:44:54.241+0000 7f50800f0640 -1 osd.0 0 log_to_monitors true 2024-06-02T16:44:54.252 INFO:tasks.ceph.osd.6.smithi114.stderr:2024-06-02T16:44:54.252+0000 7f23b5033640 -1 osd.6 0 log_to_monitors true 2024-06-02T16:44:54.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2024-06-02T16:44:54.264+0000 7f9e09dd6640 -1 osd.5 0 log_to_monitors true 2024-06-02T16:44:56.268 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-06-02T16:44:56.270+0000 7f9275800640 -1 osd.1 0 waiting for initial osdmap 2024-06-02T16:44:56.281 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-06-02T16:44:56.282+0000 7f926b800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:57.475 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-06-02T16:44:57.477+0000 7fc933a00640 -1 osd.2 0 waiting for initial osdmap 2024-06-02T16:44:57.476 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-06-02T16:44:57.477+0000 7f507b000640 -1 osd.0 0 waiting for initial osdmap 2024-06-02T16:44:57.484 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-06-02T16:44:57.486+0000 7f5071000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:57.495 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-06-02T16:44:57.496+0000 7fc929a00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:57.504 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-06-02T16:44:57.505+0000 7f75e4800640 -1 osd.3 0 waiting for initial osdmap 2024-06-02T16:44:57.524 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-06-02T16:44:57.526+0000 7f75da800640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:58.139 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T16:44:58.317 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.318+0000 7f8682800640 1 Processor -- start 2024-06-02T16:44:58.318 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.318+0000 7f8682800640 1 -- start start 2024-06-02T16:44:58.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8682800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 0x7f867c160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:58.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8682800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c161490 con 0x7f867c0d2fe0 2024-06-02T16:44:58.320 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8682800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c0cfd80 con 0x7f867c0d3ef0 2024-06-02T16:44:58.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8682800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0d2620 con 0x7f867c0b6840 2024-06-02T16:44:58.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8680a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f867c0d2fe0 0x7f867c0d37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48316/0 (socket says 172.21.15.52:48316) 2024-06-02T16:44:58.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8680a00640 1 -- 172.21.15.52:0/2560025340 learned_addr learned my addr 172.21.15.52:0/2560025340 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:44:58.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.320+0000 7f8681400640 1 --2- 172.21.15.52:0/2560025340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 0x7f867c160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:58.321 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066604123 0 0) 0x7f867c161490 con 0x7f867c0d2fe0 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8664003520 con 0x7f867c0d2fe0 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152401971 0 0) 0x7f867c0cfd80 con 0x7f867c0d3ef0 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f867c161490 con 0x7f867c0d3ef0 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f8681400640 1 -- 172.21.15.52:0/2560025340 >> v1:172.21.15.114:6789/0 conn(0x7f867c0d3ef0 legacy=0x7f867c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f8681400640 1 -- 172.21.15.52:0/2560025340 >> v1:172.21.15.52:6789/0 conn(0x7f867c0d2fe0 legacy=0x7f867c0d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.322 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.321+0000 7f8681400640 1 -- 172.21.15.52:0/2560025340 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c160350 con 0x7f867c0b6840 2024-06-02T16:44:58.323 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.322+0000 7f8681400640 1 --2- 172.21.15.52:0/2560025340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 0x7f867c160f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86700097d0 tx=0x7f867002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98dd35c3e2773f00 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:58.328 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.322+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670037070 con 0x7f867c0b6840 2024-06-02T16:44:58.328 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.322+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8670032440 con 0x7f867c0b6840 2024-06-02T16:44:58.328 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.322+0000 7f867be00640 1 -- 172.21.15.52:0/2560025340 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670032810 con 0x7f867c0b6840 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 -- 172.21.15.52:0/2560025340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 msgr2=0x7f867c160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 --2- 172.21.15.52:0/2560025340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 0x7f867c160f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86700097d0 tx=0x7f867002a210 comp rx=0 tx=0).stop 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 -- 172.21.15.52:0/2560025340 shutdown_connections 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 --2- 172.21.15.52:0/2560025340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0b6840 0x7f867c160f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 -- 172.21.15.52:0/2560025340 >> 172.21.15.52:0/2560025340 conn(0x7f867c09e540 msgr2=0x7f867c0d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:58.329 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 -- 172.21.15.52:0/2560025340 shutdown_connections 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.323+0000 7f8682800640 1 -- 172.21.15.52:0/2560025340 wait complete. 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.325+0000 7f8682800640 1 Processor -- start 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.325+0000 7f8682800640 1 -- start start 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0d2fe0 0x7f867c0b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:58.330 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0d3ef0 0x7f867c09fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:58.331 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0d0020 con 0x7f867c0b6840 2024-06-02T16:44:58.331 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f867c160910 con 0x7f867c0d3ef0 2024-06-02T16:44:58.331 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8682800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f867c15fe60 con 0x7f867c0d2fe0 2024-06-02T16:44:58.332 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:58.332 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40388/0 (socket says 172.21.15.52:40388) 2024-06-02T16:44:58.332 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 -- 172.21.15.52:0/1221729718 learned_addr learned my addr 172.21.15.52:0/1221729718 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:44:58.332 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8680a00640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0d2fe0 0x7f867c0b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:58.332 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 -- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0d2fe0 msgr2=0x7f867c0b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0d2fe0 0x7f867c0b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 -- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0d3ef0 msgr2=0x7f867c09fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0d3ef0 0x7f867c09fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.326+0000 7f8681400640 1 -- 172.21.15.52:0/1221729718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c0a2cc0 con 0x7f867c0b6840 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8681400640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86700098f0 tx=0x7f86700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:58.333 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670037050 con 0x7f867c0b6840 2024-06-02T16:44:58.334 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8670038040 con 0x7f867c0b6840 2024-06-02T16:44:58.334 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670004430 con 0x7f867c0b6840 2024-06-02T16:44:58.334 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c0b8fa0 con 0x7f867c0b6840 2024-06-02T16:44:58.334 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.327+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c0b9560 con 0x7f867c0b6840 2024-06-02T16:44:58.334 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.328+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0769c0 con 0x7f867c0b6840 2024-06-02T16:44:58.335 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.329+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f867003c6d0 con 0x7f867c0b6840 2024-06-02T16:44:58.336 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.330+0000 7f8679600640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 0x7f865c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:44:58.336 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.330+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3351+0+0 (secure 0 0 0) 0x7f86700b7600 con 0x7f867c0b6840 2024-06-02T16:44:58.336 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.331+0000 7f8680a00640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 0x7f865c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:44:58.337 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.332+0000 7f8680a00640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 0x7f865c078700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f867c0d4a10 tx=0x7f8668009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:44:58.337 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.336+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8670081960 con 0x7f867c0b6840 2024-06-02T16:44:58.340 INFO:tasks.ceph.osd.7.smithi114.stderr:2024-06-02T16:44:58.341+0000 7f0118800640 -1 osd.7 0 waiting for initial osdmap 2024-06-02T16:44:58.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2024-06-02T16:44:58.350+0000 7f6226800640 -1 osd.4 0 waiting for initial osdmap 2024-06-02T16:44:58.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2024-06-02T16:44:58.350+0000 7f010de00640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:58.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2024-06-02T16:44:58.357+0000 7f9e04c00640 -1 osd.5 0 waiting for initial osdmap 2024-06-02T16:44:58.361 INFO:tasks.ceph.osd.4.smithi114.stderr:2024-06-02T16:44:58.362+0000 7f621be00640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:58.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2024-06-02T16:44:58.375+0000 7f23af400640 -1 osd.6 0 waiting for initial osdmap 2024-06-02T16:44:58.379 INFO:tasks.ceph.osd.5.smithi114.stderr:2024-06-02T16:44:58.379+0000 7f9dfac00640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:58.384 INFO:tasks.ceph.osd.6.smithi114.stderr:2024-06-02T16:44:58.385+0000 7f23a5400640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T16:44:58.536 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.538+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f867c0d6110 con 0x7f867c0b6840 2024-06-02T16:44:58.538 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.539+0000 7f8679600640 1 -- 172.21.15.52:0/1221729718 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9000 (secure 0 0 0) 0x7f8670081260 con 0x7f867c0b6840 2024-06-02T16:44:58.538 INFO:teuthology.misc.health.smithi052.stdout: 2024-06-02T16:44:58.539 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":15,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:44:58.114018+0000","last_up_change":"2024-06-02T16:44:58.114018+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 msgr2=0x7f865c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 0x7f865c078700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f867c0d4a10 tx=0x7f8668009040 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 msgr2=0x7f867c0a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86700098f0 tx=0x7f86700046c0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 shutdown_connections 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f865c076240 0x7f865c078700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0d3ef0 0x7f867c09fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f867c0d2fe0 0x7f867c0b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 --2- 172.21.15.52:0/1221729718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c0b6840 0x7f867c0a25e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 >> 172.21.15.52:0/1221729718 conn(0x7f867c09e540 msgr2=0x7f867c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:44:58.542 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 shutdown_connections 2024-06-02T16:44:58.543 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:44:58.542+0000 7f8682800640 1 -- 172.21.15.52:0/1221729718 wait complete. 2024-06-02T16:44:58.555 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-06-02T16:45:04.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:45:04.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:45:05.361 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:05.552 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.553+0000 7f584fe00640 1 Processor -- start 2024-06-02T16:45:05.552 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.553+0000 7f584fe00640 1 -- start start 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58501439c0 0x7f58500b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b2bf0 0x7f58500b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58500b3f60 0x7f58500b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f58500cead0 con 0x7f58501439c0 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f58500b3590 con 0x7f58500b3f60 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584fe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f58500b4e20 con 0x7f58500b2bf0 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58501439c0 0x7f58500b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58501439c0 0x7f58500b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59246/0 (socket says 172.21.15.52:59246) 2024-06-02T16:45:05.554 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.555+0000 7f584ea00640 1 -- 172.21.15.52:0/800256828 learned_addr learned my addr 172.21.15.52:0/800256828 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:05.555 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584f400640 1 --2- 172.21.15.52:0/800256828 >> v2:172.21.15.114:3300/0 conn(0x7f58500b3f60 0x7f58500b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.555 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584ea00640 1 -- 172.21.15.52:0/800256828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b2bf0 msgr2=0x7f58500b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:05.555 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f5846000640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b2bf0 0x7f58500b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.555 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584ea00640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b2bf0 0x7f58500b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.556 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584ea00640 1 -- 172.21.15.52:0/800256828 >> v2:172.21.15.114:3300/0 conn(0x7f58500b3f60 msgr2=0x7f58500b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:05.556 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584ea00640 1 --2- 172.21.15.52:0/800256828 >> v2:172.21.15.114:3300/0 conn(0x7f58500b3f60 0x7f58500b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.556 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.556+0000 7f584ea00640 1 -- 172.21.15.52:0/800256828 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58500b4b40 con 0x7f58501439c0 2024-06-02T16:45:05.556 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.557+0000 7f584ea00640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500b60c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58500705e0 tx=0x7f584002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588dc7942644c8d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.557+0000 7f584e000640 1 -- 172.21.15.52:0/800256828 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840036070 con 0x7f58501439c0 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.557+0000 7f584e000640 1 -- 172.21.15.52:0/800256828 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5840031600 con 0x7f58501439c0 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.557+0000 7f584e000640 1 -- 172.21.15.52:0/800256828 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58400319d0 con 0x7f58501439c0 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 -- 172.21.15.52:0/800256828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 msgr2=0x7f58500b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500b60c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58500705e0 tx=0x7f584002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 -- 172.21.15.52:0/800256828 shutdown_connections 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b2bf0 0x7f58500b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 --2- 172.21.15.52:0/800256828 >> v2:172.21.15.114:3300/0 conn(0x7f58500b3f60 0x7f58500b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.557 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 --2- 172.21.15.52:0/800256828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500b60c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.558 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 -- 172.21.15.52:0/800256828 >> 172.21.15.52:0/800256828 conn(0x7f585006fb10 msgr2=0x7f585006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:05.558 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 -- 172.21.15.52:0/800256828 shutdown_connections 2024-06-02T16:45:05.558 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.558+0000 7f584fe00640 1 -- 172.21.15.52:0/800256828 wait complete. 2024-06-02T16:45:05.558 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.560+0000 7f584fe00640 1 Processor -- start 2024-06-02T16:45:05.558 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.560+0000 7f584fe00640 1 -- start start 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58500b2bf0 0x7f58501f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b3f60 0x7f58501f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5850143fe0 con 0x7f58501439c0 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58500b58c0 con 0x7f58500b2bf0 2024-06-02T16:45:05.560 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584fe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5850144160 con 0x7f58500b3f60 2024-06-02T16:45:05.561 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.561 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59262/0 (socket says 172.21.15.52:59262) 2024-06-02T16:45:05.561 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584f400640 1 -- 172.21.15.52:0/3825185456 learned_addr learned my addr 172.21.15.52:0/3825185456 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:05.561 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f5846000640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b3f60 0x7f58501f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.561 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.561+0000 7f584ea00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58500b2bf0 0x7f58501f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 -- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b3f60 msgr2=0x7f58501f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b3f60 0x7f58501f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 -- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58500b2bf0 msgr2=0x7f58501f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58500b2bf0 0x7f58501f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 -- 172.21.15.52:0/3825185456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5850158f90 con 0x7f58501439c0 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f584f400640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848015070 con 0x7f58501439c0 2024-06-02T16:45:05.562 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.562+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5848004220 con 0x7f58501439c0 2024-06-02T16:45:05.563 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.563+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848007620 con 0x7f58501439c0 2024-06-02T16:45:05.563 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.563+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5850159270 con 0x7f58501439c0 2024-06-02T16:45:05.563 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.563+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585015a200 con 0x7f58501439c0 2024-06-02T16:45:05.563 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.564+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58500769c0 con 0x7f58501439c0 2024-06-02T16:45:05.564 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.565+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58480079d0 con 0x7f58501439c0 2024-06-02T16:45:05.565 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.566+0000 7f5847400640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 0x7f582c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:05.565 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.566+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5848097300 con 0x7f58501439c0 2024-06-02T16:45:05.565 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.567+0000 7f584ea00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 0x7f582c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:05.567 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.568+0000 7f584ea00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 0x7f582c078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5840033000 tx=0x7f5840009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:05.570 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.572+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5848060fa0 con 0x7f58501439c0 2024-06-02T16:45:05.784 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.786+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58500b1660 con 0x7f58501439c0 2024-06-02T16:45:05.787 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.788+0000 7f5847400640 1 -- 172.21.15.52:0/3825185456 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12884 (secure 0 0 0) 0x7f58480608a0 con 0x7f58501439c0 2024-06-02T16:45:05.787 INFO:teuthology.misc.health.smithi052.stdout: 2024-06-02T16:45:05.787 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":19,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:02.177931+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 msgr2=0x7f582c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 0x7f582c078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5840033000 tx=0x7f5840009000 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 msgr2=0x7f58500722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 shutdown_connections 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f582c0762d0 0x7f582c078790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58501439c0 0x7f58500722c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58500b3f60 0x7f58501f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 --2- 172.21.15.52:0/3825185456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58500b2bf0 0x7f58501f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:05.791 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 >> 172.21.15.52:0/3825185456 conn(0x7f585006fb10 msgr2=0x7f5850141cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:05.792 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 shutdown_connections 2024-06-02T16:45:05.792 INFO:teuthology.misc.health.smithi052.stderr:2024-06-02T16:45:05.792+0000 7f584fe00640 1 -- 172.21.15.52:0/3825185456 wait complete. 2024-06-02T16:45:05.806 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-02T16:45:05.806 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-02T16:45:05.807 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T16:45:05.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T16:45:05.814 INFO:tasks.ceph.mds.a:Started 2024-06-02T16:45:05.815 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T16:45:05.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T16:45:05.822 INFO:tasks.ceph.mds.c:Started 2024-06-02T16:45:05.822 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T16:45:05.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T16:45:05.830 INFO:tasks.ceph.mds.b:Started 2024-06-02T16:45:05.830 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T16:45:05.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T16:45:05.837 INFO:tasks.ceph.mds.d:Started 2024-06-02T16:45:05.838 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-02T16:45:05.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:05.968 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-06-02T16:45:05.969 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-06-02T16:45:05.989 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2024-06-02T16:45:05.992 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2024-06-02T16:45:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.023+0000 7f2d0e400640 1 Processor -- start 2024-06-02T16:45:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.023+0000 7f2d0e400640 1 -- start start 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2d0e400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2d080b4050 0x7f2d08168150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2d0e400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080cee60 con 0x7f2d080d17a0 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2d0e400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080cf120 con 0x7f2d0815d5d0 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2d0e400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2d080cf400 con 0x7f2d080b4050 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2cffe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2d080d17a0 0x7f2d080d1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60184/0 (socket says 172.21.15.52:60184) 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2cffe00640 1 -- 172.21.15.52:0/2589106343 learned_addr learned my addr 172.21.15.52:0/2589106343 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.024+0000 7f2d07e00640 1 --2- 172.21.15.52:0/2589106343 >> v2:172.21.15.52:3300/0 conn(0x7f2d080b4050 0x7f2d08168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.025+0000 7f2d07e00640 1 -- 172.21.15.52:0/2589106343 >> v1:172.21.15.114:6789/0 conn(0x7f2d0815d5d0 legacy=0x7f2d080d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.025+0000 7f2d07e00640 1 -- 172.21.15.52:0/2589106343 >> v1:172.21.15.52:6789/0 conn(0x7f2d080d17a0 legacy=0x7f2d080d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.025+0000 7f2d06a00640 1 -- 172.21.15.52:0/2589106343 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7045312 0 0) 0x7f2d080cf120 con 0x7f2d0815d5d0 2024-06-02T16:45:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.025+0000 7f2d07e00640 1 -- 172.21.15.52:0/2589106343 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080cf6e0 con 0x7f2d080b4050 2024-06-02T16:45:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.026+0000 7f2d07e00640 1 --2- 172.21.15.52:0/2589106343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d08168150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009d90 tx=0x7f2d0002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64728403a2dbe5f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.026+0000 7f2d06a00640 1 -- 172.21.15.52:0/2589106343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00007740 con 0x7f2d080b4050 2024-06-02T16:45:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.026+0000 7f2d06a00640 1 -- 172.21.15.52:0/2589106343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d000078e0 con 0x7f2d080b4050 2024-06-02T16:45:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.026+0000 7f2d06a00640 1 -- 172.21.15.52:0/2589106343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00007cb0 con 0x7f2d080b4050 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 -- 172.21.15.52:0/2589106343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 msgr2=0x7f2d08168150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 --2- 172.21.15.52:0/2589106343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d08168150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009d90 tx=0x7f2d0002a560 comp rx=0 tx=0).stop 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 -- 172.21.15.52:0/2589106343 shutdown_connections 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 --2- 172.21.15.52:0/2589106343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d08168150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 -- 172.21.15.52:0/2589106343 >> 172.21.15.52:0/2589106343 conn(0x7f2d080b4cb0 msgr2=0x7f2d080b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 -- 172.21.15.52:0/2589106343 shutdown_connections 2024-06-02T16:45:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.027+0000 7f2d0e400640 1 -- 172.21.15.52:0/2589106343 wait complete. 2024-06-02T16:45:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.029+0000 7f2d0e400640 1 Processor -- start 2024-06-02T16:45:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.029+0000 7f2d0e400640 1 -- start start 2024-06-02T16:45:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d080d17a0 0x7f2d080ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0815d5d0 0x7f2d080c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080b5980 con 0x7f2d080b4050 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080d14a0 con 0x7f2d080d17a0 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d0e400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2d080b5b00 con 0x7f2d0815d5d0 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d07400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d07400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59308/0 (socket says 172.21.15.52:59308) 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d07400640 1 -- 172.21.15.52:0/500155911 learned_addr learned my addr 172.21.15.52:0/500155911 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2cffe00640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d080d17a0 0x7f2d080ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.030+0000 7f2d07e00640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0815d5d0 0x7f2d080c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 -- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0815d5d0 msgr2=0x7f2d080c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0815d5d0 0x7f2d080c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 -- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d080d17a0 msgr2=0x7f2d080ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d080d17a0 0x7f2d080ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 -- 172.21.15.52:0/500155911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080cd450 con 0x7f2d080b4050 2024-06-02T16:45:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d07400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c430 tx=0x7f2cf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8017070 con 0x7f2d080b4050 2024-06-02T16:45:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80035f0 con 0x7f2d080b4050 2024-06-02T16:45:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80039e0 con 0x7f2d080b4050 2024-06-02T16:45:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.031+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0815ee90 con 0x7f2d080b4050 2024-06-02T16:45:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.032+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0814a510 con 0x7f2d080b4050 2024-06-02T16:45:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.033+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d08069520 con 0x7f2d080b4050 2024-06-02T16:45:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.034+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2cf801a070 con 0x7f2d080b4050 2024-06-02T16:45:06.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.035+0000 7f2cff400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 0x7f2ce4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:06.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.035+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f2cf8096650 con 0x7f2d080b4050 2024-06-02T16:45:06.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.036+0000 7f2cffe00640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 0x7f2ce4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:06.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.037+0000 7f2cffe00640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 0x7f2ce4078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d080ce640 tx=0x7f2cf0007e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:06.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.040+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2cf805fcd0 con 0x7f2d080b4050 2024-06-02T16:45:06.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.295+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d080d1d90 con 0x7f2d080b4050 2024-06-02T16:45:06.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.296+0000 7f2cff400640 1 -- 172.21.15.52:0/500155911 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f2cf8063fd0 con 0x7f2d080b4050 2024-06-02T16:45:06.295 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:06.295 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T16:45:06.295 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 msgr2=0x7f2ce4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 0x7f2ce4078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d080ce640 tx=0x7f2cf0007e20 comp rx=0 tx=0).stop 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 msgr2=0x7f2d080b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c430 tx=0x7f2cf800c8f0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 shutdown_connections 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ce40762d0 0x7f2ce4078790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0815d5d0 0x7f2d080c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d080d17a0 0x7f2d080ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 --2- 172.21.15.52:0/500155911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d080b4050 0x7f2d080b6a80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 >> 172.21.15.52:0/500155911 conn(0x7f2d080b4cb0 msgr2=0x7f2d080b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 shutdown_connections 2024-06-02T16:45:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:06.299+0000 7f2d0e400640 1 -- 172.21.15.52:0/500155911 wait complete. 2024-06-02T16:45:08.316 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:08.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.538+0000 7ff93a200640 1 Processor -- start 2024-06-02T16:45:08.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.539+0000 7ff93a200640 1 -- start start 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.540+0000 7ff93a200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff9340d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.540+0000 7ff93a200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9341607c0 con 0x7ff9340d06b0 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.540+0000 7ff93a200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff934163040 con 0x7ff9340b7390 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.540+0000 7ff93a200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff934163c50 con 0x7ff93415d060 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.541+0000 7ff933e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff9340d06b0 0x7ff9340b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60186/0 (socket says 172.21.15.52:60186) 2024-06-02T16:45:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.541+0000 7ff933e00640 1 -- 172.21.15.52:0/2425117794 learned_addr learned my addr 172.21.15.52:0/2425117794 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:08.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.541+0000 7ff938e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff9340d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.541+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244501033 0 0) 0x7ff9341607c0 con 0x7ff9340d06b0 2024-06-02T16:45:08.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.541+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918003520 con 0x7ff9340d06b0 2024-06-02T16:45:08.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 530693583 0 0) 0x7ff918003520 con 0x7ff9340d06b0 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 msgr2=0x7ff9340d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff9340d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 >> v1:172.21.15.114:6789/0 conn(0x7ff9340b7390 legacy=0x7ff9340ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff934163320 con 0x7ff9340d06b0 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7ff91c0016f0 con 0x7ff9340d06b0 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 >> v1:172.21.15.52:6789/0 conn(0x7ff9340d06b0 legacy=0x7ff9340b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff918003a30 0x7ff918003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff918004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918004d40 0x7ff9180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff934163c50 con 0x7ff918003a30 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff91800baf0 con 0x7ff918004d40 2024-06-02T16:45:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff91800bcf0 con 0x7ff93415d060 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff938e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff918003a30 0x7ff918003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff933e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff918004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff938e00640 1 -- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 msgr2=0x7ff918004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff939800640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918004d40 0x7ff9180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff938e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff918004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.542+0000 7ff938e00640 1 -- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918004d40 msgr2=0x7ff9180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.543+0000 7ff938e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918004d40 0x7ff9180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.543+0000 7ff938e00640 1 -- 172.21.15.52:0/2425117794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff918003520 con 0x7ff918003a30 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.543+0000 7ff933e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415d060 0x7ff918004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.543+0000 7ff939800640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918004d40 0x7ff9180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:08.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.544+0000 7ff938e00640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff918003a30 0x7ff918003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff924009fc0 tx=0x7ff918005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd9a7344d7d529e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:08.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.544+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924038070 con 0x7ff918003a30 2024-06-02T16:45:08.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.544+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92402f070 con 0x7ff918003a30 2024-06-02T16:45:08.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.544+0000 7ff933400640 1 -- 172.21.15.52:0/2425117794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924009c10 con 0x7ff918003a30 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 -- 172.21.15.52:0/2425117794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff918003a30 msgr2=0x7ff918003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 --2- 172.21.15.52:0/2425117794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff918003a30 0x7ff918003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff924009fc0 tx=0x7ff918005830 comp rx=0 tx=0).stop 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff939800640 1 -- 172.21.15.52:0/2425117794 reap_dead start 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 -- 172.21.15.52:0/2425117794 shutdown_connections 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 -- 172.21.15.52:0/2425117794 >> 172.21.15.52:0/2425117794 conn(0x7ff9340740e0 msgr2=0x7ff9340d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 -- 172.21.15.52:0/2425117794 shutdown_connections 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.545+0000 7ff93a200640 1 -- 172.21.15.52:0/2425117794 wait complete. 2024-06-02T16:45:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.547+0000 7ff93a200640 1 Processor -- start 2024-06-02T16:45:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.547+0000 7ff93a200640 1 -- start start 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918003a30 0x7ff9341eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415bce0 0x7ff9340ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340d4280 con 0x7ff93415c160 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff9341638e0 con 0x7ff918003a30 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff93a200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340d4400 con 0x7ff93415bce0 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.548+0000 7ff939800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59322/0 (socket says 172.21.15.52:59322) 2024-06-02T16:45:08.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 -- 172.21.15.52:0/951205592 learned_addr learned my addr 172.21.15.52:0/951205592 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff938e00640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918003a30 0x7ff9341eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 -- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415bce0 msgr2=0x7ff9340ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415bce0 0x7ff9340ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 -- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918003a30 msgr2=0x7ff9341eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918003a30 0x7ff9341eaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 -- 172.21.15.52:0/951205592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9341e96d0 con 0x7ff93415c160 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff939800640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9340b7ca0 tx=0x7ff92c00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.549+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c018070 con 0x7ff93415c160 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.550+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c0067d0 con 0x7ff93415c160 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.550+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c006c00 con 0x7ff93415c160 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.550+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9341e9990 con 0x7ff93415c160 2024-06-02T16:45:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.550+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9341e9f50 con 0x7ff93415c160 2024-06-02T16:45:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.551+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff934069e40 con 0x7ff93415c160 2024-06-02T16:45:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.552+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff92c007030 con 0x7ff93415c160 2024-06-02T16:45:08.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.553+0000 7ff930c00640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 0x7ff910078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:08.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.553+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff92c0963a0 con 0x7ff93415c160 2024-06-02T16:45:08.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.554+0000 7ff938e00640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 0x7ff910078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:08.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.555+0000 7ff938e00640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 0x7ff910078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff924035000 tx=0x7ff92402f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:08.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.558+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff934069e40 con 0x7ff93415c160 2024-06-02T16:45:08.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.811+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9340d2ea0 con 0x7ff93415c160 2024-06-02T16:45:08.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.812+0000 7ff930c00640 1 -- 172.21.15.52:0/951205592 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7ff92c060040 con 0x7ff93415c160 2024-06-02T16:45:08.811 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:08.811 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-02T16:45:08.811 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 msgr2=0x7ff910078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 0x7ff910078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff924035000 tx=0x7ff92402f000 comp rx=0 tx=0).stop 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 msgr2=0x7ff9341f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9340b7ca0 tx=0x7ff92c00d890 comp rx=0 tx=0).stop 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 shutdown_connections 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff9100762d0 0x7ff910078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93415c160 0x7ff9341f4c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff93415bce0 0x7ff9340ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 --2- 172.21.15.52:0/951205592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff918003a30 0x7ff9341eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 >> 172.21.15.52:0/951205592 conn(0x7ff9340740e0 msgr2=0x7ff9340cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 shutdown_connections 2024-06-02T16:45:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:08.815+0000 7ff93a200640 1 -- 172.21.15.52:0/951205592 wait complete. 2024-06-02T16:45:08.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T16:45:09.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.043+0000 7fe583200640 1 Processor -- start 2024-06-02T16:45:09.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.043+0000 7fe583200640 1 -- start start 2024-06-02T16:45:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.044+0000 7fe583200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5840d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.044+0000 7fe583200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5840b7390 0x7fe5840ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe583200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5841607c0 con 0x7fe5840d06b0 2024-06-02T16:45:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe583200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe584163c50 con 0x7fe5840b7390 2024-06-02T16:45:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe583200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe584163040 con 0x7fe58415d060 2024-06-02T16:45:09.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe581400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5840d06b0 0x7fe5840b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60196/0 (socket says 172.21.15.52:60196) 2024-06-02T16:45:09.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe581400640 1 -- 172.21.15.52:0/4272651747 learned_addr learned my addr 172.21.15.52:0/4272651747 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe582800640 1 --2- 172.21.15.52:0/4272651747 >> v2:172.21.15.114:3300/0 conn(0x7fe5840b7390 0x7fe5840ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe581e00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5840d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723786024 0 0) 0x7fe5841607c0 con 0x7fe5840d06b0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.045+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe568003520 con 0x7fe5840d06b0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4241175762 0 0) 0x7fe568003520 con 0x7fe5840d06b0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 msgr2=0x7fe5840d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5840d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 >> v2:172.21.15.114:3300/0 conn(0x7fe5840b7390 msgr2=0x7fe5840ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 --2- 172.21.15.52:0/4272651747 >> v2:172.21.15.114:3300/0 conn(0x7fe5840b7390 0x7fe5840ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584163320 con 0x7fe5840d06b0 2024-06-02T16:45:09.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fe5700016f0 con 0x7fe5840d06b0 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 >> v1:172.21.15.52:6789/0 conn(0x7fe5840d06b0 legacy=0x7fe5840b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe568003a50 0x7fe568003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568004800 0x7fe568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe584163c50 con 0x7fe568003a50 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe584163040 con 0x7fe568004800 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe56800ba10 con 0x7fe58415d060 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe581e00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe568003a50 0x7fe568003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.046+0000 7fe581400640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568004800 0x7fe568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe582800640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe581e00640 1 -- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 msgr2=0x7fe5680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:09.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe581e00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe581e00640 1 -- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568004800 msgr2=0x7fe568004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe581e00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568004800 0x7fe568004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe581e00640 1 -- 172.21.15.52:0/4272651747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe568003520 con 0x7fe568003a50 2024-06-02T16:45:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.047+0000 7fe582800640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe58415d060 0x7fe5680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.048+0000 7fe581e00640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe568003a50 0x7fe568003e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe574009af0 tx=0x7fe568005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e24a0f354f477a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.048+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574036070 con 0x7fe568003a50 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.048+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe574031400 con 0x7fe568003a50 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.048+0000 7fe580a00640 1 -- 172.21.15.52:0/4272651747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574009690 con 0x7fe568003a50 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 -- 172.21.15.52:0/4272651747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe568003a50 msgr2=0x7fe568003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 --2- 172.21.15.52:0/4272651747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe568003a50 0x7fe568003e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe574009af0 tx=0x7fe568005830 comp rx=0 tx=0).stop 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe582800640 1 -- 172.21.15.52:0/4272651747 reap_dead start 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 -- 172.21.15.52:0/4272651747 shutdown_connections 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 -- 172.21.15.52:0/4272651747 >> 172.21.15.52:0/4272651747 conn(0x7fe5840740e0 msgr2=0x7fe5840d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 -- 172.21.15.52:0/4272651747 shutdown_connections 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.049+0000 7fe583200640 1 -- 172.21.15.52:0/4272651747 wait complete. 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.051+0000 7fe583200640 1 Processor -- start 2024-06-02T16:45:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.051+0000 7fe583200640 1 -- start start 2024-06-02T16:45:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568003a50 0x7fe584158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe584148870 0x7fe58415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840d0170 con 0x7fe5840ccce0 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841638e0 con 0x7fe568003a50 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe583200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe5840d02f0 con 0x7fe584148870 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe581e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568003a50 0x7fe584158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59344/0 (socket says 172.21.15.52:59344) 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe581400640 1 -- 172.21.15.52:0/1304484765 learned_addr learned my addr 172.21.15.52:0/1304484765 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.052+0000 7fe582800640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe584148870 0x7fe58415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 -- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe584148870 msgr2=0x7fe58415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe584148870 0x7fe58415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 -- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568003a50 msgr2=0x7fe584158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568003a50 0x7fe584158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 -- 172.21.15.52:0/1304484765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584148df0 con 0x7fe5840ccce0 2024-06-02T16:45:09.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe581400640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e730 tx=0x7fe57000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57000ee40 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe570018070 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57000ca30 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.053+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841490d0 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.054+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5840cc7c0 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.055+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5840cc9c0 con 0x7fe5840ccce0 2024-06-02T16:45:09.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.056+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe57000cbd0 con 0x7fe5840ccce0 2024-06-02T16:45:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.057+0000 7fe57a000640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 0x7fe564078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.057+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe570097050 con 0x7fe5840ccce0 2024-06-02T16:45:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.058+0000 7fe581e00640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 0x7fe564078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.059+0000 7fe581e00640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 0x7fe564078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe574033000 tx=0x7fe574008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.061+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe5840cc9c0 con 0x7fe5840ccce0 2024-06-02T16:45:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.279+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe5840507e0 con 0x7fe5840ccce0 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.280+0000 7fe57a000640 1 -- 172.21.15.52:0/1304484765 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fe570060c60 con 0x7fe5840ccce0 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:09.279 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-06-02T16:45:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 msgr2=0x7fe564078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 0x7fe564078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe574033000 tx=0x7fe574008030 comp rx=0 tx=0).stop 2024-06-02T16:45:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 msgr2=0x7fe584148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e730 tx=0x7fe57000ebf0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 shutdown_connections 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe5640762d0 0x7fe564078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe584148870 0x7fe58415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5840ccce0 0x7fe584148330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 --2- 172.21.15.52:0/1304484765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe568003a50 0x7fe584158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 >> 172.21.15.52:0/1304484765 conn(0x7fe5840740e0 msgr2=0x7fe5840b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 shutdown_connections 2024-06-02T16:45:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.283+0000 7fe583200640 1 -- 172.21.15.52:0/1304484765 wait complete. 2024-06-02T16:45:09.301 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T16:45:09.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T16:45:09.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.516+0000 7f82abe00640 1 Processor -- start 2024-06-02T16:45:09.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.517+0000 7f82abe00640 1 -- start start 2024-06-02T16:45:09.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.518+0000 7f82abe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac15f680 0x7f82ac0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.518+0000 7f82abe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82ac0d23c0 0x7f82ac163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.518+0000 7f82abe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d0360 con 0x7f82ac0b8780 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.518+0000 7f82abe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac1641c0 con 0x7f82ac0d23c0 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.518+0000 7f82abe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0d36d0 con 0x7f82ac15f680 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82aa000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f82ac0b8780 0x7f82ac0d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60212/0 (socket says 172.21.15.52:60212) 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82aa000640 1 -- 172.21.15.52:0/372840993 learned_addr learned my addr 172.21.15.52:0/372840993 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82ab400640 1 --2- 172.21.15.52:0/372840993 >> v2:172.21.15.52:3300/0 conn(0x7f82ac0d23c0 0x7f82ac163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82aaa00640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac15f680 0x7f82ac0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82ab400640 1 -- 172.21.15.52:0/372840993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac15f680 msgr2=0x7f82ac0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:09.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82ab400640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac15f680 0x7f82ac0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82ab400640 1 -- 172.21.15.52:0/372840993 >> v1:172.21.15.52:6789/0 conn(0x7f82ac0b8780 legacy=0x7f82ac0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82ab400640 1 -- 172.21.15.52:0/372840993 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0d0640 con 0x7f82ac0d23c0 2024-06-02T16:45:09.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.519+0000 7f82a9600640 1 -- 172.21.15.52:0/372840993 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651518609 0 0) 0x7f82ac0d0360 con 0x7f82ac0b8780 2024-06-02T16:45:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.521+0000 7f82ab400640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0d23c0 0x7f82ac163c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009d90 tx=0x7f82a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135df5cbadf084d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.521+0000 7f82a9600640 1 -- 172.21.15.52:0/372840993 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4007740 con 0x7f82ac0d23c0 2024-06-02T16:45:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.521+0000 7f82a9600640 1 -- 172.21.15.52:0/372840993 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a40078e0 con 0x7f82ac0d23c0 2024-06-02T16:45:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.521+0000 7f82a9600640 1 -- 172.21.15.52:0/372840993 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4007cb0 con 0x7f82ac0d23c0 2024-06-02T16:45:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 -- 172.21.15.52:0/372840993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0d23c0 msgr2=0x7f82ac163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0d23c0 0x7f82ac163c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009d90 tx=0x7f82a402a660 comp rx=0 tx=0).stop 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 -- 172.21.15.52:0/372840993 shutdown_connections 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0d23c0 0x7f82ac163c80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 --2- 172.21.15.52:0/372840993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac15f680 0x7f82ac0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 -- 172.21.15.52:0/372840993 >> 172.21.15.52:0/372840993 conn(0x7f82ac0740e0 msgr2=0x7f82ac06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 -- 172.21.15.52:0/372840993 shutdown_connections 2024-06-02T16:45:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.522+0000 7f82abe00640 1 -- 172.21.15.52:0/372840993 wait complete. 2024-06-02T16:45:09.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.524+0000 7f82abe00640 1 Processor -- start 2024-06-02T16:45:09.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.524+0000 7f82abe00640 1 -- start start 2024-06-02T16:45:09.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 0x7f82ac155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 0x7f82ac1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac15fa60 con 0x7f82ac0b8780 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0d0c00 con 0x7f82ac15f680 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82abe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0d3b60 con 0x7f82ac0d23c0 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82aaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82aaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59372/0 (socket says 172.21.15.52:59372) 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82aaa00640 1 -- 172.21.15.52:0/3957454233 learned_addr learned my addr 172.21.15.52:0/3957454233 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82ab400640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 0x7f82ac1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.525+0000 7f82aa000640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 0x7f82ac155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 -- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 msgr2=0x7f82ac155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 0x7f82ac155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 -- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 msgr2=0x7f82ac1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 0x7f82ac1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 -- 172.21.15.52:0/3957454233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac156100 con 0x7f82ac0b8780 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aa000640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 0x7f82ac155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:09.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82ab400640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 0x7f82ac1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:09.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82aaa00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e8a0 tx=0x7f829c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c017070 con 0x7f82ac0b8780 2024-06-02T16:45:09.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c00c940 con 0x7f82ac0b8780 2024-06-02T16:45:09.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c00cd30 con 0x7f82ac0b8780 2024-06-02T16:45:09.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac157cf0 con 0x7f82ac0b8780 2024-06-02T16:45:09.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.526+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac0cb3c0 con 0x7f82ac0b8780 2024-06-02T16:45:09.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.528+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac0507e0 con 0x7f82ac0b8780 2024-06-02T16:45:09.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.529+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f829c01a070 con 0x7f82ac0b8780 2024-06-02T16:45:09.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.530+0000 7f82a2a00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 0x7f8288078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:09.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.530+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f829c097300 con 0x7f82ac0b8780 2024-06-02T16:45:09.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.530+0000 7f82aa000640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 0x7f8288078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:09.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.531+0000 7f82aa000640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 0x7f8288078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8294001220 tx=0x7f8294009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:09.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.535+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f829c060e80 con 0x7f82ac0b8780 2024-06-02T16:45:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:09.747+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f82ac0d3000 con 0x7f82ac0b8780 2024-06-02T16:45:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.229+0000 7f82a2a00640 1 -- 172.21.15.52:0/3957454233 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f829c060780 con 0x7f82ac0b8780 2024-06-02T16:45:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-06-02T16:45:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 msgr2=0x7f8288078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 0x7f8288078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8294001220 tx=0x7f8294009040 comp rx=0 tx=0).stop 2024-06-02T16:45:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 msgr2=0x7f82ac0c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e8a0 tx=0x7f829c00ed60 comp rx=0 tx=0).stop 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 shutdown_connections 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82880762d0 0x7f8288078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac15f680 0x7f82ac1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82ac0d23c0 0x7f82ac155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 --2- 172.21.15.52:0/3957454233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82ac0b8780 0x7f82ac0c9820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 >> 172.21.15.52:0/3957454233 conn(0x7f82ac0740e0 msgr2=0x7f82ac06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.235+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 shutdown_connections 2024-06-02T16:45:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.236+0000 7f82abe00640 1 -- 172.21.15.52:0/3957454233 wait complete. 2024-06-02T16:45:10.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T16:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.472+0000 7f42d9c00640 1 Processor -- start 2024-06-02T16:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.472+0000 7f42d9c00640 1 -- start start 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.474+0000 7f42d9c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d415d330 0x7f42d4073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.474+0000 7f42d9c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 0x7f42d4074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.474+0000 7f42d9c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d4070650 con 0x7f42d40734f0 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.474+0000 7f42d9c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f42d4072450 con 0x7f42d415d330 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.474+0000 7f42d9c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f42d4072730 con 0x7f42d40ae550 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d415d330 0x7f42d4073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d415d330 0x7f42d4073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59380/0 (socket says 172.21.15.52:59380) 2024-06-02T16:45:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 -- 172.21.15.52:0/191467724 learned_addr learned my addr 172.21.15.52:0/191467724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d9200640 1 --2- 172.21.15.52:0/191467724 >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 0x7f42d4074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 -- 172.21.15.52:0/191467724 >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 msgr2=0x7f42d4074060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 --2- 172.21.15.52:0/191467724 >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 0x7f42d4074060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 -- 172.21.15.52:0/191467724 >> v1:172.21.15.114:6789/0 conn(0x7f42d40734f0 legacy=0x7f42d40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d3e00640 1 -- 172.21.15.52:0/191467724 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d4072a10 con 0x7f42d415d330 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.475+0000 7f42d9200640 1 --2- 172.21.15.52:0/191467724 >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 0x7f42d4074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.476+0000 7f42d3e00640 1 --2- 172.21.15.52:0/191467724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d4073b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42d40b3f10 tx=0x7f42c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2d8315053f03f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d2a00640 1 -- 172.21.15.52:0/191467724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4037070 con 0x7f42d415d330 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d2a00640 1 -- 172.21.15.52:0/191467724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4032440 con 0x7f42d415d330 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d2a00640 1 -- 172.21.15.52:0/191467724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4032810 con 0x7f42d415d330 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 -- 172.21.15.52:0/191467724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 msgr2=0x7f42d4073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 --2- 172.21.15.52:0/191467724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d4073b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42d40b3f10 tx=0x7f42c402a1e0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 -- 172.21.15.52:0/191467724 shutdown_connections 2024-06-02T16:45:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 --2- 172.21.15.52:0/191467724 >> v2:172.21.15.114:3300/0 conn(0x7f42d40ae550 0x7f42d4074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 --2- 172.21.15.52:0/191467724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d4073b20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.477+0000 7f42d9c00640 1 -- 172.21.15.52:0/191467724 >> 172.21.15.52:0/191467724 conn(0x7f42d40b2b60 msgr2=0x7f42d40b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.478+0000 7f42d9c00640 1 -- 172.21.15.52:0/191467724 shutdown_connections 2024-06-02T16:45:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.478+0000 7f42d9c00640 1 -- 172.21.15.52:0/191467724 wait complete. 2024-06-02T16:45:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.480+0000 7f42d9c00640 1 Processor -- start 2024-06-02T16:45:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.480+0000 7f42d9c00640 1 -- start start 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 0x7f42d4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 0x7f42d40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42d406e410 con 0x7f42d415d330 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4072fd0 con 0x7f42d40ae550 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.481+0000 7f42d9c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f42d406e590 con 0x7f42d40734f0 2024-06-02T16:45:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59382/0 (socket says 172.21.15.52:59382) 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 -- 172.21.15.52:0/3756674254 learned_addr learned my addr 172.21.15.52:0/3756674254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d3e00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 0x7f42d4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d3400640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 0x7f42d40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 -- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 msgr2=0x7f42d4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 0x7f42d4150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 -- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 msgr2=0x7f42d40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 0x7f42d40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 -- 172.21.15.52:0/3756674254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d40ce5b0 con 0x7f42d415d330 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d3400640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 0x7f42d40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d3e00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 0x7f42d4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.482+0000 7f42d9200640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00ce40 tx=0x7f42cc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.483+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc01a070 con 0x7f42d415d330 2024-06-02T16:45:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.483+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc00d840 con 0x7f42d415d330 2024-06-02T16:45:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.483+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00dc30 con 0x7f42d415d330 2024-06-02T16:45:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.483+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d40ce890 con 0x7f42d415d330 2024-06-02T16:45:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.483+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d40cf130 con 0x7f42d415d330 2024-06-02T16:45:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.484+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d40cf330 con 0x7f42d415d330 2024-06-02T16:45:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.485+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42cc01d070 con 0x7f42d415d330 2024-06-02T16:45:10.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.487+0000 7f42cbe00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 0x7f42b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.487+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f42cc097d90 con 0x7f42d415d330 2024-06-02T16:45:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.488+0000 7f42d3e00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 0x7f42b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.489+0000 7f42d3e00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 0x7f42b4078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.492+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42d40cf330 con 0x7f42d415d330 2024-06-02T16:45:10.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:10.709+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f42d40507e0 con 0x7f42d415d330 2024-06-02T16:45:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.236+0000 7f42cbe00640 1 -- 172.21.15.52:0/3756674254 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f42cc0617a0 con 0x7f42d415d330 2024-06-02T16:45:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-06-02T16:45:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.240+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 msgr2=0x7f42b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.240+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 0x7f42b4078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).stop 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.240+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 msgr2=0x7f42d40cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.240+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00ce40 tx=0x7f42cc00a710 comp rx=0 tx=0).stop 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 shutdown_connections 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f42b40762d0 0x7f42b4078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d415d330 0x7f42d40cc900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40ae550 0x7f42d40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 --2- 172.21.15.52:0/3756674254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42d40734f0 0x7f42d4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 >> 172.21.15.52:0/3756674254 conn(0x7f42d40b2b60 msgr2=0x7f42d40b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.241+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 shutdown_connections 2024-06-02T16:45:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.242+0000 7f42d9c00640 1 -- 172.21.15.52:0/3756674254 wait complete. 2024-06-02T16:45:11.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T16:45:11.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.459+0000 7f59b3e00640 1 Processor -- start 2024-06-02T16:45:11.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.460+0000 7f59b3e00640 1 -- start start 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f59b40ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59b40d0df0 0x7f59b4166d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b3e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b40b4b50 con 0x7f59b40d0300 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b3e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f59b40b5760 con 0x7f59b40d0df0 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b3e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f59b406d390 con 0x7f59b40cda60 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b2a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f59b40d0300 0x7f59b40d06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60228/0 (socket says 172.21.15.52:60228) 2024-06-02T16:45:11.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.461+0000 7f59b2a00640 1 -- 172.21.15.52:0/873450295 learned_addr learned my addr 172.21.15.52:0/873450295 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b2000640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f59b40ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b3400640 1 --2- 172.21.15.52:0/873450295 >> v2:172.21.15.114:3300/0 conn(0x7f59b40d0df0 0x7f59b4166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079883909 0 0) 0x7f59b40b4b50 con 0x7f59b40d0300 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5994003520 con 0x7f59b40d0300 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3713812806 0 0) 0x7f5994003520 con 0x7f59b40d0300 2024-06-02T16:45:11.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 msgr2=0x7f59b40ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f59b40ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 >> v2:172.21.15.114:3300/0 conn(0x7f59b40d0df0 msgr2=0x7f59b4166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 --2- 172.21.15.52:0/873450295 >> v2:172.21.15.114:3300/0 conn(0x7f59b40d0df0 0x7f59b4166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b40b4e30 con 0x7f59b40d0300 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f59a40016f0 con 0x7f59b40d0300 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b3400640 1 --2- 172.21.15.52:0/873450295 >> v2:172.21.15.114:3300/0 conn(0x7f59b40d0df0 0x7f59b4166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 >> v1:172.21.15.52:6789/0 conn(0x7f59b40d0300 legacy=0x7f59b40d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f5994003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f5994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5994004d40 0x7f59940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59b40b5760 con 0x7f5994003a50 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f59b406d390 con 0x7f5994004d40 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.462+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f599400bb70 con 0x7f59b40cda60 2024-06-02T16:45:11.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f5994003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2000640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f5994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b3400640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5994004d40 0x7f59940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 -- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 msgr2=0x7f5994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b40cda60 0x7f5994004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 -- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5994004d40 msgr2=0x7f59940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5994004d40 0x7f59940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b2a00640 1 -- 172.21.15.52:0/873450295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5994003520 con 0x7f5994003a50 2024-06-02T16:45:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.463+0000 7f59b3400640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5994004d40 0x7f59940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.464+0000 7f59b2a00640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f5994003e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c190 tx=0x7f5994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193201d7df666bef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.464+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4007cc0 con 0x7f5994003a50 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.464+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4005ad0 con 0x7f5994003a50 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.464+0000 7f59b1600640 1 -- 172.21.15.52:0/873450295 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4007070 con 0x7f5994003a50 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 -- 172.21.15.52:0/873450295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 msgr2=0x7f5994003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 --2- 172.21.15.52:0/873450295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f5994003e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c190 tx=0x7f5994005830 comp rx=0 tx=0).stop 2024-06-02T16:45:11.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3400640 1 -- 172.21.15.52:0/873450295 reap_dead start 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 -- 172.21.15.52:0/873450295 shutdown_connections 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 -- 172.21.15.52:0/873450295 >> 172.21.15.52:0/873450295 conn(0x7f59b40d1770 msgr2=0x7f59b40d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 -- 172.21.15.52:0/873450295 shutdown_connections 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.465+0000 7f59b3e00640 1 -- 172.21.15.52:0/873450295 wait complete. 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.467+0000 7f59b3e00640 1 Processor -- start 2024-06-02T16:45:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.467+0000 7f59b3e00640 1 -- start start 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b41f21e0 0x7f59b41536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b41f2640 0x7f59b4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59b40b47e0 con 0x7f5994003a50 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f59b40b53f0 con 0x7f59b41f21e0 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b3e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f59b40b5bf0 con 0x7f59b41f2640 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.468+0000 7f59b2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59404/0 (socket says 172.21.15.52:59404) 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 -- 172.21.15.52:0/1662955341 learned_addr learned my addr 172.21.15.52:0/1662955341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 -- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b41f2640 msgr2=0x7f59b4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b41f2640 0x7f59b4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2000640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b41f21e0 0x7f59b41536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 -- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b41f21e0 msgr2=0x7f59b41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b41f21e0 0x7f59b41536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 -- 172.21.15.52:0/1662955341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b4141f60 con 0x7f5994003a50 2024-06-02T16:45:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.469+0000 7f59b2a00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f59a402abb0 tx=0x7f59a4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.470+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4043070 con 0x7f5994003a50 2024-06-02T16:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.470+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4038040 con 0x7f5994003a50 2024-06-02T16:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.470+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a40072b0 con 0x7f5994003a50 2024-06-02T16:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.470+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b4159430 con 0x7f5994003a50 2024-06-02T16:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.470+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b41599f0 con 0x7f5994003a50 2024-06-02T16:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.471+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b40507e0 con 0x7f5994003a50 2024-06-02T16:45:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.472+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f59a4046070 con 0x7f5994003a50 2024-06-02T16:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.474+0000 7f59aaa00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 0x7f5990078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.474+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f59a40b7800 con 0x7f5994003a50 2024-06-02T16:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.475+0000 7f59b2000640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 0x7f5990078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.476+0000 7f59b2000640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 0x7f5990078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59b40b34b0 tx=0x7f599c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.479+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f59a404d020 con 0x7f5994003a50 2024-06-02T16:45:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:11.728+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f59b4063d50 con 0x7f5994003a50 2024-06-02T16:45:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.280+0000 7f59aaa00640 1 -- 172.21.15.52:0/1662955341 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f59a40811a0 con 0x7f5994003a50 2024-06-02T16:45:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T16:45:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 msgr2=0x7f5990078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 0x7f5990078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59b40b34b0 tx=0x7f599c00b040 comp rx=0 tx=0).stop 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 msgr2=0x7f59b4141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f59a402abb0 tx=0x7f59a4001930 comp rx=0 tx=0).stop 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 shutdown_connections 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f59900762d0 0x7f5990078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b41f2640 0x7f59b4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b41f21e0 0x7f59b41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 --2- 172.21.15.52:0/1662955341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5994003a50 0x7f59b4141a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.286+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 >> 172.21.15.52:0/1662955341 conn(0x7f59b40d1770 msgr2=0x7f59b4160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.287+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 shutdown_connections 2024-06-02T16:45:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.288+0000 7f59b3e00640 1 -- 172.21.15.52:0/1662955341 wait complete. 2024-06-02T16:45:12.322 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:12.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.495+0000 7fa1c5400640 1 Processor -- start 2024-06-02T16:45:12.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.496+0000 7fa1c5400640 1 -- start start 2024-06-02T16:45:12.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1c5400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa1c00d1b60 0x7fa1c00ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1c5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1c006fed0 0x7fa1c006f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1c5400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c00ae8e0 con 0x7fa1c015d2d0 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1c5400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c015d6b0 con 0x7fa1c006fed0 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1c5400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c006ed90 con 0x7fa1c00d1b60 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1bf200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1c006fed0 0x7fa1c006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1bf200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1c006fed0 0x7fa1c006f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59418/0 (socket says 172.21.15.52:59418) 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1bf200640 1 -- 172.21.15.52:0/3270848061 learned_addr learned my addr 172.21.15.52:0/3270848061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.497+0000 7fa1b5e00640 1 --2- 172.21.15.52:0/3270848061 >> v2:172.21.15.114:3300/0 conn(0x7fa1c00d1b60 0x7fa1c00ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.498+0000 7fa1bf200640 1 -- 172.21.15.52:0/3270848061 >> v2:172.21.15.114:3300/0 conn(0x7fa1c00d1b60 msgr2=0x7fa1c00ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.498+0000 7fa1bf200640 1 --2- 172.21.15.52:0/3270848061 >> v2:172.21.15.114:3300/0 conn(0x7fa1c00d1b60 0x7fa1c00ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.498+0000 7fa1bf200640 1 -- 172.21.15.52:0/3270848061 >> v1:172.21.15.114:6789/0 conn(0x7fa1c015d2d0 legacy=0x7fa1c00d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:12.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.498+0000 7fa1bf200640 1 -- 172.21.15.52:0/3270848061 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c00ae600 con 0x7fa1c006fed0 2024-06-02T16:45:12.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.499+0000 7fa1bf200640 1 --2- 172.21.15.52:0/3270848061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c006fed0 0x7fa1c006f220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0073aa0 tx=0x7fa1b802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3446dd3362f2c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.499+0000 7fa1bde00640 1 -- 172.21.15.52:0/3270848061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8036070 con 0x7fa1c006fed0 2024-06-02T16:45:12.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.499+0000 7fa1bde00640 1 -- 172.21.15.52:0/3270848061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b8031600 con 0x7fa1c006fed0 2024-06-02T16:45:12.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.499+0000 7fa1bde00640 1 -- 172.21.15.52:0/3270848061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80319d0 con 0x7fa1c006fed0 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 -- 172.21.15.52:0/3270848061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c006fed0 msgr2=0x7fa1c006f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 --2- 172.21.15.52:0/3270848061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c006fed0 0x7fa1c006f220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0073aa0 tx=0x7fa1b802a610 comp rx=0 tx=0).stop 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 -- 172.21.15.52:0/3270848061 shutdown_connections 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 --2- 172.21.15.52:0/3270848061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c006fed0 0x7fa1c006f220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 --2- 172.21.15.52:0/3270848061 >> v2:172.21.15.114:3300/0 conn(0x7fa1c00d1b60 0x7fa1c00ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 -- 172.21.15.52:0/3270848061 >> 172.21.15.52:0/3270848061 conn(0x7fa1c006c7a0 msgr2=0x7fa1c006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:12.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 -- 172.21.15.52:0/3270848061 shutdown_connections 2024-06-02T16:45:12.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.500+0000 7fa1c5400640 1 -- 172.21.15.52:0/3270848061 wait complete. 2024-06-02T16:45:12.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.502+0000 7fa1c5400640 1 Processor -- start 2024-06-02T16:45:12.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.502+0000 7fa1c5400640 1 -- start start 2024-06-02T16:45:12.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1c006fed0 0x7fa1c01555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c015d2d0 0x7fa1c00d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00741b0 con 0x7fa1c00d1b60 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c006ea20 con 0x7fa1c015d2d0 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1c5400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c00d0640 con 0x7fa1c006fed0 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1b5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1b5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59422/0 (socket says 172.21.15.52:59422) 2024-06-02T16:45:12.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.503+0000 7fa1b5e00640 1 -- 172.21.15.52:0/4065658010 learned_addr learned my addr 172.21.15.52:0/4065658010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:12.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1bf200640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c015d2d0 0x7fa1c00d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 -- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1c006fed0 msgr2=0x7fa1c01555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1c006fed0 0x7fa1c01555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 -- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c015d2d0 msgr2=0x7fa1c00d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c015d2d0 0x7fa1c00d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 -- 172.21.15.52:0/4065658010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c00b4c80 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b5e00640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800d800 tx=0x7fa1a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800b6c0 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a8019070 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800ba80 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.504+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c00b4f60 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.505+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c00b5520 con 0x7fa1c00d1b60 2024-06-02T16:45:12.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.506+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c0069520 con 0x7fa1c00d1b60 2024-06-02T16:45:12.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.507+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1a800bc20 con 0x7fa1c00d1b60 2024-06-02T16:45:12.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.508+0000 7fa1b7400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 0x7fa19c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.508+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa1a8097b20 con 0x7fa1c00d1b60 2024-06-02T16:45:12.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.508+0000 7fa1be800640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 0x7fa19c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.510+0000 7fa1be800640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 0x7fa19c0787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0006fd0 tx=0x7fa1b0006bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.513+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1a80613e0 con 0x7fa1c00d1b60 2024-06-02T16:45:12.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.719+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1c00b3b30 con 0x7fa1c00d1b60 2024-06-02T16:45:12.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.721+0000 7fa1b7400640 1 -- 172.21.15.52:0/4065658010 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16618 (secure 0 0 0) 0x7fa1a8060ce0 con 0x7fa1c00d1b60 2024-06-02T16:45:12.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:12.720 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:11.730166+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 msgr2=0x7fa19c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 0x7fa19c0787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0006fd0 tx=0x7fa1b0006bc0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 msgr2=0x7fa1c00cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800d800 tx=0x7fa1a800dcc0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 shutdown_connections 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa19c076300 0x7fa19c0787c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c015d2d0 0x7fa1c00d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1c00d1b60 0x7fa1c00cfbc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 --2- 172.21.15.52:0/4065658010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1c006fed0 0x7fa1c01555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 >> 172.21.15.52:0/4065658010 conn(0x7fa1c006c7a0 msgr2=0x7fa1c015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.723+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 shutdown_connections 2024-06-02T16:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.724+0000 7fa1c5400640 1 -- 172.21.15.52:0/4065658010 wait complete. 2024-06-02T16:45:12.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.946+0000 7f52c8a00640 1 Processor -- start 2024-06-02T16:45:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.946+0000 7f52c8a00640 1 -- start start 2024-06-02T16:45:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52c4160350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52c8a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c40d0890 con 0x7f52c413f140 2024-06-02T16:45:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52c8a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c41416c0 con 0x7f52c413ed60 2024-06-02T16:45:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52c8a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f52c4160970 con 0x7f52c406e840 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52baa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f52c413f140 0x7f52c415fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51750/0 (socket says 172.21.15.52:51750) 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.948+0000 7f52baa00640 1 -- 172.21.15.52:0/2929613482 learned_addr learned my addr 172.21.15.52:0/2929613482 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c3e00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52c4160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923376518 0 0) 0x7f52c40d0890 con 0x7f52c413f140 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52a8003520 con 0x7f52c413f140 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2556122554 0 0) 0x7f52a8003520 con 0x7f52c413f140 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 msgr2=0x7f52c4160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52c4160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 >> v1:172.21.15.114:6789/0 conn(0x7f52c413ed60 legacy=0x7f52c406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4141960 con 0x7f52c413f140 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f52ac0016f0 con 0x7f52c413f140 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 >> v1:172.21.15.52:6789/0 conn(0x7f52c413f140 legacy=0x7f52c415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8003a80 0x7f52a8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a8004e60 0x7f52a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4160970 con 0x7f52a8004e60 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52a8005650 con 0x7f52a8003a80 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.949+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f52a800e110 con 0x7f52c406e840 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a8004e60 0x7f52a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52baa00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3400640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8003a80 0x7f52a8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 -- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 msgr2=0x7f52a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 -- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8003a80 msgr2=0x7f52a8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8003a80 0x7f52a8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52c3e00640 1 -- 172.21.15.52:0/2929613482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a8003520 con 0x7f52a8004e60 2024-06-02T16:45:12.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.950+0000 7f52baa00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c406e840 0x7f52a8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.951+0000 7f52c3e00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a8004e60 0x7f52a800b9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ba90 tx=0x7f52a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3928bb765db491af server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.951+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc030070 con 0x7f52a8004e60 2024-06-02T16:45:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.951+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc02ae30 con 0x7f52a8004e60 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.951+0000 7f52c2a00640 1 -- 172.21.15.52:0/2929613482 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00b600 con 0x7f52a8004e60 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 -- 172.21.15.52:0/2929613482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a8004e60 msgr2=0x7f52a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 --2- 172.21.15.52:0/2929613482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52a8004e60 0x7f52a800b9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ba90 tx=0x7f52a8005830 comp rx=0 tx=0).stop 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c3e00640 1 -- 172.21.15.52:0/2929613482 reap_dead start 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 -- 172.21.15.52:0/2929613482 shutdown_connections 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 -- 172.21.15.52:0/2929613482 >> 172.21.15.52:0/2929613482 conn(0x7f52c406c380 msgr2=0x7f52c406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 -- 172.21.15.52:0/2929613482 shutdown_connections 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.952+0000 7f52c8a00640 1 -- 172.21.15.52:0/2929613482 wait complete. 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.954+0000 7f52c8a00640 1 Processor -- start 2024-06-02T16:45:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.954+0000 7f52c8a00640 1 -- start start 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8004e60 0x7f52c413b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c413d630 0x7f52c40725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4142440 con 0x7f52c413a2a0 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4141f20 con 0x7f52a8004e60 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c8a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f52c41425c0 con 0x7f52c413d630 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52776/0 (socket says 172.21.15.52:52776) 2024-06-02T16:45:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c3e00640 1 -- 172.21.15.52:0/1421343487 learned_addr learned my addr 172.21.15.52:0/1421343487 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52c3400640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8004e60 0x7f52c413b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.955+0000 7f52baa00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c413d630 0x7f52c40725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 -- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c413d630 msgr2=0x7f52c40725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c413d630 0x7f52c40725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 -- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8004e60 msgr2=0x7f52c413b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8004e60 0x7f52c413b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 -- 172.21.15.52:0/1421343487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4153ea0 con 0x7f52c413a2a0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c3e00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00b980 tx=0x7f52bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc042030 con 0x7f52c413a2a0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc02ac30 con 0x7f52c413a2a0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00b600 con 0x7f52c413a2a0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c413ac60 con 0x7f52c413a2a0 2024-06-02T16:45:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.956+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c4154110 con 0x7f52c413a2a0 2024-06-02T16:45:12.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.958+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c4160470 con 0x7f52c413a2a0 2024-06-02T16:45:12.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.959+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f52bc004240 con 0x7f52c413a2a0 2024-06-02T16:45:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.960+0000 7f52bbe00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 0x7f52a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.960+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f52bc0b73b0 con 0x7f52c413a2a0 2024-06-02T16:45:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.960+0000 7f52c3400640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 0x7f52a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.961+0000 7f52c3400640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 0x7f52a00787c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005230 tx=0x7f52b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:12.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:12.964+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52c4160470 con 0x7f52c413a2a0 2024-06-02T16:45:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.179+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52c40b4020 con 0x7f52c413a2a0 2024-06-02T16:45:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.181+0000 7f52bbe00640 1 -- 172.21.15.52:0/1421343487 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16618 (secure 0 0 0) 0x7f52bc04b020 con 0x7f52c413a2a0 2024-06-02T16:45:13.180 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:13.180 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:11.730166+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 msgr2=0x7f52a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 0x7f52a00787c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005230 tx=0x7f52b4009040 comp rx=0 tx=0).stop 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 msgr2=0x7f52c413a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00b980 tx=0x7f52bc004730 comp rx=0 tx=0).stop 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 shutdown_connections 2024-06-02T16:45:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f52a0076300 0x7f52a00787c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52c413a2a0 0x7f52c413a720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52c413d630 0x7f52c40725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 --2- 172.21.15.52:0/1421343487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a8004e60 0x7f52c413b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 >> 172.21.15.52:0/1421343487 conn(0x7f52c406c380 msgr2=0x7f52c415e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 shutdown_connections 2024-06-02T16:45:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.184+0000 7f52c8a00640 1 -- 172.21.15.52:0/1421343487 wait complete. 2024-06-02T16:45:13.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T16:45:13.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.421+0000 7fb50e600640 1 Processor -- start 2024-06-02T16:45:13.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.421+0000 7fb50e600640 1 -- start start 2024-06-02T16:45:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb50e600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb508167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb50e600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb508070650 con 0x7fb508074230 2024-06-02T16:45:13.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb50e600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb508072450 con 0x7fb50815d330 2024-06-02T16:45:13.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb50e600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb508072730 con 0x7fb5080734f0 2024-06-02T16:45:13.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb507e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb508074230 0x7fb5080ade40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51754/0 (socket says 172.21.15.52:51754) 2024-06-02T16:45:13.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb507e00640 1 -- 172.21.15.52:0/1579224588 learned_addr learned my addr 172.21.15.52:0/1579224588 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.423+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb508167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579321888 0 0) 0x7fb508070650 con 0x7fb508074230 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb508074230 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622138390 0 0) 0x7fb4ec003520 con 0x7fb508074230 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 msgr2=0x7fb508167ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb508167ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 >> v1:172.21.15.114:6789/0 conn(0x7fb50815d330 legacy=0x7fb508073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb508072a10 con 0x7fb508074230 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fb4f00016f0 con 0x7fb508074230 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb508167ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 >> v1:172.21.15.52:6789/0 conn(0x7fb508074230 legacy=0x7fb5080ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb4ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec003f70 0x7fb4ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb4ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb508072730 con 0x7fb4ec004d40 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec00bad0 con 0x7fb4ec003f70 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.424+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec00bcd0 con 0x7fb5080734f0 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb4ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb507e00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec003f70 0x7fb4ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50d200640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb4ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 -- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 msgr2=0x7fb4ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5080734f0 0x7fb4ec0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 -- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec003f70 msgr2=0x7fb4ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:13.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec003f70 0x7fb4ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.425+0000 7fb50dc00640 1 -- 172.21.15.52:0/1579224588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec003520 con 0x7fb4ec004d40 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.426+0000 7fb50dc00640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb4ec0051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5080b3f30 tx=0x7fb4ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2bfe7ac7f2fcb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500036070 con 0x7fb4ec004d40 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb500031400 con 0x7fb4ec004d40 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb507400640 1 -- 172.21.15.52:0/1579224588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500009820 con 0x7fb4ec004d40 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 -- 172.21.15.52:0/1579224588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 msgr2=0x7fb4ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 --2- 172.21.15.52:0/1579224588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb4ec0051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5080b3f30 tx=0x7fb4ec005830 comp rx=0 tx=0).stop 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50dc00640 1 -- 172.21.15.52:0/1579224588 reap_dead start 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 -- 172.21.15.52:0/1579224588 shutdown_connections 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 -- 172.21.15.52:0/1579224588 >> 172.21.15.52:0/1579224588 conn(0x7fb5080b2b60 msgr2=0x7fb5080b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 -- 172.21.15.52:0/1579224588 shutdown_connections 2024-06-02T16:45:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.427+0000 7fb50e600640 1 -- 172.21.15.52:0/1579224588 wait complete. 2024-06-02T16:45:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.429+0000 7fb50e600640 1 Processor -- start 2024-06-02T16:45:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.429+0000 7fb50e600640 1 -- start start 2024-06-02T16:45:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 0x7fb5081516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5080d1600 0x7fb508159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5080ae550 con 0x7fb4ec004d40 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb508072fd0 con 0x7fb5080d1600 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.430+0000 7fb50e600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb5080ae6d0 con 0x7fb508151d90 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52790/0 (socket says 172.21.15.52:52790) 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 -- 172.21.15.52:0/303759836 learned_addr learned my addr 172.21.15.52:0/303759836 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50dc00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5080d1600 0x7fb508159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb507e00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 0x7fb5081516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 -- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 msgr2=0x7fb5081516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 0x7fb5081516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 -- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5080d1600 msgr2=0x7fb508159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5080d1600 0x7fb508159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb50d200640 1 -- 172.21.15.52:0/303759836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb508160560 con 0x7fb4ec004d40 2024-06-02T16:45:13.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.431+0000 7fb507e00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 0x7fb5081516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb50d200640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800db10 tx=0x7fb4f8002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8003da0 con 0x7fb4ec004d40 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f8017070 con 0x7fb4ec004d40 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb508160280 con 0x7fb4ec004d40 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800b9c0 con 0x7fb4ec004d40 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.432+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb508154490 con 0x7fb4ec004d40 2024-06-02T16:45:13.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.433+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb508154750 con 0x7fb4ec004d40 2024-06-02T16:45:13.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.434+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4f800bb60 con 0x7fb4ec004d40 2024-06-02T16:45:13.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.435+0000 7fb504c00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 0x7fb4e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:13.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.435+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb4f80979a0 con 0x7fb4ec004d40 2024-06-02T16:45:13.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.436+0000 7fb507e00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 0x7fb4e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:13.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.437+0000 7fb507e00640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 0x7fb4e4078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb50815c750 tx=0x7fb4f0001db0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.440+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4f8061260 con 0x7fb4ec004d40 2024-06-02T16:45:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:13.690+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb5080507e0 con 0x7fb4ec004d40 2024-06-02T16:45:14.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.300+0000 7fb504c00640 1 -- 172.21.15.52:0/303759836 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb4f8069250 con 0x7fb4ec004d40 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 msgr2=0x7fb4e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 0x7fb4e4078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb50815c750 tx=0x7fb4f0001db0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 msgr2=0x7fb50815c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800db10 tx=0x7fb4f8002150 comp rx=0 tx=0).stop 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 shutdown_connections 2024-06-02T16:45:14.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb4e40762d0 0x7fb4e4078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5080d1600 0x7fb508159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb508151d90 0x7fb5081516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 --2- 172.21.15.52:0/303759836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec004d40 0x7fb50815c210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.304+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 >> 172.21.15.52:0/303759836 conn(0x7fb5080b2b60 msgr2=0x7fb5080d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.305+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 shutdown_connections 2024-06-02T16:45:14.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.305+0000 7fb50e600640 1 -- 172.21.15.52:0/303759836 wait complete. 2024-06-02T16:45:14.324 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T16:45:14.324 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T16:45:14.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.536+0000 7f0c56c00640 1 Processor -- start 2024-06-02T16:45:14.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.536+0000 7f0c56c00640 1 -- start start 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c56c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c500d0830 0x7f0c5016a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c56c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c500d3e20 con 0x7f0c500badc0 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c56c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c500d4100 con 0x7f0c5015f420 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c56c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0c500d4a30 con 0x7f0c500d0830 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c54e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0c500badc0 0x7f0c500d0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51764/0 (socket says 172.21.15.52:51764) 2024-06-02T16:45:14.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.537+0000 7f0c54e00640 1 -- 172.21.15.52:0/1647673505 learned_addr learned my addr 172.21.15.52:0/1647673505 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435738356 0 0) 0x7f0c500d3e20 con 0x7f0c500badc0 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c34003520 con 0x7f0c500badc0 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c56200640 1 --2- 172.21.15.52:0/1647673505 >> v2:172.21.15.114:3300/0 conn(0x7f0c500d0830 0x7f0c5016a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 12793079 0 0) 0x7f0c34003520 con 0x7f0c500badc0 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 >> v2:172.21.15.114:3300/0 conn(0x7f0c500d0830 msgr2=0x7f0c5016a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 --2- 172.21.15.52:0/1647673505 >> v2:172.21.15.114:3300/0 conn(0x7f0c500d0830 0x7f0c5016a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 >> v1:172.21.15.114:6789/0 conn(0x7f0c5015f420 legacy=0x7f0c500d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c500d43e0 con 0x7f0c500badc0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f0c3c0016f0 con 0x7f0c500badc0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 >> v1:172.21.15.52:6789/0 conn(0x7f0c500badc0 legacy=0x7f0c500d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 0x7f0c34003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c34004800 0x7f0c34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.538+0000 7f0c4fe00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c340052e0 0x7f0c3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0c500d4a30 con 0x7f0c34003a50 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3400c1e0 con 0x7f0c34004800 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3400c3e0 con 0x7f0c340052e0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 0x7f0c34003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c54e00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c34004800 0x7f0c34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c56200640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c340052e0 0x7f0c3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 -- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c340052e0 msgr2=0x7f0c3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:14.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c340052e0 0x7f0c3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 -- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c34004800 msgr2=0x7f0c34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:14.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c34004800 0x7f0c34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c55800640 1 -- 172.21.15.52:0/1647673505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c34003520 con 0x7f0c34003a50 2024-06-02T16:45:14.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.539+0000 7f0c56200640 1 -- 172.21.15.52:0/1647673505 reap_dead start 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.541+0000 7f0c55800640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 0x7f0c34003e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c40001760 tx=0x7f0c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d526eb30879d38a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.541+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c400013b0 con 0x7f0c34003a50 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.541+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c400052d0 con 0x7f0c34003a50 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.541+0000 7f0c4fe00640 1 -- 172.21.15.52:0/1647673505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4002aa50 con 0x7f0c34003a50 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 -- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 msgr2=0x7f0c34003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 0x7f0c34003e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c40001760 tx=0x7f0c34005830 comp rx=0 tx=0).stop 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 -- 172.21.15.52:0/1647673505 shutdown_connections 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 --2- 172.21.15.52:0/1647673505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c34003a50 0x7f0c34003e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 -- 172.21.15.52:0/1647673505 >> 172.21.15.52:0/1647673505 conn(0x7f0c500740e0 msgr2=0x7f0c5006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:14.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 -- 172.21.15.52:0/1647673505 shutdown_connections 2024-06-02T16:45:14.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.542+0000 7f0c56c00640 1 -- 172.21.15.52:0/1647673505 wait complete. 2024-06-02T16:45:14.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.544+0000 7f0c56c00640 1 Processor -- start 2024-06-02T16:45:14.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.544+0000 7f0c56c00640 1 -- start start 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c34003a50 0x7f0c500ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500caab0 0x7f0c500caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0c500d4ec0 con 0x7f0c500cce30 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5015f800 con 0x7f0c500caab0 2024-06-02T16:45:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c56c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0c500cdf40 con 0x7f0c34003a50 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c54e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c54e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52806/0 (socket says 172.21.15.52:52806) 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.545+0000 7f0c54e00640 1 -- 172.21.15.52:0/4203344198 learned_addr learned my addr 172.21.15.52:0/4203344198 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c55800640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c34003a50 0x7f0c500ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c56200640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500caab0 0x7f0c500caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 -- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c34003a50 msgr2=0x7f0c500ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c34003a50 0x7f0c500ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 -- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500caab0 msgr2=0x7f0c500caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500caab0 0x7f0c500caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:14.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 -- 172.21.15.52:0/4203344198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5015be20 con 0x7f0c500cce30 2024-06-02T16:45:14.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c54e00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c004f70 tx=0x7f0c3c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:14.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c01a070 con 0x7f0c500cce30 2024-06-02T16:45:14.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c007740 con 0x7f0c500cce30 2024-06-02T16:45:14.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00fba0 con 0x7f0c500cce30 2024-06-02T16:45:14.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.546+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c500cd980 con 0x7f0c500cce30 2024-06-02T16:45:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.547+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501e7bb0 con 0x7f0c500cce30 2024-06-02T16:45:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.548+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c500507e0 con 0x7f0c500cce30 2024-06-02T16:45:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.549+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c3c01d070 con 0x7f0c500cce30 2024-06-02T16:45:14.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.550+0000 7f0c4d600640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 0x7f0c30078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:14.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.550+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3c096fd0 con 0x7f0c500cce30 2024-06-02T16:45:14.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.551+0000 7f0c55800640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 0x7f0c30078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:14.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.552+0000 7f0c55800640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 0x7f0c30078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c40032000 tx=0x7f0c4002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:14.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.555+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c3c060890 con 0x7f0c500cce30 2024-06-02T16:45:14.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:14.802+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0c500cf930 con 0x7f0c500cce30 2024-06-02T16:45:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.304+0000 7f0c4d600640 1 -- 172.21.15.52:0/4203344198 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f0c3c060190 con 0x7f0c500cce30 2024-06-02T16:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 msgr2=0x7f0c30078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 0x7f0c30078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c40032000 tx=0x7f0c4002e000 comp rx=0 tx=0).stop 2024-06-02T16:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 msgr2=0x7f0c500cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c004f70 tx=0x7f0c3c0074f0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 shutdown_connections 2024-06-02T16:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0c300762d0 0x7f0c30078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c500caab0 0x7f0c500caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c500cce30 0x7f0c500cd270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 --2- 172.21.15.52:0/4203344198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c34003a50 0x7f0c500ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 >> 172.21.15.52:0/4203344198 conn(0x7f0c500740e0 msgr2=0x7f0c50161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 shutdown_connections 2024-06-02T16:45:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.307+0000 7f0c56c00640 1 -- 172.21.15.52:0/4203344198 wait complete. 2024-06-02T16:45:15.328 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T16:45:15.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:15.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.530+0000 7feb1da00640 1 Processor -- start 2024-06-02T16:45:15.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.531+0000 7feb1da00640 1 -- start start 2024-06-02T16:45:15.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb1da00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feb18072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb1da00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1806ea40 con 0x7feb1806e130 2024-06-02T16:45:15.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb1da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb18160c80 con 0x7feb181577f0 2024-06-02T16:45:15.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb1da00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feb18160f60 con 0x7feb1806e5b0 2024-06-02T16:45:15.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb0fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb1806e130 0x7feb18072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51776/0 (socket says 172.21.15.52:51776) 2024-06-02T16:45:15.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb0fe00640 1 -- 172.21.15.52:0/466201811 learned_addr learned my addr 172.21.15.52:0/466201811 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.533+0000 7feb1d000640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feb18072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395084707 0 0) 0x7feb1806ea40 con 0x7feb1806e130 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feafc003520 con 0x7feb1806e130 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141583391 0 0) 0x7feafc003520 con 0x7feb1806e130 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 msgr2=0x7feb18072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feb18072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 >> v1:172.21.15.114:6789/0 conn(0x7feb181577f0 legacy=0x7feb18073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb18161240 con 0x7feb1806e130 2024-06-02T16:45:15.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7feb000016f0 con 0x7feb1806e130 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 >> v1:172.21.15.52:6789/0 conn(0x7feb1806e130 legacy=0x7feb18072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feafc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feafc004000 0x7feafc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feafc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb18160f60 con 0x7feafc004d40 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feafc00bb50 con 0x7feafc004000 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feafc00bd50 con 0x7feb1806e5b0 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.534+0000 7feb1d000640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feafc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb0fe00640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feafc004000 0x7feafc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb17e00640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feafc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb1d000640 1 -- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 msgr2=0x7feafc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb1d000640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feafc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb1d000640 1 -- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feafc004000 msgr2=0x7feafc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:15.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb1d000640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feafc004000 0x7feafc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb1d000640 1 -- 172.21.15.52:0/466201811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc003520 con 0x7feafc004d40 2024-06-02T16:45:15.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.535+0000 7feb17e00640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb1806e5b0 0x7feafc003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.536+0000 7feb1d000640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feafc0051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb10009fc0 tx=0x7feafc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c984d6633b52d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.536+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10009c10 con 0x7feafc004d40 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.536+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb10036070 con 0x7feafc004d40 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.536+0000 7feb17400640 1 -- 172.21.15.52:0/466201811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10031880 con 0x7feafc004d40 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 -- 172.21.15.52:0/466201811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 msgr2=0x7feafc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 --2- 172.21.15.52:0/466201811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feafc0051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb10009fc0 tx=0x7feafc005830 comp rx=0 tx=0).stop 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1d000640 1 -- 172.21.15.52:0/466201811 reap_dead start 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 -- 172.21.15.52:0/466201811 shutdown_connections 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 -- 172.21.15.52:0/466201811 >> 172.21.15.52:0/466201811 conn(0x7feb1806c380 msgr2=0x7feb1806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 -- 172.21.15.52:0/466201811 shutdown_connections 2024-06-02T16:45:15.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.537+0000 7feb1da00640 1 -- 172.21.15.52:0/466201811 wait complete. 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.539+0000 7feb1da00640 1 Processor -- start 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.539+0000 7feb1da00640 1 -- start start 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb181444d0 0x7feb181f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 0x7feb18154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb18161a40 con 0x7feafc004d40 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb1815e510 con 0x7feb181444d0 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1da00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feb18074580 con 0x7feb181f8dd0 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52822/0 (socket says 172.21.15.52:52822) 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb17e00640 1 -- 172.21.15.52:0/2785081083 learned_addr learned my addr 172.21.15.52:0/2785081083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb0fe00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb181444d0 0x7feb181f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.540+0000 7feb1d000640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 0x7feb18154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 -- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 msgr2=0x7feb18154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 0x7feb18154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 -- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb181444d0 msgr2=0x7feb181f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb181444d0 0x7feb181f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 -- 172.21.15.52:0/2785081083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb181f9350 con 0x7feafc004d40 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb1d000640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 0x7feb18154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb17e00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb0800d7a0 tx=0x7feb0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08005270 con 0x7feafc004d40 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb08017070 con 0x7feafc004d40 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0800b6b0 con 0x7feafc004d40 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb181f9630 con 0x7feafc004d40 2024-06-02T16:45:15.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.541+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb18144950 con 0x7feafc004d40 2024-06-02T16:45:15.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.542+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb180b4020 con 0x7feafc004d40 2024-06-02T16:45:15.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.543+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb0800b850 con 0x7feafc004d40 2024-06-02T16:45:15.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.544+0000 7feb14c00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 0x7feaf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:15.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.545+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb08097640 con 0x7feafc004d40 2024-06-02T16:45:15.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.545+0000 7feb0fe00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 0x7feaf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:15.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.546+0000 7feb0fe00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 0x7feaf4078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb181e9190 tx=0x7feb00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:15.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.549+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb08060f90 con 0x7feafc004d40 2024-06-02T16:45:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.801+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb1806f070 con 0x7feafc004d40 2024-06-02T16:45:15.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.802+0000 7feb14c00640 1 -- 172.21.15.52:0/2785081083 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7feb08060890 con 0x7feafc004d40 2024-06-02T16:45:15.802 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:15.802 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 msgr2=0x7feaf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 0x7feaf4078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb181e9190 tx=0x7feb00009040 comp rx=0 tx=0).stop 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 msgr2=0x7feb18157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb0800d7a0 tx=0x7feb0800dc60 comp rx=0 tx=0).stop 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 shutdown_connections 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaf40762d0 0x7feaf4078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb181f8dd0 0x7feb18154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb181444d0 0x7feb181f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 --2- 172.21.15.52:0/2785081083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feafc004d40 0x7feb18157bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:15.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 >> 172.21.15.52:0/2785081083 conn(0x7feb1806c380 msgr2=0x7feb1815c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:15.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 shutdown_connections 2024-06-02T16:45:15.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:15.806+0000 7feb1da00640 1 -- 172.21.15.52:0/2785081083 wait complete. 2024-06-02T16:45:15.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:16.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.039+0000 7f0f2ce00640 1 Processor -- start 2024-06-02T16:45:16.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.040+0000 7f0f2ce00640 1 -- start start 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.041+0000 7f0f2ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f2806fed0 0x7f0f280ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.041+0000 7f0f2ce00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280ae8e0 con 0x7f0f280d1b60 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.041+0000 7f0f2ce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280ae600 con 0x7f0f2815d2d0 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.041+0000 7f0f2ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0f2815d6b0 con 0x7f0f2806fed0 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.042+0000 7f0f1fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f280d1b60 0x7f0f280727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51788/0 (socket says 172.21.15.52:51788) 2024-06-02T16:45:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.042+0000 7f0f1fe00640 1 -- 172.21.15.52:0/2326465065 learned_addr learned my addr 172.21.15.52:0/2326465065 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.042+0000 7f0f26800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f2806fed0 0x7f0f280ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.043+0000 7f0f26800640 1 -- 172.21.15.52:0/2326465065 >> v1:172.21.15.114:6789/0 conn(0x7f0f2815d2d0 legacy=0x7f0f280d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.043+0000 7f0f26800640 1 -- 172.21.15.52:0/2326465065 >> v1:172.21.15.52:6789/0 conn(0x7f0f280d1b60 legacy=0x7f0f280727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.043+0000 7f0f26800640 1 -- 172.21.15.52:0/2326465065 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2806e740 con 0x7f0f2806fed0 2024-06-02T16:45:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.043+0000 7f0f25400640 1 -- 172.21.15.52:0/2326465065 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288696432 0 0) 0x7f0f10001110 con 0x7f0f280d1b60 2024-06-02T16:45:16.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.044+0000 7f0f26800640 1 --2- 172.21.15.52:0/2326465065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f2806fed0 0x7f0f280ae020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009d90 tx=0x7f0f2002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d624bb8eb2a4054 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.045+0000 7f0f25400640 1 -- 172.21.15.52:0/2326465065 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20007740 con 0x7f0f2806fed0 2024-06-02T16:45:16.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.045+0000 7f0f25400640 1 -- 172.21.15.52:0/2326465065 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f200078e0 con 0x7f0f2806fed0 2024-06-02T16:45:16.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.045+0000 7f0f25400640 1 -- 172.21.15.52:0/2326465065 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20007cb0 con 0x7f0f2806fed0 2024-06-02T16:45:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.045+0000 7f0f2ce00640 1 -- 172.21.15.52:0/2326465065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f2806fed0 msgr2=0x7f0f280ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.045+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/2326465065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f2806fed0 0x7f0f280ae020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009d90 tx=0x7f0f2002a660 comp rx=0 tx=0).stop 2024-06-02T16:45:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.046+0000 7f0f2ce00640 1 -- 172.21.15.52:0/2326465065 shutdown_connections 2024-06-02T16:45:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.046+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/2326465065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f2806fed0 0x7f0f280ae020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.046+0000 7f0f2ce00640 1 -- 172.21.15.52:0/2326465065 >> 172.21.15.52:0/2326465065 conn(0x7f0f2806c7a0 msgr2=0x7f0f2806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.046+0000 7f0f2ce00640 1 -- 172.21.15.52:0/2326465065 shutdown_connections 2024-06-02T16:45:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.046+0000 7f0f2ce00640 1 -- 172.21.15.52:0/2326465065 wait complete. 2024-06-02T16:45:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.047+0000 7f0f2ce00640 1 Processor -- start 2024-06-02T16:45:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.048+0000 7f0f2ce00640 1 -- start start 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f2806fed0 0x7f0f2809edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f280d1b60 0x7f0f2815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280741b0 con 0x7f0f2815d2d0 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2806ed90 con 0x7f0f280d1b60 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f2ce00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2815b780 con 0x7f0f2806fed0 2024-06-02T16:45:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f26800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f26800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52834/0 (socket says 172.21.15.52:52834) 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f26800640 1 -- 172.21.15.52:0/1461865320 learned_addr learned my addr 172.21.15.52:0/1461865320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f1fe00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f280d1b60 0x7f0f2815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.049+0000 7f0f25e00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f2806fed0 0x7f0f2809edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 -- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f2806fed0 msgr2=0x7f0f2809edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f2806fed0 0x7f0f2809edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 -- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f280d1b60 msgr2=0x7f0f2815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f280d1b60 0x7f0f2815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 -- 172.21.15.52:0/1461865320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2815ba20 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f26800640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009eb0 tx=0x7f0f20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20040070 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f20031c90 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2003c640 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2815bd00 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.050+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f281f2d90 con 0x7f0f2815d2d0 2024-06-02T16:45:16.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.052+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f28069520 con 0x7f0f2815d2d0 2024-06-02T16:45:16.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.053+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f20039040 con 0x7f0f2815d2d0 2024-06-02T16:45:16.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.054+0000 7f0f1e000640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 0x7f0f04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.054+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0f200b8b70 con 0x7f0f2815d2d0 2024-06-02T16:45:16.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.055+0000 7f0f25e00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 0x7f0f04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.055+0000 7f0f25e00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 0x7f0f04078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000f60 tx=0x7f0f18009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.059+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f20082620 con 0x7f0f2815d2d0 2024-06-02T16:45:16.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.272+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f280d15c0 con 0x7f0f2815d2d0 2024-06-02T16:45:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.275+0000 7f0f1e000640 1 -- 172.21.15.52:0/1461865320 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7f0f20081f20 con 0x7f0f2815d2d0 2024-06-02T16:45:16.275 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:16.276 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.278+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 msgr2=0x7f0f04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.278+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 0x7f0f04078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000f60 tx=0x7f0f18009040 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.278+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 msgr2=0x7f0f281f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.278+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009eb0 tx=0x7f0f20004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 shutdown_connections 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f040762d0 0x7f0f04078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f2815d2d0 0x7f0f281f3630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f280d1b60 0x7f0f2815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 --2- 172.21.15.52:0/1461865320 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f2806fed0 0x7f0f2809edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 >> 172.21.15.52:0/1461865320 conn(0x7f0f2806c7a0 msgr2=0x7f0f28161330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 shutdown_connections 2024-06-02T16:45:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.279+0000 7f0f2ce00640 1 -- 172.21.15.52:0/1461865320 wait complete. 2024-06-02T16:45:16.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T16:45:16.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:45:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.514+0000 7fda39400640 1 Processor -- start 2024-06-02T16:45:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.514+0000 7fda39400640 1 -- start start 2024-06-02T16:45:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.515+0000 7fda39400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda341577f0 0x7fda34073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.515+0000 7fda39400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 0x7fda34072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda39400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda34160c80 con 0x7fda34073fb0 2024-06-02T16:45:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda39400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fda34160f60 con 0x7fda341577f0 2024-06-02T16:45:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda39400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fda34161240 con 0x7fda3406e840 2024-06-02T16:45:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda33e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda341577f0 0x7fda34073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda33400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fda34073fb0 0x7fda3406e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:36456/0 (socket says 172.21.15.52:36456) 2024-06-02T16:45:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda33400640 1 -- 172.21.15.52:0/555889510 learned_addr learned my addr 172.21.15.52:0/555889510 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.516+0000 7fda38a00640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 0x7fda34072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.517+0000 7fda33e00640 1 -- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 msgr2=0x7fda34072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.517+0000 7fda33e00640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 0x7fda34072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.517+0000 7fda33e00640 1 -- 172.21.15.52:0/555889510 >> v1:172.21.15.114:6789/0 conn(0x7fda34073fb0 legacy=0x7fda3406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.517+0000 7fda33e00640 1 -- 172.21.15.52:0/555889510 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34161520 con 0x7fda341577f0 2024-06-02T16:45:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.517+0000 7fda38a00640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 0x7fda34072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.519+0000 7fda33e00640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda341577f0 0x7fda34073a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda24009d90 tx=0x7fda2402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3697e3b2816ce465 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.519+0000 7fda32a00640 1 -- 172.21.15.52:0/555889510 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24007740 con 0x7fda341577f0 2024-06-02T16:45:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda32a00640 1 -- 172.21.15.52:0/555889510 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda240078e0 con 0x7fda341577f0 2024-06-02T16:45:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda32a00640 1 -- 172.21.15.52:0/555889510 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24007cb0 con 0x7fda341577f0 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 -- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda341577f0 msgr2=0x7fda34073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda341577f0 0x7fda34073a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda24009d90 tx=0x7fda2402a660 comp rx=0 tx=0).stop 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 -- 172.21.15.52:0/555889510 shutdown_connections 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda3406e840 0x7fda34072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 --2- 172.21.15.52:0/555889510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda341577f0 0x7fda34073a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 -- 172.21.15.52:0/555889510 >> 172.21.15.52:0/555889510 conn(0x7fda3406c380 msgr2=0x7fda3406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 -- 172.21.15.52:0/555889510 shutdown_connections 2024-06-02T16:45:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.520+0000 7fda39400640 1 -- 172.21.15.52:0/555889510 wait complete. 2024-06-02T16:45:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.522+0000 7fda39400640 1 Processor -- start 2024-06-02T16:45:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.522+0000 7fda39400640 1 -- start start 2024-06-02T16:45:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda34073fb0 0x7fda3413e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 0x7fda3413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda34074580 con 0x7fda3406e840 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda34161a40 con 0x7fda34073fb0 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda39400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fda34072880 con 0x7fda341577f0 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.523+0000 7fda33e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52848/0 (socket says 172.21.15.52:52848) 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 -- 172.21.15.52:0/1042646180 learned_addr learned my addr 172.21.15.52:0/1042646180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda38a00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 0x7fda3413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda34073fb0 0x7fda3413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 -- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 msgr2=0x7fda3413f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 0x7fda3413f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 -- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda34073fb0 msgr2=0x7fda3413e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda34073fb0 0x7fda3413e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 -- 172.21.15.52:0/1042646180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34141d50 con 0x7fda3406e840 2024-06-02T16:45:16.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda38a00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 0x7fda3413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:16.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.524+0000 7fda33e00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda24009eb0 tx=0x7fda24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.525+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2403f070 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.525+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda24031bc0 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.525+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24044460 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.525+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3413eeb0 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.525+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3413c650 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.526+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda34075ea0 con 0x7fda3406e840 2024-06-02T16:45:16.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.527+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda24044600 con 0x7fda3406e840 2024-06-02T16:45:16.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.529+0000 7fda2be00640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 0x7fda10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:16.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.529+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fda240b8dd0 con 0x7fda3406e840 2024-06-02T16:45:16.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.529+0000 7fda33400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 0x7fda10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:16.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.530+0000 7fda33400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 0x7fda10078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda3415a190 tx=0x7fda1c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:16.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.533+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda24082690 con 0x7fda3406e840 2024-06-02T16:45:16.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.740+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda340507e0 con 0x7fda100762d0 2024-06-02T16:45:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.763+0000 7fda2be00640 1 -- 172.21.15.52:0/1042646180 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7fda340507e0 con 0x7fda100762d0 2024-06-02T16:45:16.766 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:16.768 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:45:16.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 msgr2=0x7fda10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 0x7fda10078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda3415a190 tx=0x7fda1c009040 comp rx=0 tx=0).stop 2024-06-02T16:45:16.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 msgr2=0x7fda3413b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:16.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda24009eb0 tx=0x7fda24004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 shutdown_connections 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda100762d0 0x7fda10078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda341577f0 0x7fda3413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda34073fb0 0x7fda3413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 --2- 172.21.15.52:0/1042646180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3406e840 0x7fda3413b800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 >> 172.21.15.52:0/1042646180 conn(0x7fda3406c380 msgr2=0x7fda34156510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.768+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 shutdown_connections 2024-06-02T16:45:16.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:16.769+0000 7fda39400640 1 -- 172.21.15.52:0/1042646180 wait complete. 2024-06-02T16:45:16.788 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-06-02T16:45:15.993203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3031040,"data_stored":1798876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.758549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996517+0000","last_change":"2024-06-02T16:45:12.306743+0000","last_active":"2024-06-02T16:45:13.996517+0000","last_peered":"2024-06-02T16:45:13.996517+0000","last_clean":"2024-06-02T16:45:13.996517+0000","last_became_active":"2024-06-02T16:45:12.306440+0000","last_became_peered":"2024-06-02T16:45:12.306440+0000","last_unstale":"2024-06-02T16:45:13.996517+0000","last_undegraded":"2024-06-02T16:45:13.996517+0000","last_fullsized":"2024-06-02T16:45:13.996517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298670+0000","last_change":"2024-06-02T16:45:12.292683+0000","last_active":"2024-06-02T16:45:12.298670+0000","last_peered":"2024-06-02T16:45:12.298670+0000","last_clean":"2024-06-02T16:45:12.298670+0000","last_became_active":"2024-06-02T16:45:12.292372+0000","last_became_peered":"2024-06-02T16:45:12.292372+0000","last_unstale":"2024-06-02T16:45:12.298670+0000","last_undegraded":"2024-06-02T16:45:12.298670+0000","last_fullsized":"2024-06-02T16:45:12.298670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:40:21.138253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298572+0000","last_change":"2024-06-02T16:45:12.293718+0000","last_active":"2024-06-02T16:45:12.298572+0000","last_peered":"2024-06-02T16:45:12.298572+0000","last_clean":"2024-06-02T16:45:12.298572+0000","last_became_active":"2024-06-02T16:45:12.293430+0000","last_became_peered":"2024-06-02T16:45:12.293430+0000","last_unstale":"2024-06-02T16:45:12.298572+0000","last_undegraded":"2024-06-02T16:45:12.298572+0000","last_fullsized":"2024-06-02T16:45:12.298572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:41.387072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402594+0000","last_change":"2024-06-02T16:45:12.309651+0000","last_active":"2024-06-02T16:45:14.402594+0000","last_peered":"2024-06-02T16:45:14.402594+0000","last_clean":"2024-06-02T16:45:14.402594+0000","last_became_active":"2024-06-02T16:45:12.309314+0000","last_became_peered":"2024-06-02T16:45:12.309314+0000","last_unstale":"2024-06-02T16:45:14.402594+0000","last_undegraded":"2024-06-02T16:45:14.402594+0000","last_fullsized":"2024-06-02T16:45:14.402594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995876+0000","last_change":"2024-06-02T16:45:12.297519+0000","last_active":"2024-06-02T16:45:13.995876+0000","last_peered":"2024-06-02T16:45:13.995876+0000","last_clean":"2024-06-02T16:45:13.995876+0000","last_became_active":"2024-06-02T16:45:12.297239+0000","last_became_peered":"2024-06-02T16:45:12.297239+0000","last_unstale":"2024-06-02T16:45:13.995876+0000","last_undegraded":"2024-06-02T16:45:13.995876+0000","last_fullsized":"2024-06-02T16:45:13.995876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401349+0000","last_change":"2024-06-02T16:45:12.311245+0000","last_active":"2024-06-02T16:45:14.401349+0000","last_peered":"2024-06-02T16:45:14.401349+0000","last_clean":"2024-06-02T16:45:14.401349+0000","last_became_active":"2024-06-02T16:45:12.310210+0000","last_became_peered":"2024-06-02T16:45:12.310210+0000","last_unstale":"2024-06-02T16:45:14.401349+0000","last_undegraded":"2024-06-02T16:45:14.401349+0000","last_fullsized":"2024-06-02T16:45:14.401349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995424+0000","last_change":"2024-06-02T16:45:12.298527+0000","last_active":"2024-06-02T16:45:13.995424+0000","last_peered":"2024-06-02T16:45:13.995424+0000","last_clean":"2024-06-02T16:45:13.995424+0000","last_became_active":"2024-06-02T16:45:12.297923+0000","last_became_peered":"2024-06-02T16:45:12.297923+0000","last_unstale":"2024-06-02T16:45:13.995424+0000","last_undegraded":"2024-06-02T16:45:13.995424+0000","last_fullsized":"2024-06-02T16:45:13.995424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296562+0000","last_change":"2024-06-02T16:45:12.319083+0000","last_active":"2024-06-02T16:45:13.296562+0000","last_peered":"2024-06-02T16:45:13.296562+0000","last_clean":"2024-06-02T16:45:13.296562+0000","last_became_active":"2024-06-02T16:45:12.318762+0000","last_became_peered":"2024-06-02T16:45:12.318762+0000","last_unstale":"2024-06-02T16:45:13.296562+0000","last_undegraded":"2024-06-02T16:45:13.296562+0000","last_fullsized":"2024-06-02T16:45:13.296562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996683+0000","last_change":"2024-06-02T16:45:12.317753+0000","last_active":"2024-06-02T16:45:13.996683+0000","last_peered":"2024-06-02T16:45:13.996683+0000","last_clean":"2024-06-02T16:45:13.996683+0000","last_became_active":"2024-06-02T16:45:12.317416+0000","last_became_peered":"2024-06-02T16:45:12.317416+0000","last_unstale":"2024-06-02T16:45:13.996683+0000","last_undegraded":"2024-06-02T16:45:13.996683+0000","last_fullsized":"2024-06-02T16:45:13.996683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:31.192107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325971+0000","last_change":"2024-06-02T16:45:12.296816+0000","last_active":"2024-06-02T16:45:13.325971+0000","last_peered":"2024-06-02T16:45:13.325971+0000","last_clean":"2024-06-02T16:45:13.325971+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325971+0000","last_undegraded":"2024-06-02T16:45:13.325971+0000","last_fullsized":"2024-06-02T16:45:13.325971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325571+0000","last_change":"2024-06-02T16:45:12.304652+0000","last_active":"2024-06-02T16:45:13.325571+0000","last_peered":"2024-06-02T16:45:13.325571+0000","last_clean":"2024-06-02T16:45:13.325571+0000","last_became_active":"2024-06-02T16:45:12.304386+0000","last_became_peered":"2024-06-02T16:45:12.304386+0000","last_unstale":"2024-06-02T16:45:13.325571+0000","last_undegraded":"2024-06-02T16:45:13.325571+0000","last_fullsized":"2024-06-02T16:45:13.325571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402540+0000","last_change":"2024-06-02T16:45:12.305078+0000","last_active":"2024-06-02T16:45:14.402540+0000","last_peered":"2024-06-02T16:45:14.402540+0000","last_clean":"2024-06-02T16:45:14.402540+0000","last_became_active":"2024-06-02T16:45:12.304544+0000","last_became_peered":"2024-06-02T16:45:12.304544+0000","last_unstale":"2024-06-02T16:45:14.402540+0000","last_undegraded":"2024-06-02T16:45:14.402540+0000","last_fullsized":"2024-06-02T16:45:14.402540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297756+0000","last_change":"2024-06-02T16:45:12.308837+0000","last_active":"2024-06-02T16:45:13.297756+0000","last_peered":"2024-06-02T16:45:13.297756+0000","last_clean":"2024-06-02T16:45:13.297756+0000","last_became_active":"2024-06-02T16:45:12.307884+0000","last_became_peered":"2024-06-02T16:45:12.307884+0000","last_unstale":"2024-06-02T16:45:13.297756+0000","last_undegraded":"2024-06-02T16:45:13.297756+0000","last_fullsized":"2024-06-02T16:45:13.297756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.310097+0000","last_change":"2024-06-02T16:45:12.302741+0000","last_active":"2024-06-02T16:45:12.310097+0000","last_peered":"2024-06-02T16:45:12.310097+0000","last_clean":"2024-06-02T16:45:12.310097+0000","last_became_active":"2024-06-02T16:45:12.302448+0000","last_became_peered":"2024-06-02T16:45:12.302448+0000","last_unstale":"2024-06-02T16:45:12.310097+0000","last_undegraded":"2024-06-02T16:45:12.310097+0000","last_fullsized":"2024-06-02T16:45:12.310097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.304158+0000","last_change":"2024-06-02T16:45:12.298379+0000","last_active":"2024-06-02T16:45:12.304158+0000","last_peered":"2024-06-02T16:45:12.304158+0000","last_clean":"2024-06-02T16:45:12.304158+0000","last_became_active":"2024-06-02T16:45:12.297169+0000","last_became_peered":"2024-06-02T16:45:12.297169+0000","last_unstale":"2024-06-02T16:45:12.304158+0000","last_undegraded":"2024-06-02T16:45:12.304158+0000","last_fullsized":"2024-06-02T16:45:12.304158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:18.079887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400485+0000","last_change":"2024-06-02T16:45:12.313940+0000","last_active":"2024-06-02T16:45:14.400485+0000","last_peered":"2024-06-02T16:45:14.400485+0000","last_clean":"2024-06-02T16:45:14.400485+0000","last_became_active":"2024-06-02T16:45:12.313226+0000","last_became_peered":"2024-06-02T16:45:12.313226+0000","last_unstale":"2024-06-02T16:45:14.400485+0000","last_undegraded":"2024-06-02T16:45:14.400485+0000","last_fullsized":"2024-06-02T16:45:14.400485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403995+0000","last_change":"2024-06-02T16:45:12.312810+0000","last_active":"2024-06-02T16:45:14.403995+0000","last_peered":"2024-06-02T16:45:14.403995+0000","last_clean":"2024-06-02T16:45:14.403995+0000","last_became_active":"2024-06-02T16:45:12.312269+0000","last_became_peered":"2024-06-02T16:45:12.312269+0000","last_unstale":"2024-06-02T16:45:14.403995+0000","last_undegraded":"2024-06-02T16:45:14.403995+0000","last_fullsized":"2024-06-02T16:45:14.403995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297718+0000","last_change":"2024-06-02T16:45:12.304201+0000","last_active":"2024-06-02T16:45:13.297718+0000","last_peered":"2024-06-02T16:45:13.297718+0000","last_clean":"2024-06-02T16:45:13.297718+0000","last_became_active":"2024-06-02T16:45:12.303839+0000","last_became_peered":"2024-06-02T16:45:12.303839+0000","last_unstale":"2024-06-02T16:45:13.297718+0000","last_undegraded":"2024-06-02T16:45:13.297718+0000","last_fullsized":"2024-06-02T16:45:13.297718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996653+0000","last_change":"2024-06-02T16:45:12.300262+0000","last_active":"2024-06-02T16:45:13.996653+0000","last_peered":"2024-06-02T16:45:13.996653+0000","last_clean":"2024-06-02T16:45:13.996653+0000","last_became_active":"2024-06-02T16:45:12.299445+0000","last_became_peered":"2024-06-02T16:45:12.299445+0000","last_unstale":"2024-06-02T16:45:13.996653+0000","last_undegraded":"2024-06-02T16:45:13.996653+0000","last_fullsized":"2024-06-02T16:45:13.996653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:05.323209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325689+0000","last_change":"2024-06-02T16:45:12.303651+0000","last_active":"2024-06-02T16:45:13.325689+0000","last_peered":"2024-06-02T16:45:13.325689+0000","last_clean":"2024-06-02T16:45:13.325689+0000","last_became_active":"2024-06-02T16:45:12.301465+0000","last_became_peered":"2024-06-02T16:45:12.301465+0000","last_unstale":"2024-06-02T16:45:13.325689+0000","last_undegraded":"2024-06-02T16:45:13.325689+0000","last_fullsized":"2024-06-02T16:45:13.325689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.305661+0000","last_change":"2024-06-02T16:45:12.301175+0000","last_active":"2024-06-02T16:45:12.305661+0000","last_peered":"2024-06-02T16:45:12.305661+0000","last_clean":"2024-06-02T16:45:12.305661+0000","last_became_active":"2024-06-02T16:45:12.300384+0000","last_became_peered":"2024-06-02T16:45:12.300384+0000","last_unstale":"2024-06-02T16:45:12.305661+0000","last_undegraded":"2024-06-02T16:45:12.305661+0000","last_fullsized":"2024-06-02T16:45:12.305661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402228+0000","last_change":"2024-06-02T16:45:12.311520+0000","last_active":"2024-06-02T16:45:14.402228+0000","last_peered":"2024-06-02T16:45:14.402228+0000","last_clean":"2024-06-02T16:45:14.402228+0000","last_became_active":"2024-06-02T16:45:12.310653+0000","last_became_peered":"2024-06-02T16:45:12.310653+0000","last_unstale":"2024-06-02T16:45:14.402228+0000","last_undegraded":"2024-06-02T16:45:14.402228+0000","last_fullsized":"2024-06-02T16:45:14.402228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297205+0000","last_change":"2024-06-02T16:45:12.304397+0000","last_active":"2024-06-02T16:45:13.297205+0000","last_peered":"2024-06-02T16:45:13.297205+0000","last_clean":"2024-06-02T16:45:13.297205+0000","last_became_active":"2024-06-02T16:45:12.304107+0000","last_became_peered":"2024-06-02T16:45:12.304107+0000","last_unstale":"2024-06-02T16:45:13.297205+0000","last_undegraded":"2024-06-02T16:45:13.297205+0000","last_fullsized":"2024-06-02T16:45:13.297205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400682+0000","last_change":"2024-06-02T16:45:12.314155+0000","last_active":"2024-06-02T16:45:14.400682+0000","last_peered":"2024-06-02T16:45:14.400682+0000","last_clean":"2024-06-02T16:45:14.400682+0000","last_became_active":"2024-06-02T16:45:12.313644+0000","last_became_peered":"2024-06-02T16:45:12.313644+0000","last_unstale":"2024-06-02T16:45:14.400682+0000","last_undegraded":"2024-06-02T16:45:14.400682+0000","last_fullsized":"2024-06-02T16:45:14.400682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298924+0000","last_change":"2024-06-02T16:45:12.306290+0000","last_active":"2024-06-02T16:45:13.298924+0000","last_peered":"2024-06-02T16:45:13.298924+0000","last_clean":"2024-06-02T16:45:13.298924+0000","last_became_active":"2024-06-02T16:45:12.306055+0000","last_became_peered":"2024-06-02T16:45:12.306055+0000","last_unstale":"2024-06-02T16:45:13.298924+0000","last_undegraded":"2024-06-02T16:45:13.298924+0000","last_fullsized":"2024-06-02T16:45:13.298924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.326006+0000","last_change":"2024-06-02T16:45:12.303636+0000","last_active":"2024-06-02T16:45:13.326006+0000","last_peered":"2024-06-02T16:45:13.326006+0000","last_clean":"2024-06-02T16:45:13.326006+0000","last_became_active":"2024-06-02T16:45:12.302670+0000","last_became_peered":"2024-06-02T16:45:12.302670+0000","last_unstale":"2024-06-02T16:45:13.326006+0000","last_undegraded":"2024-06-02T16:45:13.326006+0000","last_fullsized":"2024-06-02T16:45:13.326006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.303888+0000","last_change":"2024-06-02T16:45:12.299670+0000","last_active":"2024-06-02T16:45:12.303888+0000","last_peered":"2024-06-02T16:45:12.303888+0000","last_clean":"2024-06-02T16:45:12.303888+0000","last_became_active":"2024-06-02T16:45:12.299052+0000","last_became_peered":"2024-06-02T16:45:12.299052+0000","last_unstale":"2024-06-02T16:45:12.303888+0000","last_undegraded":"2024-06-02T16:45:12.303888+0000","last_fullsized":"2024-06-02T16:45:12.303888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:22.230527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298514+0000","last_change":"2024-06-02T16:45:12.303422+0000","last_active":"2024-06-02T16:45:13.298514+0000","last_peered":"2024-06-02T16:45:13.298514+0000","last_clean":"2024-06-02T16:45:13.298514+0000","last_became_active":"2024-06-02T16:45:12.301580+0000","last_became_peered":"2024-06-02T16:45:12.301580+0000","last_unstale":"2024-06-02T16:45:13.298514+0000","last_undegraded":"2024-06-02T16:45:13.298514+0000","last_fullsized":"2024-06-02T16:45:13.298514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.312519+0000","last_change":"2024-06-02T16:45:12.310664+0000","last_active":"2024-06-02T16:45:12.312519+0000","last_peered":"2024-06-02T16:45:12.312519+0000","last_clean":"2024-06-02T16:45:12.312519+0000","last_became_active":"2024-06-02T16:45:12.310369+0000","last_became_peered":"2024-06-02T16:45:12.310369+0000","last_unstale":"2024-06-02T16:45:12.312519+0000","last_undegraded":"2024-06-02T16:45:12.312519+0000","last_fullsized":"2024-06-02T16:45:12.312519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402532+0000","last_change":"2024-06-02T16:45:12.310972+0000","last_active":"2024-06-02T16:45:14.402532+0000","last_peered":"2024-06-02T16:45:14.402532+0000","last_clean":"2024-06-02T16:45:14.402532+0000","last_became_active":"2024-06-02T16:45:12.309072+0000","last_became_peered":"2024-06-02T16:45:12.309072+0000","last_unstale":"2024-06-02T16:45:14.402532+0000","last_undegraded":"2024-06-02T16:45:14.402532+0000","last_fullsized":"2024-06-02T16:45:14.402532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296413+0000","last_change":"2024-06-02T16:45:12.319222+0000","last_active":"2024-06-02T16:45:13.296413+0000","last_peered":"2024-06-02T16:45:13.296413+0000","last_clean":"2024-06-02T16:45:13.296413+0000","last_became_active":"2024-06-02T16:45:12.318902+0000","last_became_peered":"2024-06-02T16:45:12.318902+0000","last_unstale":"2024-06-02T16:45:13.296413+0000","last_undegraded":"2024-06-02T16:45:13.296413+0000","last_fullsized":"2024-06-02T16:45:13.296413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325172+0000","last_change":"2024-06-02T16:45:12.293440+0000","last_active":"2024-06-02T16:45:13.325172+0000","last_peered":"2024-06-02T16:45:13.325172+0000","last_clean":"2024-06-02T16:45:13.325172+0000","last_became_active":"2024-06-02T16:45:12.293145+0000","last_became_peered":"2024-06-02T16:45:12.293145+0000","last_unstale":"2024-06-02T16:45:13.325172+0000","last_undegraded":"2024-06-02T16:45:13.325172+0000","last_fullsized":"2024-06-02T16:45:13.325172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401279+0000","last_change":"2024-06-02T16:45:12.302510+0000","last_active":"2024-06-02T16:45:14.401279+0000","last_peered":"2024-06-02T16:45:14.401279+0000","last_clean":"2024-06-02T16:45:14.401279+0000","last_became_active":"2024-06-02T16:45:12.301477+0000","last_became_peered":"2024-06-02T16:45:12.301477+0000","last_unstale":"2024-06-02T16:45:14.401279+0000","last_undegraded":"2024-06-02T16:45:14.401279+0000","last_fullsized":"2024-06-02T16:45:14.401279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297991+0000","last_change":"2024-06-02T16:45:11.272839+0000","last_active":"2024-06-02T16:45:13.297991+0000","last_peered":"2024-06-02T16:45:13.297991+0000","last_clean":"2024-06-02T16:45:13.297991+0000","last_became_active":"2024-06-02T16:45:11.272540+0000","last_became_peered":"2024-06-02T16:45:11.272540+0000","last_unstale":"2024-06-02T16:45:13.297991+0000","last_undegraded":"2024-06-02T16:45:13.297991+0000","last_fullsized":"2024-06-02T16:45:13.297991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.311323+0000","last_change":"2024-06-02T16:45:12.305267+0000","last_active":"2024-06-02T16:45:12.311323+0000","last_peered":"2024-06-02T16:45:12.311323+0000","last_clean":"2024-06-02T16:45:12.311323+0000","last_became_active":"2024-06-02T16:45:12.304804+0000","last_became_peered":"2024-06-02T16:45:12.304804+0000","last_unstale":"2024-06-02T16:45:12.311323+0000","last_undegraded":"2024-06-02T16:45:12.311323+0000","last_fullsized":"2024-06-02T16:45:12.311323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325127+0000","last_change":"2024-06-02T16:45:11.271730+0000","last_active":"2024-06-02T16:45:13.325127+0000","last_peered":"2024-06-02T16:45:13.325127+0000","last_clean":"2024-06-02T16:45:13.325127+0000","last_became_active":"2024-06-02T16:45:11.269255+0000","last_became_peered":"2024-06-02T16:45:11.269255+0000","last_unstale":"2024-06-02T16:45:13.325127+0000","last_undegraded":"2024-06-02T16:45:13.325127+0000","last_fullsized":"2024-06-02T16:45:13.325127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297433+0000","last_change":"2024-06-02T16:45:11.269405+0000","last_active":"2024-06-02T16:45:13.297433+0000","last_peered":"2024-06-02T16:45:13.297433+0000","last_clean":"2024-06-02T16:45:13.297433+0000","last_became_active":"2024-06-02T16:45:11.269072+0000","last_became_peered":"2024-06-02T16:45:11.269072+0000","last_unstale":"2024-06-02T16:45:13.297433+0000","last_undegraded":"2024-06-02T16:45:13.297433+0000","last_fullsized":"2024-06-02T16:45:13.297433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:39.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297102+0000","last_change":"2024-06-02T16:45:12.308910+0000","last_active":"2024-06-02T16:45:13.297102+0000","last_peered":"2024-06-02T16:45:13.297102+0000","last_clean":"2024-06-02T16:45:13.297102+0000","last_became_active":"2024-06-02T16:45:12.308375+0000","last_became_peered":"2024-06-02T16:45:12.308375+0000","last_unstale":"2024-06-02T16:45:13.297102+0000","last_undegraded":"2024-06-02T16:45:13.297102+0000","last_fullsized":"2024-06-02T16:45:13.297102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400758+0000","last_change":"2024-06-02T16:45:11.280551+0000","last_active":"2024-06-02T16:45:14.400758+0000","last_peered":"2024-06-02T16:45:14.400758+0000","last_clean":"2024-06-02T16:45:14.400758+0000","last_became_active":"2024-06-02T16:45:11.279982+0000","last_became_peered":"2024-06-02T16:45:11.279982+0000","last_unstale":"2024-06-02T16:45:14.400758+0000","last_undegraded":"2024-06-02T16:45:14.400758+0000","last_fullsized":"2024-06-02T16:45:14.400758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298520+0000","last_change":"2024-06-02T16:45:12.294403+0000","last_active":"2024-06-02T16:45:12.298520+0000","last_peered":"2024-06-02T16:45:12.298520+0000","last_clean":"2024-06-02T16:45:12.298520+0000","last_became_active":"2024-06-02T16:45:12.294104+0000","last_became_peered":"2024-06-02T16:45:12.294104+0000","last_unstale":"2024-06-02T16:45:12.298520+0000","last_undegraded":"2024-06-02T16:45:12.298520+0000","last_fullsized":"2024-06-02T16:45:12.298520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:59:26.559041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325481+0000","last_change":"2024-06-02T16:45:11.279215+0000","last_active":"2024-06-02T16:45:13.325481+0000","last_peered":"2024-06-02T16:45:13.325481+0000","last_clean":"2024-06-02T16:45:13.325481+0000","last_became_active":"2024-06-02T16:45:11.278900+0000","last_became_peered":"2024-06-02T16:45:11.278900+0000","last_unstale":"2024-06-02T16:45:13.325481+0000","last_undegraded":"2024-06-02T16:45:13.325481+0000","last_fullsized":"2024-06-02T16:45:13.325481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403606+0000","last_change":"2024-06-02T16:45:12.312906+0000","last_active":"2024-06-02T16:45:14.403606+0000","last_peered":"2024-06-02T16:45:14.403606+0000","last_clean":"2024-06-02T16:45:14.403606+0000","last_became_active":"2024-06-02T16:45:12.312594+0000","last_became_peered":"2024-06-02T16:45:12.312594+0000","last_unstale":"2024-06-02T16:45:14.403606+0000","last_undegraded":"2024-06-02T16:45:14.403606+0000","last_fullsized":"2024-06-02T16:45:14.403606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403585+0000","last_change":"2024-06-02T16:45:11.283234+0000","last_active":"2024-06-02T16:45:14.403585+0000","last_peered":"2024-06-02T16:45:14.403585+0000","last_clean":"2024-06-02T16:45:14.403585+0000","last_became_active":"2024-06-02T16:45:11.282949+0000","last_became_peered":"2024-06-02T16:45:11.282949+0000","last_unstale":"2024-06-02T16:45:14.403585+0000","last_undegraded":"2024-06-02T16:45:14.403585+0000","last_fullsized":"2024-06-02T16:45:14.403585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.317831+0000","last_change":"2024-06-02T16:45:12.317022+0000","last_active":"2024-06-02T16:45:12.317831+0000","last_peered":"2024-06-02T16:45:12.317831+0000","last_clean":"2024-06-02T16:45:12.317831+0000","last_became_active":"2024-06-02T16:45:12.316687+0000","last_became_peered":"2024-06-02T16:45:12.316687+0000","last_unstale":"2024-06-02T16:45:12.317831+0000","last_undegraded":"2024-06-02T16:45:12.317831+0000","last_fullsized":"2024-06-02T16:45:12.317831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:38.904127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.327902+0000","last_change":"2024-06-02T16:45:11.279941+0000","last_active":"2024-06-02T16:45:12.327902+0000","last_peered":"2024-06-02T16:45:12.327902+0000","last_clean":"2024-06-02T16:45:12.327902+0000","last_became_active":"2024-06-02T16:45:11.279600+0000","last_became_peered":"2024-06-02T16:45:11.279600+0000","last_unstale":"2024-06-02T16:45:12.327902+0000","last_undegraded":"2024-06-02T16:45:12.327902+0000","last_fullsized":"2024-06-02T16:45:12.327902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:05:50.798003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402942+0000","last_change":"2024-06-02T16:45:12.311936+0000","last_active":"2024-06-02T16:45:14.402942+0000","last_peered":"2024-06-02T16:45:14.402942+0000","last_clean":"2024-06-02T16:45:14.402942+0000","last_became_active":"2024-06-02T16:45:12.311644+0000","last_became_peered":"2024-06-02T16:45:12.311644+0000","last_unstale":"2024-06-02T16:45:14.402942+0000","last_undegraded":"2024-06-02T16:45:14.402942+0000","last_fullsized":"2024-06-02T16:45:14.402942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325811+0000","last_change":"2024-06-02T16:45:11.273910+0000","last_active":"2024-06-02T16:45:13.325811+0000","last_peered":"2024-06-02T16:45:13.325811+0000","last_clean":"2024-06-02T16:45:13.325811+0000","last_became_active":"2024-06-02T16:45:11.269349+0000","last_became_peered":"2024-06-02T16:45:11.269349+0000","last_unstale":"2024-06-02T16:45:13.325811+0000","last_undegraded":"2024-06-02T16:45:13.325811+0000","last_fullsized":"2024-06-02T16:45:13.325811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996048+0000","last_change":"2024-06-02T16:45:12.309869+0000","last_active":"2024-06-02T16:45:13.996048+0000","last_peered":"2024-06-02T16:45:13.996048+0000","last_clean":"2024-06-02T16:45:13.996048+0000","last_became_active":"2024-06-02T16:45:12.309531+0000","last_became_peered":"2024-06-02T16:45:12.309531+0000","last_unstale":"2024-06-02T16:45:13.996048+0000","last_undegraded":"2024-06-02T16:45:13.996048+0000","last_fullsized":"2024-06-02T16:45:13.996048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.329485+0000","last_change":"2024-06-02T16:45:11.281999+0000","last_active":"2024-06-02T16:45:12.329485+0000","last_peered":"2024-06-02T16:45:12.329485+0000","last_clean":"2024-06-02T16:45:12.329485+0000","last_became_active":"2024-06-02T16:45:11.281659+0000","last_became_peered":"2024-06-02T16:45:11.281659+0000","last_unstale":"2024-06-02T16:45:12.329485+0000","last_undegraded":"2024-06-02T16:45:12.329485+0000","last_fullsized":"2024-06-02T16:45:12.329485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:42:40.894276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.302874+0000","last_change":"2024-06-02T16:45:12.300160+0000","last_active":"2024-06-02T16:45:12.302874+0000","last_peered":"2024-06-02T16:45:12.302874+0000","last_clean":"2024-06-02T16:45:12.302874+0000","last_became_active":"2024-06-02T16:45:12.299866+0000","last_became_peered":"2024-06-02T16:45:12.299866+0000","last_unstale":"2024-06-02T16:45:12.302874+0000","last_undegraded":"2024-06-02T16:45:12.302874+0000","last_fullsized":"2024-06-02T16:45:12.302874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402682+0000","last_change":"2024-06-02T16:45:11.275912+0000","last_active":"2024-06-02T16:45:14.402682+0000","last_peered":"2024-06-02T16:45:14.402682+0000","last_clean":"2024-06-02T16:45:14.402682+0000","last_became_active":"2024-06-02T16:45:11.274344+0000","last_became_peered":"2024-06-02T16:45:11.274344+0000","last_unstale":"2024-06-02T16:45:14.402682+0000","last_undegraded":"2024-06-02T16:45:14.402682+0000","last_fullsized":"2024-06-02T16:45:14.402682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996045+0000","last_change":"2024-06-02T16:45:12.305113+0000","last_active":"2024-06-02T16:45:13.996045+0000","last_peered":"2024-06-02T16:45:13.996045+0000","last_clean":"2024-06-02T16:45:13.996045+0000","last_became_active":"2024-06-02T16:45:12.303754+0000","last_became_peered":"2024-06-02T16:45:12.303754+0000","last_unstale":"2024-06-02T16:45:13.996045+0000","last_undegraded":"2024-06-02T16:45:13.996045+0000","last_fullsized":"2024-06-02T16:45:13.996045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325343+0000","last_change":"2024-06-02T16:45:11.282207+0000","last_active":"2024-06-02T16:45:13.325343+0000","last_peered":"2024-06-02T16:45:13.325343+0000","last_clean":"2024-06-02T16:45:13.325343+0000","last_became_active":"2024-06-02T16:45:11.281896+0000","last_became_peered":"2024-06-02T16:45:11.281896+0000","last_unstale":"2024-06-02T16:45:13.325343+0000","last_undegraded":"2024-06-02T16:45:13.325343+0000","last_fullsized":"2024-06-02T16:45:13.325343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325428+0000","last_change":"2024-06-02T16:45:12.296800+0000","last_active":"2024-06-02T16:45:13.325428+0000","last_peered":"2024-06-02T16:45:13.325428+0000","last_clean":"2024-06-02T16:45:13.325428+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325428+0000","last_undegraded":"2024-06-02T16:45:13.325428+0000","last_fullsized":"2024-06-02T16:45:13.325428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296330+0000","last_change":"2024-06-02T16:45:11.266200+0000","last_active":"2024-06-02T16:45:13.296330+0000","last_peered":"2024-06-02T16:45:13.296330+0000","last_clean":"2024-06-02T16:45:13.296330+0000","last_became_active":"2024-06-02T16:45:11.265898+0000","last_became_peered":"2024-06-02T16:45:11.265898+0000","last_unstale":"2024-06-02T16:45:13.296330+0000","last_undegraded":"2024-06-02T16:45:13.296330+0000","last_fullsized":"2024-06-02T16:45:13.296330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995641+0000","last_change":"2024-06-02T16:45:12.306797+0000","last_active":"2024-06-02T16:45:13.995641+0000","last_peered":"2024-06-02T16:45:13.995641+0000","last_clean":"2024-06-02T16:45:13.995641+0000","last_became_active":"2024-06-02T16:45:12.306438+0000","last_became_peered":"2024-06-02T16:45:12.306438+0000","last_unstale":"2024-06-02T16:45:13.995641+0000","last_undegraded":"2024-06-02T16:45:13.995641+0000","last_fullsized":"2024-06-02T16:45:13.995641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402003+0000","last_change":"2024-06-02T16:45:11.281764+0000","last_active":"2024-06-02T16:45:14.402003+0000","last_peered":"2024-06-02T16:45:14.402003+0000","last_clean":"2024-06-02T16:45:14.402003+0000","last_became_active":"2024-06-02T16:45:11.281487+0000","last_became_peered":"2024-06-02T16:45:11.281487+0000","last_unstale":"2024-06-02T16:45:14.402003+0000","last_undegraded":"2024-06-02T16:45:14.402003+0000","last_fullsized":"2024-06-02T16:45:14.402003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:00.859465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996452+0000","last_change":"2024-06-02T16:45:12.303257+0000","last_active":"2024-06-02T16:45:13.996452+0000","last_peered":"2024-06-02T16:45:13.996452+0000","last_clean":"2024-06-02T16:45:13.996452+0000","last_became_active":"2024-06-02T16:45:12.302846+0000","last_became_peered":"2024-06-02T16:45:12.302846+0000","last_unstale":"2024-06-02T16:45:13.996452+0000","last_undegraded":"2024-06-02T16:45:13.996452+0000","last_fullsized":"2024-06-02T16:45:13.996452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297861+0000","last_change":"2024-06-02T16:45:11.265071+0000","last_active":"2024-06-02T16:45:13.297861+0000","last_peered":"2024-06-02T16:45:13.297861+0000","last_clean":"2024-06-02T16:45:13.297861+0000","last_became_active":"2024-06-02T16:45:11.264782+0000","last_became_peered":"2024-06-02T16:45:11.264782+0000","last_unstale":"2024-06-02T16:45:13.297861+0000","last_undegraded":"2024-06-02T16:45:13.297861+0000","last_fullsized":"2024-06-02T16:45:13.297861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996903+0000","last_change":"2024-06-02T16:45:12.308045+0000","last_active":"2024-06-02T16:45:13.996903+0000","last_peered":"2024-06-02T16:45:13.996903+0000","last_clean":"2024-06-02T16:45:13.996903+0000","last_became_active":"2024-06-02T16:45:12.307750+0000","last_became_peered":"2024-06-02T16:45:12.307750+0000","last_unstale":"2024-06-02T16:45:13.996903+0000","last_undegraded":"2024-06-02T16:45:13.996903+0000","last_fullsized":"2024-06-02T16:45:13.996903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:24.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.326083+0000","last_change":"2024-06-02T16:45:11.279209+0000","last_active":"2024-06-02T16:45:12.326083+0000","last_peered":"2024-06-02T16:45:12.326083+0000","last_clean":"2024-06-02T16:45:12.326083+0000","last_became_active":"2024-06-02T16:45:11.278908+0000","last_became_peered":"2024-06-02T16:45:11.278908+0000","last_unstale":"2024-06-02T16:45:12.326083+0000","last_undegraded":"2024-06-02T16:45:12.326083+0000","last_fullsized":"2024-06-02T16:45:12.326083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:26:48.069333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403037+0000","last_change":"2024-06-02T16:45:12.309555+0000","last_active":"2024-06-02T16:45:14.403037+0000","last_peered":"2024-06-02T16:45:14.403037+0000","last_clean":"2024-06-02T16:45:14.403037+0000","last_became_active":"2024-06-02T16:45:12.309069+0000","last_became_peered":"2024-06-02T16:45:12.309069+0000","last_unstale":"2024-06-02T16:45:14.403037+0000","last_undegraded":"2024-06-02T16:45:14.403037+0000","last_fullsized":"2024-06-02T16:45:14.403037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297157+0000","last_change":"2024-06-02T16:45:11.275392+0000","last_active":"2024-06-02T16:45:13.297157+0000","last_peered":"2024-06-02T16:45:13.297157+0000","last_clean":"2024-06-02T16:45:13.297157+0000","last_became_active":"2024-06-02T16:45:11.274685+0000","last_became_peered":"2024-06-02T16:45:11.274685+0000","last_unstale":"2024-06-02T16:45:13.297157+0000","last_undegraded":"2024-06-02T16:45:13.297157+0000","last_fullsized":"2024-06-02T16:45:13.297157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996381+0000","last_change":"2024-06-02T16:45:12.317046+0000","last_active":"2024-06-02T16:45:13.996381+0000","last_peered":"2024-06-02T16:45:13.996381+0000","last_clean":"2024-06-02T16:45:13.996381+0000","last_became_active":"2024-06-02T16:45:12.316726+0000","last_became_peered":"2024-06-02T16:45:12.316726+0000","last_unstale":"2024-06-02T16:45:13.996381+0000","last_undegraded":"2024-06-02T16:45:13.996381+0000","last_fullsized":"2024-06-02T16:45:13.996381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995299+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:45:13.995299+0000","last_peered":"2024-06-02T16:45:13.995299+0000","last_clean":"2024-06-02T16:45:13.995299+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:45:13.995299+0000","last_undegraded":"2024-06-02T16:45:13.995299+0000","last_fullsized":"2024-06-02T16:45:13.995299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401851+0000","last_change":"2024-06-02T16:45:11.275427+0000","last_active":"2024-06-02T16:45:14.401851+0000","last_peered":"2024-06-02T16:45:14.401851+0000","last_clean":"2024-06-02T16:45:14.401851+0000","last_became_active":"2024-06-02T16:45:11.275105+0000","last_became_peered":"2024-06-02T16:45:11.275105+0000","last_unstale":"2024-06-02T16:45:14.401851+0000","last_undegraded":"2024-06-02T16:45:14.401851+0000","last_fullsized":"2024-06-02T16:45:14.401851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297782+0000","last_change":"2024-06-02T16:45:12.315916+0000","last_active":"2024-06-02T16:45:13.297782+0000","last_peered":"2024-06-02T16:45:13.297782+0000","last_clean":"2024-06-02T16:45:13.297782+0000","last_became_active":"2024-06-02T16:45:12.315576+0000","last_became_peered":"2024-06-02T16:45:12.315576+0000","last_unstale":"2024-06-02T16:45:13.297782+0000","last_undegraded":"2024-06-02T16:45:13.297782+0000","last_fullsized":"2024-06-02T16:45:13.297782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995143+0000","last_change":"2024-06-02T16:45:11.284136+0000","last_active":"2024-06-02T16:45:13.995143+0000","last_peered":"2024-06-02T16:45:13.995143+0000","last_clean":"2024-06-02T16:45:13.995143+0000","last_became_active":"2024-06-02T16:45:11.283636+0000","last_became_peered":"2024-06-02T16:45:11.283636+0000","last_unstale":"2024-06-02T16:45:13.995143+0000","last_undegraded":"2024-06-02T16:45:13.995143+0000","last_fullsized":"2024-06-02T16:45:13.995143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.300847+0000","last_change":"2024-06-02T16:45:12.297552+0000","last_active":"2024-06-02T16:45:12.300847+0000","last_peered":"2024-06-02T16:45:12.300847+0000","last_clean":"2024-06-02T16:45:12.300847+0000","last_became_active":"2024-06-02T16:45:12.297284+0000","last_became_peered":"2024-06-02T16:45:12.297284+0000","last_unstale":"2024-06-02T16:45:12.300847+0000","last_undegraded":"2024-06-02T16:45:12.300847+0000","last_fullsized":"2024-06-02T16:45:12.300847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:14.424486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296544+0000","last_change":"2024-06-02T16:45:11.263835+0000","last_active":"2024-06-02T16:45:13.296544+0000","last_peered":"2024-06-02T16:45:13.296544+0000","last_clean":"2024-06-02T16:45:13.296544+0000","last_became_active":"2024-06-02T16:45:11.261012+0000","last_became_peered":"2024-06-02T16:45:11.261012+0000","last_unstale":"2024-06-02T16:45:13.296544+0000","last_undegraded":"2024-06-02T16:45:13.296544+0000","last_fullsized":"2024-06-02T16:45:13.296544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298711+0000","last_change":"2024-06-02T16:45:12.293349+0000","last_active":"2024-06-02T16:45:12.298711+0000","last_peered":"2024-06-02T16:45:12.298711+0000","last_clean":"2024-06-02T16:45:12.298711+0000","last_became_active":"2024-06-02T16:45:12.292988+0000","last_became_peered":"2024-06-02T16:45:12.292988+0000","last_unstale":"2024-06-02T16:45:12.298711+0000","last_undegraded":"2024-06-02T16:45:12.298711+0000","last_fullsized":"2024-06-02T16:45:12.298711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:43:05.763638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402866+0000","last_change":"2024-06-02T16:45:11.275239+0000","last_active":"2024-06-02T16:45:14.402866+0000","last_peered":"2024-06-02T16:45:14.402866+0000","last_clean":"2024-06-02T16:45:14.402866+0000","last_became_active":"2024-06-02T16:45:11.274878+0000","last_became_peered":"2024-06-02T16:45:11.274878+0000","last_unstale":"2024-06-02T16:45:14.402866+0000","last_undegraded":"2024-06-02T16:45:14.402866+0000","last_fullsized":"2024-06-02T16:45:14.402866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402084+0000","last_change":"2024-06-02T16:45:12.299815+0000","last_active":"2024-06-02T16:45:14.402084+0000","last_peered":"2024-06-02T16:45:14.402084+0000","last_clean":"2024-06-02T16:45:14.402084+0000","last_became_active":"2024-06-02T16:45:12.299416+0000","last_became_peered":"2024-06-02T16:45:12.299416+0000","last_unstale":"2024-06-02T16:45:14.402084+0000","last_undegraded":"2024-06-02T16:45:14.402084+0000","last_fullsized":"2024-06-02T16:45:14.402084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.268073+0000","last_change":"2024-06-02T16:45:11.272338+0000","last_active":"2024-06-02T16:45:12.268073+0000","last_peered":"2024-06-02T16:45:12.268073+0000","last_clean":"2024-06-02T16:45:12.268073+0000","last_became_active":"2024-06-02T16:45:11.271994+0000","last_became_peered":"2024-06-02T16:45:11.271994+0000","last_unstale":"2024-06-02T16:45:12.268073+0000","last_undegraded":"2024-06-02T16:45:12.268073+0000","last_fullsized":"2024-06-02T16:45:12.268073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:01.110485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403530+0000","last_change":"2024-06-02T16:45:12.314530+0000","last_active":"2024-06-02T16:45:14.403530+0000","last_peered":"2024-06-02T16:45:14.403530+0000","last_clean":"2024-06-02T16:45:14.403530+0000","last_became_active":"2024-06-02T16:45:12.309275+0000","last_became_peered":"2024-06-02T16:45:12.309275+0000","last_unstale":"2024-06-02T16:45:14.403530+0000","last_undegraded":"2024-06-02T16:45:14.403530+0000","last_fullsized":"2024-06-02T16:45:14.403530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996654+0000","last_change":"2024-06-02T16:45:11.286614+0000","last_active":"2024-06-02T16:45:13.996654+0000","last_peered":"2024-06-02T16:45:13.996654+0000","last_clean":"2024-06-02T16:45:13.996654+0000","last_became_active":"2024-06-02T16:45:11.286270+0000","last_became_peered":"2024-06-02T16:45:11.286270+0000","last_unstale":"2024-06-02T16:45:13.996654+0000","last_undegraded":"2024-06-02T16:45:13.996654+0000","last_fullsized":"2024-06-02T16:45:13.996654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:34.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.300532+0000","last_change":"2024-06-02T16:45:12.297417+0000","last_active":"2024-06-02T16:45:12.300532+0000","last_peered":"2024-06-02T16:45:12.300532+0000","last_clean":"2024-06-02T16:45:12.300532+0000","last_became_active":"2024-06-02T16:45:12.295971+0000","last_became_peered":"2024-06-02T16:45:12.295971+0000","last_unstale":"2024-06-02T16:45:12.300532+0000","last_undegraded":"2024-06-02T16:45:12.300532+0000","last_fullsized":"2024-06-02T16:45:12.300532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:35:19.393828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.268141+0000","last_change":"2024-06-02T16:45:11.276872+0000","last_active":"2024-06-02T16:45:12.268141+0000","last_peered":"2024-06-02T16:45:12.268141+0000","last_clean":"2024-06-02T16:45:12.268141+0000","last_became_active":"2024-06-02T16:45:11.276659+0000","last_became_peered":"2024-06-02T16:45:11.276659+0000","last_unstale":"2024-06-02T16:45:12.268141+0000","last_undegraded":"2024-06-02T16:45:12.268141+0000","last_fullsized":"2024-06-02T16:45:12.268141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:35.798870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.299014+0000","last_change":"2024-06-02T16:45:12.309798+0000","last_active":"2024-06-02T16:45:13.299014+0000","last_peered":"2024-06-02T16:45:13.299014+0000","last_clean":"2024-06-02T16:45:13.299014+0000","last_became_active":"2024-06-02T16:45:12.309229+0000","last_became_peered":"2024-06-02T16:45:12.309229+0000","last_unstale":"2024-06-02T16:45:13.299014+0000","last_undegraded":"2024-06-02T16:45:13.299014+0000","last_fullsized":"2024-06-02T16:45:13.299014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325726+0000","last_change":"2024-06-02T16:45:11.284796+0000","last_active":"2024-06-02T16:45:13.325726+0000","last_peered":"2024-06-02T16:45:13.325726+0000","last_clean":"2024-06-02T16:45:13.325726+0000","last_became_active":"2024-06-02T16:45:11.284453+0000","last_became_peered":"2024-06-02T16:45:11.284453+0000","last_unstale":"2024-06-02T16:45:13.325726+0000","last_undegraded":"2024-06-02T16:45:13.325726+0000","last_fullsized":"2024-06-02T16:45:13.325726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.301961+0000","last_change":"2024-06-02T16:45:12.295217+0000","last_active":"2024-06-02T16:45:12.301961+0000","last_peered":"2024-06-02T16:45:12.301961+0000","last_clean":"2024-06-02T16:45:12.301961+0000","last_became_active":"2024-06-02T16:45:12.294918+0000","last_became_peered":"2024-06-02T16:45:12.294918+0000","last_unstale":"2024-06-02T16:45:12.301961+0000","last_undegraded":"2024-06-02T16:45:12.301961+0000","last_fullsized":"2024-06-02T16:45:12.301961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:40.403924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995110+0000","last_change":"2024-06-02T16:45:11.283792+0000","last_active":"2024-06-02T16:45:13.995110+0000","last_peered":"2024-06-02T16:45:13.995110+0000","last_clean":"2024-06-02T16:45:13.995110+0000","last_became_active":"2024-06-02T16:45:11.283275+0000","last_became_peered":"2024-06-02T16:45:11.283275+0000","last_unstale":"2024-06-02T16:45:13.995110+0000","last_undegraded":"2024-06-02T16:45:13.995110+0000","last_fullsized":"2024-06-02T16:45:13.995110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:37.892243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402663+0000","last_change":"2024-06-02T16:45:12.297797+0000","last_active":"2024-06-02T16:45:14.402663+0000","last_peered":"2024-06-02T16:45:14.402663+0000","last_clean":"2024-06-02T16:45:14.402663+0000","last_became_active":"2024-06-02T16:45:12.297359+0000","last_became_peered":"2024-06-02T16:45:12.297359+0000","last_unstale":"2024-06-02T16:45:14.402663+0000","last_undegraded":"2024-06-02T16:45:14.402663+0000","last_fullsized":"2024-06-02T16:45:14.402663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.267427+0000","last_change":"2024-06-02T16:45:11.278360+0000","last_active":"2024-06-02T16:45:12.267427+0000","last_peered":"2024-06-02T16:45:12.267427+0000","last_clean":"2024-06-02T16:45:12.267427+0000","last_became_active":"2024-06-02T16:45:11.277862+0000","last_became_peered":"2024-06-02T16:45:11.277862+0000","last_unstale":"2024-06-02T16:45:12.267427+0000","last_undegraded":"2024-06-02T16:45:12.267427+0000","last_fullsized":"2024-06-02T16:45:12.267427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:41:22.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296880+0000","last_change":"2024-06-02T16:45:12.306004+0000","last_active":"2024-06-02T16:45:13.296880+0000","last_peered":"2024-06-02T16:45:13.296880+0000","last_clean":"2024-06-02T16:45:13.296880+0000","last_became_active":"2024-06-02T16:45:12.305698+0000","last_became_peered":"2024-06-02T16:45:12.305698+0000","last_unstale":"2024-06-02T16:45:13.296880+0000","last_undegraded":"2024-06-02T16:45:13.296880+0000","last_fullsized":"2024-06-02T16:45:13.296880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.267784+0000","last_change":"2024-06-02T16:45:11.270577+0000","last_active":"2024-06-02T16:45:12.267784+0000","last_peered":"2024-06-02T16:45:12.267784+0000","last_clean":"2024-06-02T16:45:12.267784+0000","last_became_active":"2024-06-02T16:45:11.270316+0000","last_became_peered":"2024-06-02T16:45:11.270316+0000","last_unstale":"2024-06-02T16:45:12.267784+0000","last_undegraded":"2024-06-02T16:45:12.267784+0000","last_fullsized":"2024-06-02T16:45:12.267784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:49.398066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297767+0000","last_change":"2024-06-02T16:45:12.306883+0000","last_active":"2024-06-02T16:45:13.297767+0000","last_peered":"2024-06-02T16:45:13.297767+0000","last_clean":"2024-06-02T16:45:13.297767+0000","last_became_active":"2024-06-02T16:45:12.306582+0000","last_became_peered":"2024-06-02T16:45:12.306582+0000","last_unstale":"2024-06-02T16:45:13.297767+0000","last_undegraded":"2024-06-02T16:45:13.297767+0000","last_fullsized":"2024-06-02T16:45:13.297767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996343+0000","last_change":"2024-06-02T16:45:11.288038+0000","last_active":"2024-06-02T16:45:13.996343+0000","last_peered":"2024-06-02T16:45:13.996343+0000","last_clean":"2024-06-02T16:45:13.996343+0000","last_became_active":"2024-06-02T16:45:11.287757+0000","last_became_peered":"2024-06-02T16:45:11.287757+0000","last_unstale":"2024-06-02T16:45:13.996343+0000","last_undegraded":"2024-06-02T16:45:13.996343+0000","last_fullsized":"2024-06-02T16:45:13.996343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325212+0000","last_change":"2024-06-02T16:45:12.298140+0000","last_active":"2024-06-02T16:45:13.325212+0000","last_peered":"2024-06-02T16:45:13.325212+0000","last_clean":"2024-06-02T16:45:13.325212+0000","last_became_active":"2024-06-02T16:45:12.297832+0000","last_became_peered":"2024-06-02T16:45:12.297832+0000","last_unstale":"2024-06-02T16:45:13.325212+0000","last_undegraded":"2024-06-02T16:45:13.325212+0000","last_fullsized":"2024-06-02T16:45:13.325212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403511+0000","last_change":"2024-06-02T16:45:12.302894+0000","last_active":"2024-06-02T16:45:14.403511+0000","last_peered":"2024-06-02T16:45:14.403511+0000","last_clean":"2024-06-02T16:45:14.403511+0000","last_became_active":"2024-06-02T16:45:12.302609+0000","last_became_peered":"2024-06-02T16:45:12.302609+0000","last_unstale":"2024-06-02T16:45:14.403511+0000","last_undegraded":"2024-06-02T16:45:14.403511+0000","last_fullsized":"2024-06-02T16:45:14.403511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995933+0000","last_change":"2024-06-02T16:45:11.286611+0000","last_active":"2024-06-02T16:45:13.995933+0000","last_peered":"2024-06-02T16:45:13.995933+0000","last_clean":"2024-06-02T16:45:13.995933+0000","last_became_active":"2024-06-02T16:45:11.286294+0000","last_became_peered":"2024-06-02T16:45:11.286294+0000","last_unstale":"2024-06-02T16:45:13.995933+0000","last_undegraded":"2024-06-02T16:45:13.995933+0000","last_fullsized":"2024-06-02T16:45:13.995933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:07.092809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402591+0000","last_change":"2024-06-02T16:45:12.302182+0000","last_active":"2024-06-02T16:45:14.402591+0000","last_peered":"2024-06-02T16:45:14.402591+0000","last_clean":"2024-06-02T16:45:14.402591+0000","last_became_active":"2024-06-02T16:45:12.301903+0000","last_became_peered":"2024-06-02T16:45:12.301903+0000","last_unstale":"2024-06-02T16:45:14.402591+0000","last_undegraded":"2024-06-02T16:45:14.402591+0000","last_fullsized":"2024-06-02T16:45:14.402591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996321+0000","last_change":"2024-06-02T16:45:11.286446+0000","last_active":"2024-06-02T16:45:13.996321+0000","last_peered":"2024-06-02T16:45:13.996321+0000","last_clean":"2024-06-02T16:45:13.996321+0000","last_became_active":"2024-06-02T16:45:11.286095+0000","last_became_peered":"2024-06-02T16:45:11.286095+0000","last_unstale":"2024-06-02T16:45:13.996321+0000","last_undegraded":"2024-06-02T16:45:13.996321+0000","last_fullsized":"2024-06-02T16:45:13.996321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:28.668240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.311987+0000","last_change":"2024-06-02T16:45:12.309888+0000","last_active":"2024-06-02T16:45:12.311987+0000","last_peered":"2024-06-02T16:45:12.311987+0000","last_clean":"2024-06-02T16:45:12.311987+0000","last_became_active":"2024-06-02T16:45:12.309638+0000","last_became_peered":"2024-06-02T16:45:12.309638+0000","last_unstale":"2024-06-02T16:45:12.311987+0000","last_undegraded":"2024-06-02T16:45:12.311987+0000","last_fullsized":"2024-06-02T16:45:12.311987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298853+0000","last_change":"2024-06-02T16:45:11.271444+0000","last_active":"2024-06-02T16:45:13.298853+0000","last_peered":"2024-06-02T16:45:13.298853+0000","last_clean":"2024-06-02T16:45:13.298853+0000","last_became_active":"2024-06-02T16:45:11.271168+0000","last_became_peered":"2024-06-02T16:45:11.271168+0000","last_unstale":"2024-06-02T16:45:13.298853+0000","last_undegraded":"2024-06-02T16:45:13.298853+0000","last_fullsized":"2024-06-02T16:45:13.298853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:40.375189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298807+0000","last_change":"2024-06-02T16:45:12.303300+0000","last_active":"2024-06-02T16:45:13.298807+0000","last_peered":"2024-06-02T16:45:13.298807+0000","last_clean":"2024-06-02T16:45:13.298807+0000","last_became_active":"2024-06-02T16:45:12.303009+0000","last_became_peered":"2024-06-02T16:45:12.303009+0000","last_unstale":"2024-06-02T16:45:13.298807+0000","last_undegraded":"2024-06-02T16:45:13.298807+0000","last_fullsized":"2024-06-02T16:45:13.298807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.329788+0000","last_change":"2024-06-02T16:45:11.285228+0000","last_active":"2024-06-02T16:45:12.329788+0000","last_peered":"2024-06-02T16:45:12.329788+0000","last_clean":"2024-06-02T16:45:12.329788+0000","last_became_active":"2024-06-02T16:45:11.284770+0000","last_became_peered":"2024-06-02T16:45:11.284770+0000","last_unstale":"2024-06-02T16:45:12.329788+0000","last_undegraded":"2024-06-02T16:45:12.329788+0000","last_fullsized":"2024-06-02T16:45:12.329788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":670785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476740,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":823296,"data_stored":664541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":73535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:45:16.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:45:17.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.049+0000 7f974d200640 1 Processor -- start 2024-06-02T16:45:17.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.050+0000 7f974d200640 1 -- start start 2024-06-02T16:45:17.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f974d200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f97480d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f974d200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97480d0f70 con 0x7f97480d5f10 2024-06-02T16:45:17.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f974d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97480d6350 con 0x7f974815f6f0 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f974d200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f97480d1230 con 0x7f97480d0ae0 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f9745400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97480d5f10 0x7f97480d3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51790/0 (socket says 172.21.15.52:51790) 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.051+0000 7f9745400640 1 -- 172.21.15.52:0/2715171606 learned_addr learned my addr 172.21.15.52:0/2715171606 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9746800640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f97480d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423516308 0 0) 0x7f97480d0f70 con 0x7f97480d5f10 2024-06-02T16:45:17.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f972c003520 con 0x7f97480d5f10 2024-06-02T16:45:17.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469644003 0 0) 0x7f972c003520 con 0x7f97480d5f10 2024-06-02T16:45:17.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 msgr2=0x7f97480d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:17.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f97480d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 >> v1:172.21.15.114:6789/0 conn(0x7f974815f6f0 legacy=0x7f974806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97480d31a0 con 0x7f97480d5f10 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f97340016f0 con 0x7f97480d5f10 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 >> v1:172.21.15.52:6789/0 conn(0x7f97480d5f10 legacy=0x7f97480d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f972c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.052+0000 7f9744a00640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c003f70 0x7f972c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9744a00640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f972c004d40 0x7f972c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97480d1230 con 0x7f972c004d40 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f972c00bad0 con 0x7f972c003f70 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f972c00bcd0 con 0x7f97480d0ae0 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f972c004d40 0x7f972c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9745400640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c003f70 0x7f972c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9745e00640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f972c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 -- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 msgr2=0x7f972c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480d0ae0 0x7f972c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 -- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c003f70 msgr2=0x7f972c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c003f70 0x7f972c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.053+0000 7f9746800640 1 -- 172.21.15.52:0/2715171606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c003520 con 0x7f972c004d40 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.054+0000 7f9746800640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f972c004d40 0x7f972c0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9740009f90 tx=0x7f972c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cf359c58559e38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740009c10 con 0x7f972c004d40 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9740036070 con 0x7f972c004d40 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f9744a00640 1 -- 172.21.15.52:0/2715171606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740031850 con 0x7f972c004d40 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 -- 172.21.15.52:0/2715171606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f972c004d40 msgr2=0x7f972c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 --2- 172.21.15.52:0/2715171606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f972c004d40 0x7f972c0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9740009f90 tx=0x7f972c005830 comp rx=0 tx=0).stop 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f9746800640 1 -- 172.21.15.52:0/2715171606 reap_dead start 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 -- 172.21.15.52:0/2715171606 shutdown_connections 2024-06-02T16:45:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 -- 172.21.15.52:0/2715171606 >> 172.21.15.52:0/2715171606 conn(0x7f974808cf50 msgr2=0x7f97480d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 -- 172.21.15.52:0/2715171606 shutdown_connections 2024-06-02T16:45:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.055+0000 7f974d200640 1 -- 172.21.15.52:0/2715171606 wait complete. 2024-06-02T16:45:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.057+0000 7f974d200640 1 Processor -- start 2024-06-02T16:45:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.057+0000 7f974d200640 1 -- start start 2024-06-02T16:45:17.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 0x7f97481f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 0x7f9748158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f974806d940 con 0x7f97480ce560 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97480d3760 con 0x7f972c004d40 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f974d200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f974806dac0 con 0x7f97480cc520 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.058+0000 7f9746800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52870/0 (socket says 172.21.15.52:52870) 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 -- 172.21.15.52:0/924163602 learned_addr learned my addr 172.21.15.52:0/924163602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9745e00640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 0x7f97481f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9745400640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 0x7f9748158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 -- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 msgr2=0x7f9748158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 0x7f9748158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 -- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 msgr2=0x7f97481f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 0x7f97481f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 -- 172.21.15.52:0/924163602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97480cf3a0 con 0x7f97480ce560 2024-06-02T16:45:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9745e00640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 0x7f97481f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9745400640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 0x7f9748158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.059+0000 7f9746800640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9740033040 tx=0x7f9740009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.060+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740009c10 con 0x7f97480ce560 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.060+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9740003990 con 0x7f97480ce560 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.060+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740003d80 con 0x7f97480ce560 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.060+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97480cca70 con 0x7f97480ce560 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.060+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97480cd030 con 0x7f97480ce560 2024-06-02T16:45:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.061+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9748069520 con 0x7f97480ce560 2024-06-02T16:45:17.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.062+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9740005d10 con 0x7f97480ce560 2024-06-02T16:45:17.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.063+0000 7f973e000640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 0x7f97280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.063+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f97400b8790 con 0x7f97480ce560 2024-06-02T16:45:17.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.064+0000 7f9745e00640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 0x7f97280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.065+0000 7f9745e00640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 0x7f97280787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97380011a0 tx=0x7f9738009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.070+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f974002e050 con 0x7f97480ce560 2024-06-02T16:45:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.283+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97480bb3d0 con 0x7f9728076320 2024-06-02T16:45:17.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.302+0000 7f973e000640 1 -- 172.21.15.52:0/924163602 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f97480bb3d0 con 0x7f9728076320 2024-06-02T16:45:17.304 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:17.306 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 msgr2=0x7f97280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 0x7f97280787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97380011a0 tx=0x7f9738009040 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 msgr2=0x7f97480ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9740033040 tx=0x7f9740009750 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 shutdown_connections 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9728076320 0x7f97280787e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97480ce560 0x7f97480ce9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97480cc520 0x7f9748158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 --2- 172.21.15.52:0/924163602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f972c004d40 0x7f97481f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 >> 172.21.15.52:0/924163602 conn(0x7f974808cf50 msgr2=0x7f97480b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 shutdown_connections 2024-06-02T16:45:17.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.308+0000 7f974d200640 1 -- 172.21.15.52:0/924163602 wait complete. 2024-06-02T16:45:17.327 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-06-02T16:45:15.993203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235780,"kb_used_data":2960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738940,"statfs":{"total":773094113280,"available":772852674560,"internally_reserved":0,"allocated":3031040,"data_stored":1798876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.758549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996517+0000","last_change":"2024-06-02T16:45:12.306743+0000","last_active":"2024-06-02T16:45:13.996517+0000","last_peered":"2024-06-02T16:45:13.996517+0000","last_clean":"2024-06-02T16:45:13.996517+0000","last_became_active":"2024-06-02T16:45:12.306440+0000","last_became_peered":"2024-06-02T16:45:12.306440+0000","last_unstale":"2024-06-02T16:45:13.996517+0000","last_undegraded":"2024-06-02T16:45:13.996517+0000","last_fullsized":"2024-06-02T16:45:13.996517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298670+0000","last_change":"2024-06-02T16:45:12.292683+0000","last_active":"2024-06-02T16:45:12.298670+0000","last_peered":"2024-06-02T16:45:12.298670+0000","last_clean":"2024-06-02T16:45:12.298670+0000","last_became_active":"2024-06-02T16:45:12.292372+0000","last_became_peered":"2024-06-02T16:45:12.292372+0000","last_unstale":"2024-06-02T16:45:12.298670+0000","last_undegraded":"2024-06-02T16:45:12.298670+0000","last_fullsized":"2024-06-02T16:45:12.298670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:40:21.138253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298572+0000","last_change":"2024-06-02T16:45:12.293718+0000","last_active":"2024-06-02T16:45:12.298572+0000","last_peered":"2024-06-02T16:45:12.298572+0000","last_clean":"2024-06-02T16:45:12.298572+0000","last_became_active":"2024-06-02T16:45:12.293430+0000","last_became_peered":"2024-06-02T16:45:12.293430+0000","last_unstale":"2024-06-02T16:45:12.298572+0000","last_undegraded":"2024-06-02T16:45:12.298572+0000","last_fullsized":"2024-06-02T16:45:12.298572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:41.387072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402594+0000","last_change":"2024-06-02T16:45:12.309651+0000","last_active":"2024-06-02T16:45:14.402594+0000","last_peered":"2024-06-02T16:45:14.402594+0000","last_clean":"2024-06-02T16:45:14.402594+0000","last_became_active":"2024-06-02T16:45:12.309314+0000","last_became_peered":"2024-06-02T16:45:12.309314+0000","last_unstale":"2024-06-02T16:45:14.402594+0000","last_undegraded":"2024-06-02T16:45:14.402594+0000","last_fullsized":"2024-06-02T16:45:14.402594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995876+0000","last_change":"2024-06-02T16:45:12.297519+0000","last_active":"2024-06-02T16:45:13.995876+0000","last_peered":"2024-06-02T16:45:13.995876+0000","last_clean":"2024-06-02T16:45:13.995876+0000","last_became_active":"2024-06-02T16:45:12.297239+0000","last_became_peered":"2024-06-02T16:45:12.297239+0000","last_unstale":"2024-06-02T16:45:13.995876+0000","last_undegraded":"2024-06-02T16:45:13.995876+0000","last_fullsized":"2024-06-02T16:45:13.995876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401349+0000","last_change":"2024-06-02T16:45:12.311245+0000","last_active":"2024-06-02T16:45:14.401349+0000","last_peered":"2024-06-02T16:45:14.401349+0000","last_clean":"2024-06-02T16:45:14.401349+0000","last_became_active":"2024-06-02T16:45:12.310210+0000","last_became_peered":"2024-06-02T16:45:12.310210+0000","last_unstale":"2024-06-02T16:45:14.401349+0000","last_undegraded":"2024-06-02T16:45:14.401349+0000","last_fullsized":"2024-06-02T16:45:14.401349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995424+0000","last_change":"2024-06-02T16:45:12.298527+0000","last_active":"2024-06-02T16:45:13.995424+0000","last_peered":"2024-06-02T16:45:13.995424+0000","last_clean":"2024-06-02T16:45:13.995424+0000","last_became_active":"2024-06-02T16:45:12.297923+0000","last_became_peered":"2024-06-02T16:45:12.297923+0000","last_unstale":"2024-06-02T16:45:13.995424+0000","last_undegraded":"2024-06-02T16:45:13.995424+0000","last_fullsized":"2024-06-02T16:45:13.995424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296562+0000","last_change":"2024-06-02T16:45:12.319083+0000","last_active":"2024-06-02T16:45:13.296562+0000","last_peered":"2024-06-02T16:45:13.296562+0000","last_clean":"2024-06-02T16:45:13.296562+0000","last_became_active":"2024-06-02T16:45:12.318762+0000","last_became_peered":"2024-06-02T16:45:12.318762+0000","last_unstale":"2024-06-02T16:45:13.296562+0000","last_undegraded":"2024-06-02T16:45:13.296562+0000","last_fullsized":"2024-06-02T16:45:13.296562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996683+0000","last_change":"2024-06-02T16:45:12.317753+0000","last_active":"2024-06-02T16:45:13.996683+0000","last_peered":"2024-06-02T16:45:13.996683+0000","last_clean":"2024-06-02T16:45:13.996683+0000","last_became_active":"2024-06-02T16:45:12.317416+0000","last_became_peered":"2024-06-02T16:45:12.317416+0000","last_unstale":"2024-06-02T16:45:13.996683+0000","last_undegraded":"2024-06-02T16:45:13.996683+0000","last_fullsized":"2024-06-02T16:45:13.996683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:31.192107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325971+0000","last_change":"2024-06-02T16:45:12.296816+0000","last_active":"2024-06-02T16:45:13.325971+0000","last_peered":"2024-06-02T16:45:13.325971+0000","last_clean":"2024-06-02T16:45:13.325971+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325971+0000","last_undegraded":"2024-06-02T16:45:13.325971+0000","last_fullsized":"2024-06-02T16:45:13.325971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325571+0000","last_change":"2024-06-02T16:45:12.304652+0000","last_active":"2024-06-02T16:45:13.325571+0000","last_peered":"2024-06-02T16:45:13.325571+0000","last_clean":"2024-06-02T16:45:13.325571+0000","last_became_active":"2024-06-02T16:45:12.304386+0000","last_became_peered":"2024-06-02T16:45:12.304386+0000","last_unstale":"2024-06-02T16:45:13.325571+0000","last_undegraded":"2024-06-02T16:45:13.325571+0000","last_fullsized":"2024-06-02T16:45:13.325571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402540+0000","last_change":"2024-06-02T16:45:12.305078+0000","last_active":"2024-06-02T16:45:14.402540+0000","last_peered":"2024-06-02T16:45:14.402540+0000","last_clean":"2024-06-02T16:45:14.402540+0000","last_became_active":"2024-06-02T16:45:12.304544+0000","last_became_peered":"2024-06-02T16:45:12.304544+0000","last_unstale":"2024-06-02T16:45:14.402540+0000","last_undegraded":"2024-06-02T16:45:14.402540+0000","last_fullsized":"2024-06-02T16:45:14.402540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297756+0000","last_change":"2024-06-02T16:45:12.308837+0000","last_active":"2024-06-02T16:45:13.297756+0000","last_peered":"2024-06-02T16:45:13.297756+0000","last_clean":"2024-06-02T16:45:13.297756+0000","last_became_active":"2024-06-02T16:45:12.307884+0000","last_became_peered":"2024-06-02T16:45:12.307884+0000","last_unstale":"2024-06-02T16:45:13.297756+0000","last_undegraded":"2024-06-02T16:45:13.297756+0000","last_fullsized":"2024-06-02T16:45:13.297756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.310097+0000","last_change":"2024-06-02T16:45:12.302741+0000","last_active":"2024-06-02T16:45:12.310097+0000","last_peered":"2024-06-02T16:45:12.310097+0000","last_clean":"2024-06-02T16:45:12.310097+0000","last_became_active":"2024-06-02T16:45:12.302448+0000","last_became_peered":"2024-06-02T16:45:12.302448+0000","last_unstale":"2024-06-02T16:45:12.310097+0000","last_undegraded":"2024-06-02T16:45:12.310097+0000","last_fullsized":"2024-06-02T16:45:12.310097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.304158+0000","last_change":"2024-06-02T16:45:12.298379+0000","last_active":"2024-06-02T16:45:12.304158+0000","last_peered":"2024-06-02T16:45:12.304158+0000","last_clean":"2024-06-02T16:45:12.304158+0000","last_became_active":"2024-06-02T16:45:12.297169+0000","last_became_peered":"2024-06-02T16:45:12.297169+0000","last_unstale":"2024-06-02T16:45:12.304158+0000","last_undegraded":"2024-06-02T16:45:12.304158+0000","last_fullsized":"2024-06-02T16:45:12.304158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:18.079887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400485+0000","last_change":"2024-06-02T16:45:12.313940+0000","last_active":"2024-06-02T16:45:14.400485+0000","last_peered":"2024-06-02T16:45:14.400485+0000","last_clean":"2024-06-02T16:45:14.400485+0000","last_became_active":"2024-06-02T16:45:12.313226+0000","last_became_peered":"2024-06-02T16:45:12.313226+0000","last_unstale":"2024-06-02T16:45:14.400485+0000","last_undegraded":"2024-06-02T16:45:14.400485+0000","last_fullsized":"2024-06-02T16:45:14.400485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403995+0000","last_change":"2024-06-02T16:45:12.312810+0000","last_active":"2024-06-02T16:45:14.403995+0000","last_peered":"2024-06-02T16:45:14.403995+0000","last_clean":"2024-06-02T16:45:14.403995+0000","last_became_active":"2024-06-02T16:45:12.312269+0000","last_became_peered":"2024-06-02T16:45:12.312269+0000","last_unstale":"2024-06-02T16:45:14.403995+0000","last_undegraded":"2024-06-02T16:45:14.403995+0000","last_fullsized":"2024-06-02T16:45:14.403995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297718+0000","last_change":"2024-06-02T16:45:12.304201+0000","last_active":"2024-06-02T16:45:13.297718+0000","last_peered":"2024-06-02T16:45:13.297718+0000","last_clean":"2024-06-02T16:45:13.297718+0000","last_became_active":"2024-06-02T16:45:12.303839+0000","last_became_peered":"2024-06-02T16:45:12.303839+0000","last_unstale":"2024-06-02T16:45:13.297718+0000","last_undegraded":"2024-06-02T16:45:13.297718+0000","last_fullsized":"2024-06-02T16:45:13.297718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996653+0000","last_change":"2024-06-02T16:45:12.300262+0000","last_active":"2024-06-02T16:45:13.996653+0000","last_peered":"2024-06-02T16:45:13.996653+0000","last_clean":"2024-06-02T16:45:13.996653+0000","last_became_active":"2024-06-02T16:45:12.299445+0000","last_became_peered":"2024-06-02T16:45:12.299445+0000","last_unstale":"2024-06-02T16:45:13.996653+0000","last_undegraded":"2024-06-02T16:45:13.996653+0000","last_fullsized":"2024-06-02T16:45:13.996653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:05.323209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325689+0000","last_change":"2024-06-02T16:45:12.303651+0000","last_active":"2024-06-02T16:45:13.325689+0000","last_peered":"2024-06-02T16:45:13.325689+0000","last_clean":"2024-06-02T16:45:13.325689+0000","last_became_active":"2024-06-02T16:45:12.301465+0000","last_became_peered":"2024-06-02T16:45:12.301465+0000","last_unstale":"2024-06-02T16:45:13.325689+0000","last_undegraded":"2024-06-02T16:45:13.325689+0000","last_fullsized":"2024-06-02T16:45:13.325689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.305661+0000","last_change":"2024-06-02T16:45:12.301175+0000","last_active":"2024-06-02T16:45:12.305661+0000","last_peered":"2024-06-02T16:45:12.305661+0000","last_clean":"2024-06-02T16:45:12.305661+0000","last_became_active":"2024-06-02T16:45:12.300384+0000","last_became_peered":"2024-06-02T16:45:12.300384+0000","last_unstale":"2024-06-02T16:45:12.305661+0000","last_undegraded":"2024-06-02T16:45:12.305661+0000","last_fullsized":"2024-06-02T16:45:12.305661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402228+0000","last_change":"2024-06-02T16:45:12.311520+0000","last_active":"2024-06-02T16:45:14.402228+0000","last_peered":"2024-06-02T16:45:14.402228+0000","last_clean":"2024-06-02T16:45:14.402228+0000","last_became_active":"2024-06-02T16:45:12.310653+0000","last_became_peered":"2024-06-02T16:45:12.310653+0000","last_unstale":"2024-06-02T16:45:14.402228+0000","last_undegraded":"2024-06-02T16:45:14.402228+0000","last_fullsized":"2024-06-02T16:45:14.402228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297205+0000","last_change":"2024-06-02T16:45:12.304397+0000","last_active":"2024-06-02T16:45:13.297205+0000","last_peered":"2024-06-02T16:45:13.297205+0000","last_clean":"2024-06-02T16:45:13.297205+0000","last_became_active":"2024-06-02T16:45:12.304107+0000","last_became_peered":"2024-06-02T16:45:12.304107+0000","last_unstale":"2024-06-02T16:45:13.297205+0000","last_undegraded":"2024-06-02T16:45:13.297205+0000","last_fullsized":"2024-06-02T16:45:13.297205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400682+0000","last_change":"2024-06-02T16:45:12.314155+0000","last_active":"2024-06-02T16:45:14.400682+0000","last_peered":"2024-06-02T16:45:14.400682+0000","last_clean":"2024-06-02T16:45:14.400682+0000","last_became_active":"2024-06-02T16:45:12.313644+0000","last_became_peered":"2024-06-02T16:45:12.313644+0000","last_unstale":"2024-06-02T16:45:14.400682+0000","last_undegraded":"2024-06-02T16:45:14.400682+0000","last_fullsized":"2024-06-02T16:45:14.400682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298924+0000","last_change":"2024-06-02T16:45:12.306290+0000","last_active":"2024-06-02T16:45:13.298924+0000","last_peered":"2024-06-02T16:45:13.298924+0000","last_clean":"2024-06-02T16:45:13.298924+0000","last_became_active":"2024-06-02T16:45:12.306055+0000","last_became_peered":"2024-06-02T16:45:12.306055+0000","last_unstale":"2024-06-02T16:45:13.298924+0000","last_undegraded":"2024-06-02T16:45:13.298924+0000","last_fullsized":"2024-06-02T16:45:13.298924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.326006+0000","last_change":"2024-06-02T16:45:12.303636+0000","last_active":"2024-06-02T16:45:13.326006+0000","last_peered":"2024-06-02T16:45:13.326006+0000","last_clean":"2024-06-02T16:45:13.326006+0000","last_became_active":"2024-06-02T16:45:12.302670+0000","last_became_peered":"2024-06-02T16:45:12.302670+0000","last_unstale":"2024-06-02T16:45:13.326006+0000","last_undegraded":"2024-06-02T16:45:13.326006+0000","last_fullsized":"2024-06-02T16:45:13.326006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.303888+0000","last_change":"2024-06-02T16:45:12.299670+0000","last_active":"2024-06-02T16:45:12.303888+0000","last_peered":"2024-06-02T16:45:12.303888+0000","last_clean":"2024-06-02T16:45:12.303888+0000","last_became_active":"2024-06-02T16:45:12.299052+0000","last_became_peered":"2024-06-02T16:45:12.299052+0000","last_unstale":"2024-06-02T16:45:12.303888+0000","last_undegraded":"2024-06-02T16:45:12.303888+0000","last_fullsized":"2024-06-02T16:45:12.303888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:22.230527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298514+0000","last_change":"2024-06-02T16:45:12.303422+0000","last_active":"2024-06-02T16:45:13.298514+0000","last_peered":"2024-06-02T16:45:13.298514+0000","last_clean":"2024-06-02T16:45:13.298514+0000","last_became_active":"2024-06-02T16:45:12.301580+0000","last_became_peered":"2024-06-02T16:45:12.301580+0000","last_unstale":"2024-06-02T16:45:13.298514+0000","last_undegraded":"2024-06-02T16:45:13.298514+0000","last_fullsized":"2024-06-02T16:45:13.298514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.312519+0000","last_change":"2024-06-02T16:45:12.310664+0000","last_active":"2024-06-02T16:45:12.312519+0000","last_peered":"2024-06-02T16:45:12.312519+0000","last_clean":"2024-06-02T16:45:12.312519+0000","last_became_active":"2024-06-02T16:45:12.310369+0000","last_became_peered":"2024-06-02T16:45:12.310369+0000","last_unstale":"2024-06-02T16:45:12.312519+0000","last_undegraded":"2024-06-02T16:45:12.312519+0000","last_fullsized":"2024-06-02T16:45:12.312519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402532+0000","last_change":"2024-06-02T16:45:12.310972+0000","last_active":"2024-06-02T16:45:14.402532+0000","last_peered":"2024-06-02T16:45:14.402532+0000","last_clean":"2024-06-02T16:45:14.402532+0000","last_became_active":"2024-06-02T16:45:12.309072+0000","last_became_peered":"2024-06-02T16:45:12.309072+0000","last_unstale":"2024-06-02T16:45:14.402532+0000","last_undegraded":"2024-06-02T16:45:14.402532+0000","last_fullsized":"2024-06-02T16:45:14.402532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296413+0000","last_change":"2024-06-02T16:45:12.319222+0000","last_active":"2024-06-02T16:45:13.296413+0000","last_peered":"2024-06-02T16:45:13.296413+0000","last_clean":"2024-06-02T16:45:13.296413+0000","last_became_active":"2024-06-02T16:45:12.318902+0000","last_became_peered":"2024-06-02T16:45:12.318902+0000","last_unstale":"2024-06-02T16:45:13.296413+0000","last_undegraded":"2024-06-02T16:45:13.296413+0000","last_fullsized":"2024-06-02T16:45:13.296413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325172+0000","last_change":"2024-06-02T16:45:12.293440+0000","last_active":"2024-06-02T16:45:13.325172+0000","last_peered":"2024-06-02T16:45:13.325172+0000","last_clean":"2024-06-02T16:45:13.325172+0000","last_became_active":"2024-06-02T16:45:12.293145+0000","last_became_peered":"2024-06-02T16:45:12.293145+0000","last_unstale":"2024-06-02T16:45:13.325172+0000","last_undegraded":"2024-06-02T16:45:13.325172+0000","last_fullsized":"2024-06-02T16:45:13.325172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401279+0000","last_change":"2024-06-02T16:45:12.302510+0000","last_active":"2024-06-02T16:45:14.401279+0000","last_peered":"2024-06-02T16:45:14.401279+0000","last_clean":"2024-06-02T16:45:14.401279+0000","last_became_active":"2024-06-02T16:45:12.301477+0000","last_became_peered":"2024-06-02T16:45:12.301477+0000","last_unstale":"2024-06-02T16:45:14.401279+0000","last_undegraded":"2024-06-02T16:45:14.401279+0000","last_fullsized":"2024-06-02T16:45:14.401279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297991+0000","last_change":"2024-06-02T16:45:11.272839+0000","last_active":"2024-06-02T16:45:13.297991+0000","last_peered":"2024-06-02T16:45:13.297991+0000","last_clean":"2024-06-02T16:45:13.297991+0000","last_became_active":"2024-06-02T16:45:11.272540+0000","last_became_peered":"2024-06-02T16:45:11.272540+0000","last_unstale":"2024-06-02T16:45:13.297991+0000","last_undegraded":"2024-06-02T16:45:13.297991+0000","last_fullsized":"2024-06-02T16:45:13.297991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.311323+0000","last_change":"2024-06-02T16:45:12.305267+0000","last_active":"2024-06-02T16:45:12.311323+0000","last_peered":"2024-06-02T16:45:12.311323+0000","last_clean":"2024-06-02T16:45:12.311323+0000","last_became_active":"2024-06-02T16:45:12.304804+0000","last_became_peered":"2024-06-02T16:45:12.304804+0000","last_unstale":"2024-06-02T16:45:12.311323+0000","last_undegraded":"2024-06-02T16:45:12.311323+0000","last_fullsized":"2024-06-02T16:45:12.311323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325127+0000","last_change":"2024-06-02T16:45:11.271730+0000","last_active":"2024-06-02T16:45:13.325127+0000","last_peered":"2024-06-02T16:45:13.325127+0000","last_clean":"2024-06-02T16:45:13.325127+0000","last_became_active":"2024-06-02T16:45:11.269255+0000","last_became_peered":"2024-06-02T16:45:11.269255+0000","last_unstale":"2024-06-02T16:45:13.325127+0000","last_undegraded":"2024-06-02T16:45:13.325127+0000","last_fullsized":"2024-06-02T16:45:13.325127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297433+0000","last_change":"2024-06-02T16:45:11.269405+0000","last_active":"2024-06-02T16:45:13.297433+0000","last_peered":"2024-06-02T16:45:13.297433+0000","last_clean":"2024-06-02T16:45:13.297433+0000","last_became_active":"2024-06-02T16:45:11.269072+0000","last_became_peered":"2024-06-02T16:45:11.269072+0000","last_unstale":"2024-06-02T16:45:13.297433+0000","last_undegraded":"2024-06-02T16:45:13.297433+0000","last_fullsized":"2024-06-02T16:45:13.297433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:39.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297102+0000","last_change":"2024-06-02T16:45:12.308910+0000","last_active":"2024-06-02T16:45:13.297102+0000","last_peered":"2024-06-02T16:45:13.297102+0000","last_clean":"2024-06-02T16:45:13.297102+0000","last_became_active":"2024-06-02T16:45:12.308375+0000","last_became_peered":"2024-06-02T16:45:12.308375+0000","last_unstale":"2024-06-02T16:45:13.297102+0000","last_undegraded":"2024-06-02T16:45:13.297102+0000","last_fullsized":"2024-06-02T16:45:13.297102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400758+0000","last_change":"2024-06-02T16:45:11.280551+0000","last_active":"2024-06-02T16:45:14.400758+0000","last_peered":"2024-06-02T16:45:14.400758+0000","last_clean":"2024-06-02T16:45:14.400758+0000","last_became_active":"2024-06-02T16:45:11.279982+0000","last_became_peered":"2024-06-02T16:45:11.279982+0000","last_unstale":"2024-06-02T16:45:14.400758+0000","last_undegraded":"2024-06-02T16:45:14.400758+0000","last_fullsized":"2024-06-02T16:45:14.400758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298520+0000","last_change":"2024-06-02T16:45:12.294403+0000","last_active":"2024-06-02T16:45:12.298520+0000","last_peered":"2024-06-02T16:45:12.298520+0000","last_clean":"2024-06-02T16:45:12.298520+0000","last_became_active":"2024-06-02T16:45:12.294104+0000","last_became_peered":"2024-06-02T16:45:12.294104+0000","last_unstale":"2024-06-02T16:45:12.298520+0000","last_undegraded":"2024-06-02T16:45:12.298520+0000","last_fullsized":"2024-06-02T16:45:12.298520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:59:26.559041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325481+0000","last_change":"2024-06-02T16:45:11.279215+0000","last_active":"2024-06-02T16:45:13.325481+0000","last_peered":"2024-06-02T16:45:13.325481+0000","last_clean":"2024-06-02T16:45:13.325481+0000","last_became_active":"2024-06-02T16:45:11.278900+0000","last_became_peered":"2024-06-02T16:45:11.278900+0000","last_unstale":"2024-06-02T16:45:13.325481+0000","last_undegraded":"2024-06-02T16:45:13.325481+0000","last_fullsized":"2024-06-02T16:45:13.325481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403606+0000","last_change":"2024-06-02T16:45:12.312906+0000","last_active":"2024-06-02T16:45:14.403606+0000","last_peered":"2024-06-02T16:45:14.403606+0000","last_clean":"2024-06-02T16:45:14.403606+0000","last_became_active":"2024-06-02T16:45:12.312594+0000","last_became_peered":"2024-06-02T16:45:12.312594+0000","last_unstale":"2024-06-02T16:45:14.403606+0000","last_undegraded":"2024-06-02T16:45:14.403606+0000","last_fullsized":"2024-06-02T16:45:14.403606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403585+0000","last_change":"2024-06-02T16:45:11.283234+0000","last_active":"2024-06-02T16:45:14.403585+0000","last_peered":"2024-06-02T16:45:14.403585+0000","last_clean":"2024-06-02T16:45:14.403585+0000","last_became_active":"2024-06-02T16:45:11.282949+0000","last_became_peered":"2024-06-02T16:45:11.282949+0000","last_unstale":"2024-06-02T16:45:14.403585+0000","last_undegraded":"2024-06-02T16:45:14.403585+0000","last_fullsized":"2024-06-02T16:45:14.403585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.317831+0000","last_change":"2024-06-02T16:45:12.317022+0000","last_active":"2024-06-02T16:45:12.317831+0000","last_peered":"2024-06-02T16:45:12.317831+0000","last_clean":"2024-06-02T16:45:12.317831+0000","last_became_active":"2024-06-02T16:45:12.316687+0000","last_became_peered":"2024-06-02T16:45:12.316687+0000","last_unstale":"2024-06-02T16:45:12.317831+0000","last_undegraded":"2024-06-02T16:45:12.317831+0000","last_fullsized":"2024-06-02T16:45:12.317831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:38.904127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.327902+0000","last_change":"2024-06-02T16:45:11.279941+0000","last_active":"2024-06-02T16:45:12.327902+0000","last_peered":"2024-06-02T16:45:12.327902+0000","last_clean":"2024-06-02T16:45:12.327902+0000","last_became_active":"2024-06-02T16:45:11.279600+0000","last_became_peered":"2024-06-02T16:45:11.279600+0000","last_unstale":"2024-06-02T16:45:12.327902+0000","last_undegraded":"2024-06-02T16:45:12.327902+0000","last_fullsized":"2024-06-02T16:45:12.327902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:05:50.798003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402942+0000","last_change":"2024-06-02T16:45:12.311936+0000","last_active":"2024-06-02T16:45:14.402942+0000","last_peered":"2024-06-02T16:45:14.402942+0000","last_clean":"2024-06-02T16:45:14.402942+0000","last_became_active":"2024-06-02T16:45:12.311644+0000","last_became_peered":"2024-06-02T16:45:12.311644+0000","last_unstale":"2024-06-02T16:45:14.402942+0000","last_undegraded":"2024-06-02T16:45:14.402942+0000","last_fullsized":"2024-06-02T16:45:14.402942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325811+0000","last_change":"2024-06-02T16:45:11.273910+0000","last_active":"2024-06-02T16:45:13.325811+0000","last_peered":"2024-06-02T16:45:13.325811+0000","last_clean":"2024-06-02T16:45:13.325811+0000","last_became_active":"2024-06-02T16:45:11.269349+0000","last_became_peered":"2024-06-02T16:45:11.269349+0000","last_unstale":"2024-06-02T16:45:13.325811+0000","last_undegraded":"2024-06-02T16:45:13.325811+0000","last_fullsized":"2024-06-02T16:45:13.325811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996048+0000","last_change":"2024-06-02T16:45:12.309869+0000","last_active":"2024-06-02T16:45:13.996048+0000","last_peered":"2024-06-02T16:45:13.996048+0000","last_clean":"2024-06-02T16:45:13.996048+0000","last_became_active":"2024-06-02T16:45:12.309531+0000","last_became_peered":"2024-06-02T16:45:12.309531+0000","last_unstale":"2024-06-02T16:45:13.996048+0000","last_undegraded":"2024-06-02T16:45:13.996048+0000","last_fullsized":"2024-06-02T16:45:13.996048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.329485+0000","last_change":"2024-06-02T16:45:11.281999+0000","last_active":"2024-06-02T16:45:12.329485+0000","last_peered":"2024-06-02T16:45:12.329485+0000","last_clean":"2024-06-02T16:45:12.329485+0000","last_became_active":"2024-06-02T16:45:11.281659+0000","last_became_peered":"2024-06-02T16:45:11.281659+0000","last_unstale":"2024-06-02T16:45:12.329485+0000","last_undegraded":"2024-06-02T16:45:12.329485+0000","last_fullsized":"2024-06-02T16:45:12.329485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:42:40.894276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.302874+0000","last_change":"2024-06-02T16:45:12.300160+0000","last_active":"2024-06-02T16:45:12.302874+0000","last_peered":"2024-06-02T16:45:12.302874+0000","last_clean":"2024-06-02T16:45:12.302874+0000","last_became_active":"2024-06-02T16:45:12.299866+0000","last_became_peered":"2024-06-02T16:45:12.299866+0000","last_unstale":"2024-06-02T16:45:12.302874+0000","last_undegraded":"2024-06-02T16:45:12.302874+0000","last_fullsized":"2024-06-02T16:45:12.302874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402682+0000","last_change":"2024-06-02T16:45:11.275912+0000","last_active":"2024-06-02T16:45:14.402682+0000","last_peered":"2024-06-02T16:45:14.402682+0000","last_clean":"2024-06-02T16:45:14.402682+0000","last_became_active":"2024-06-02T16:45:11.274344+0000","last_became_peered":"2024-06-02T16:45:11.274344+0000","last_unstale":"2024-06-02T16:45:14.402682+0000","last_undegraded":"2024-06-02T16:45:14.402682+0000","last_fullsized":"2024-06-02T16:45:14.402682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996045+0000","last_change":"2024-06-02T16:45:12.305113+0000","last_active":"2024-06-02T16:45:13.996045+0000","last_peered":"2024-06-02T16:45:13.996045+0000","last_clean":"2024-06-02T16:45:13.996045+0000","last_became_active":"2024-06-02T16:45:12.303754+0000","last_became_peered":"2024-06-02T16:45:12.303754+0000","last_unstale":"2024-06-02T16:45:13.996045+0000","last_undegraded":"2024-06-02T16:45:13.996045+0000","last_fullsized":"2024-06-02T16:45:13.996045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325343+0000","last_change":"2024-06-02T16:45:11.282207+0000","last_active":"2024-06-02T16:45:13.325343+0000","last_peered":"2024-06-02T16:45:13.325343+0000","last_clean":"2024-06-02T16:45:13.325343+0000","last_became_active":"2024-06-02T16:45:11.281896+0000","last_became_peered":"2024-06-02T16:45:11.281896+0000","last_unstale":"2024-06-02T16:45:13.325343+0000","last_undegraded":"2024-06-02T16:45:13.325343+0000","last_fullsized":"2024-06-02T16:45:13.325343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325428+0000","last_change":"2024-06-02T16:45:12.296800+0000","last_active":"2024-06-02T16:45:13.325428+0000","last_peered":"2024-06-02T16:45:13.325428+0000","last_clean":"2024-06-02T16:45:13.325428+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325428+0000","last_undegraded":"2024-06-02T16:45:13.325428+0000","last_fullsized":"2024-06-02T16:45:13.325428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296330+0000","last_change":"2024-06-02T16:45:11.266200+0000","last_active":"2024-06-02T16:45:13.296330+0000","last_peered":"2024-06-02T16:45:13.296330+0000","last_clean":"2024-06-02T16:45:13.296330+0000","last_became_active":"2024-06-02T16:45:11.265898+0000","last_became_peered":"2024-06-02T16:45:11.265898+0000","last_unstale":"2024-06-02T16:45:13.296330+0000","last_undegraded":"2024-06-02T16:45:13.296330+0000","last_fullsized":"2024-06-02T16:45:13.296330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995641+0000","last_change":"2024-06-02T16:45:12.306797+0000","last_active":"2024-06-02T16:45:13.995641+0000","last_peered":"2024-06-02T16:45:13.995641+0000","last_clean":"2024-06-02T16:45:13.995641+0000","last_became_active":"2024-06-02T16:45:12.306438+0000","last_became_peered":"2024-06-02T16:45:12.306438+0000","last_unstale":"2024-06-02T16:45:13.995641+0000","last_undegraded":"2024-06-02T16:45:13.995641+0000","last_fullsized":"2024-06-02T16:45:13.995641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402003+0000","last_change":"2024-06-02T16:45:11.281764+0000","last_active":"2024-06-02T16:45:14.402003+0000","last_peered":"2024-06-02T16:45:14.402003+0000","last_clean":"2024-06-02T16:45:14.402003+0000","last_became_active":"2024-06-02T16:45:11.281487+0000","last_became_peered":"2024-06-02T16:45:11.281487+0000","last_unstale":"2024-06-02T16:45:14.402003+0000","last_undegraded":"2024-06-02T16:45:14.402003+0000","last_fullsized":"2024-06-02T16:45:14.402003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:00.859465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996452+0000","last_change":"2024-06-02T16:45:12.303257+0000","last_active":"2024-06-02T16:45:13.996452+0000","last_peered":"2024-06-02T16:45:13.996452+0000","last_clean":"2024-06-02T16:45:13.996452+0000","last_became_active":"2024-06-02T16:45:12.302846+0000","last_became_peered":"2024-06-02T16:45:12.302846+0000","last_unstale":"2024-06-02T16:45:13.996452+0000","last_undegraded":"2024-06-02T16:45:13.996452+0000","last_fullsized":"2024-06-02T16:45:13.996452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297861+0000","last_change":"2024-06-02T16:45:11.265071+0000","last_active":"2024-06-02T16:45:13.297861+0000","last_peered":"2024-06-02T16:45:13.297861+0000","last_clean":"2024-06-02T16:45:13.297861+0000","last_became_active":"2024-06-02T16:45:11.264782+0000","last_became_peered":"2024-06-02T16:45:11.264782+0000","last_unstale":"2024-06-02T16:45:13.297861+0000","last_undegraded":"2024-06-02T16:45:13.297861+0000","last_fullsized":"2024-06-02T16:45:13.297861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996903+0000","last_change":"2024-06-02T16:45:12.308045+0000","last_active":"2024-06-02T16:45:13.996903+0000","last_peered":"2024-06-02T16:45:13.996903+0000","last_clean":"2024-06-02T16:45:13.996903+0000","last_became_active":"2024-06-02T16:45:12.307750+0000","last_became_peered":"2024-06-02T16:45:12.307750+0000","last_unstale":"2024-06-02T16:45:13.996903+0000","last_undegraded":"2024-06-02T16:45:13.996903+0000","last_fullsized":"2024-06-02T16:45:13.996903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:24.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.326083+0000","last_change":"2024-06-02T16:45:11.279209+0000","last_active":"2024-06-02T16:45:12.326083+0000","last_peered":"2024-06-02T16:45:12.326083+0000","last_clean":"2024-06-02T16:45:12.326083+0000","last_became_active":"2024-06-02T16:45:11.278908+0000","last_became_peered":"2024-06-02T16:45:11.278908+0000","last_unstale":"2024-06-02T16:45:12.326083+0000","last_undegraded":"2024-06-02T16:45:12.326083+0000","last_fullsized":"2024-06-02T16:45:12.326083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:26:48.069333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403037+0000","last_change":"2024-06-02T16:45:12.309555+0000","last_active":"2024-06-02T16:45:14.403037+0000","last_peered":"2024-06-02T16:45:14.403037+0000","last_clean":"2024-06-02T16:45:14.403037+0000","last_became_active":"2024-06-02T16:45:12.309069+0000","last_became_peered":"2024-06-02T16:45:12.309069+0000","last_unstale":"2024-06-02T16:45:14.403037+0000","last_undegraded":"2024-06-02T16:45:14.403037+0000","last_fullsized":"2024-06-02T16:45:14.403037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297157+0000","last_change":"2024-06-02T16:45:11.275392+0000","last_active":"2024-06-02T16:45:13.297157+0000","last_peered":"2024-06-02T16:45:13.297157+0000","last_clean":"2024-06-02T16:45:13.297157+0000","last_became_active":"2024-06-02T16:45:11.274685+0000","last_became_peered":"2024-06-02T16:45:11.274685+0000","last_unstale":"2024-06-02T16:45:13.297157+0000","last_undegraded":"2024-06-02T16:45:13.297157+0000","last_fullsized":"2024-06-02T16:45:13.297157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996381+0000","last_change":"2024-06-02T16:45:12.317046+0000","last_active":"2024-06-02T16:45:13.996381+0000","last_peered":"2024-06-02T16:45:13.996381+0000","last_clean":"2024-06-02T16:45:13.996381+0000","last_became_active":"2024-06-02T16:45:12.316726+0000","last_became_peered":"2024-06-02T16:45:12.316726+0000","last_unstale":"2024-06-02T16:45:13.996381+0000","last_undegraded":"2024-06-02T16:45:13.996381+0000","last_fullsized":"2024-06-02T16:45:13.996381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995299+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:45:13.995299+0000","last_peered":"2024-06-02T16:45:13.995299+0000","last_clean":"2024-06-02T16:45:13.995299+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:45:13.995299+0000","last_undegraded":"2024-06-02T16:45:13.995299+0000","last_fullsized":"2024-06-02T16:45:13.995299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401851+0000","last_change":"2024-06-02T16:45:11.275427+0000","last_active":"2024-06-02T16:45:14.401851+0000","last_peered":"2024-06-02T16:45:14.401851+0000","last_clean":"2024-06-02T16:45:14.401851+0000","last_became_active":"2024-06-02T16:45:11.275105+0000","last_became_peered":"2024-06-02T16:45:11.275105+0000","last_unstale":"2024-06-02T16:45:14.401851+0000","last_undegraded":"2024-06-02T16:45:14.401851+0000","last_fullsized":"2024-06-02T16:45:14.401851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297782+0000","last_change":"2024-06-02T16:45:12.315916+0000","last_active":"2024-06-02T16:45:13.297782+0000","last_peered":"2024-06-02T16:45:13.297782+0000","last_clean":"2024-06-02T16:45:13.297782+0000","last_became_active":"2024-06-02T16:45:12.315576+0000","last_became_peered":"2024-06-02T16:45:12.315576+0000","last_unstale":"2024-06-02T16:45:13.297782+0000","last_undegraded":"2024-06-02T16:45:13.297782+0000","last_fullsized":"2024-06-02T16:45:13.297782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995143+0000","last_change":"2024-06-02T16:45:11.284136+0000","last_active":"2024-06-02T16:45:13.995143+0000","last_peered":"2024-06-02T16:45:13.995143+0000","last_clean":"2024-06-02T16:45:13.995143+0000","last_became_active":"2024-06-02T16:45:11.283636+0000","last_became_peered":"2024-06-02T16:45:11.283636+0000","last_unstale":"2024-06-02T16:45:13.995143+0000","last_undegraded":"2024-06-02T16:45:13.995143+0000","last_fullsized":"2024-06-02T16:45:13.995143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.300847+0000","last_change":"2024-06-02T16:45:12.297552+0000","last_active":"2024-06-02T16:45:12.300847+0000","last_peered":"2024-06-02T16:45:12.300847+0000","last_clean":"2024-06-02T16:45:12.300847+0000","last_became_active":"2024-06-02T16:45:12.297284+0000","last_became_peered":"2024-06-02T16:45:12.297284+0000","last_unstale":"2024-06-02T16:45:12.300847+0000","last_undegraded":"2024-06-02T16:45:12.300847+0000","last_fullsized":"2024-06-02T16:45:12.300847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:14.424486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296544+0000","last_change":"2024-06-02T16:45:11.263835+0000","last_active":"2024-06-02T16:45:13.296544+0000","last_peered":"2024-06-02T16:45:13.296544+0000","last_clean":"2024-06-02T16:45:13.296544+0000","last_became_active":"2024-06-02T16:45:11.261012+0000","last_became_peered":"2024-06-02T16:45:11.261012+0000","last_unstale":"2024-06-02T16:45:13.296544+0000","last_undegraded":"2024-06-02T16:45:13.296544+0000","last_fullsized":"2024-06-02T16:45:13.296544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.298711+0000","last_change":"2024-06-02T16:45:12.293349+0000","last_active":"2024-06-02T16:45:12.298711+0000","last_peered":"2024-06-02T16:45:12.298711+0000","last_clean":"2024-06-02T16:45:12.298711+0000","last_became_active":"2024-06-02T16:45:12.292988+0000","last_became_peered":"2024-06-02T16:45:12.292988+0000","last_unstale":"2024-06-02T16:45:12.298711+0000","last_undegraded":"2024-06-02T16:45:12.298711+0000","last_fullsized":"2024-06-02T16:45:12.298711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:43:05.763638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402866+0000","last_change":"2024-06-02T16:45:11.275239+0000","last_active":"2024-06-02T16:45:14.402866+0000","last_peered":"2024-06-02T16:45:14.402866+0000","last_clean":"2024-06-02T16:45:14.402866+0000","last_became_active":"2024-06-02T16:45:11.274878+0000","last_became_peered":"2024-06-02T16:45:11.274878+0000","last_unstale":"2024-06-02T16:45:14.402866+0000","last_undegraded":"2024-06-02T16:45:14.402866+0000","last_fullsized":"2024-06-02T16:45:14.402866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402084+0000","last_change":"2024-06-02T16:45:12.299815+0000","last_active":"2024-06-02T16:45:14.402084+0000","last_peered":"2024-06-02T16:45:14.402084+0000","last_clean":"2024-06-02T16:45:14.402084+0000","last_became_active":"2024-06-02T16:45:12.299416+0000","last_became_peered":"2024-06-02T16:45:12.299416+0000","last_unstale":"2024-06-02T16:45:14.402084+0000","last_undegraded":"2024-06-02T16:45:14.402084+0000","last_fullsized":"2024-06-02T16:45:14.402084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.268073+0000","last_change":"2024-06-02T16:45:11.272338+0000","last_active":"2024-06-02T16:45:12.268073+0000","last_peered":"2024-06-02T16:45:12.268073+0000","last_clean":"2024-06-02T16:45:12.268073+0000","last_became_active":"2024-06-02T16:45:11.271994+0000","last_became_peered":"2024-06-02T16:45:11.271994+0000","last_unstale":"2024-06-02T16:45:12.268073+0000","last_undegraded":"2024-06-02T16:45:12.268073+0000","last_fullsized":"2024-06-02T16:45:12.268073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:01.110485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403530+0000","last_change":"2024-06-02T16:45:12.314530+0000","last_active":"2024-06-02T16:45:14.403530+0000","last_peered":"2024-06-02T16:45:14.403530+0000","last_clean":"2024-06-02T16:45:14.403530+0000","last_became_active":"2024-06-02T16:45:12.309275+0000","last_became_peered":"2024-06-02T16:45:12.309275+0000","last_unstale":"2024-06-02T16:45:14.403530+0000","last_undegraded":"2024-06-02T16:45:14.403530+0000","last_fullsized":"2024-06-02T16:45:14.403530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996654+0000","last_change":"2024-06-02T16:45:11.286614+0000","last_active":"2024-06-02T16:45:13.996654+0000","last_peered":"2024-06-02T16:45:13.996654+0000","last_clean":"2024-06-02T16:45:13.996654+0000","last_became_active":"2024-06-02T16:45:11.286270+0000","last_became_peered":"2024-06-02T16:45:11.286270+0000","last_unstale":"2024-06-02T16:45:13.996654+0000","last_undegraded":"2024-06-02T16:45:13.996654+0000","last_fullsized":"2024-06-02T16:45:13.996654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:34.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.300532+0000","last_change":"2024-06-02T16:45:12.297417+0000","last_active":"2024-06-02T16:45:12.300532+0000","last_peered":"2024-06-02T16:45:12.300532+0000","last_clean":"2024-06-02T16:45:12.300532+0000","last_became_active":"2024-06-02T16:45:12.295971+0000","last_became_peered":"2024-06-02T16:45:12.295971+0000","last_unstale":"2024-06-02T16:45:12.300532+0000","last_undegraded":"2024-06-02T16:45:12.300532+0000","last_fullsized":"2024-06-02T16:45:12.300532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:35:19.393828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.268141+0000","last_change":"2024-06-02T16:45:11.276872+0000","last_active":"2024-06-02T16:45:12.268141+0000","last_peered":"2024-06-02T16:45:12.268141+0000","last_clean":"2024-06-02T16:45:12.268141+0000","last_became_active":"2024-06-02T16:45:11.276659+0000","last_became_peered":"2024-06-02T16:45:11.276659+0000","last_unstale":"2024-06-02T16:45:12.268141+0000","last_undegraded":"2024-06-02T16:45:12.268141+0000","last_fullsized":"2024-06-02T16:45:12.268141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:35.798870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.299014+0000","last_change":"2024-06-02T16:45:12.309798+0000","last_active":"2024-06-02T16:45:13.299014+0000","last_peered":"2024-06-02T16:45:13.299014+0000","last_clean":"2024-06-02T16:45:13.299014+0000","last_became_active":"2024-06-02T16:45:12.309229+0000","last_became_peered":"2024-06-02T16:45:12.309229+0000","last_unstale":"2024-06-02T16:45:13.299014+0000","last_undegraded":"2024-06-02T16:45:13.299014+0000","last_fullsized":"2024-06-02T16:45:13.299014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325726+0000","last_change":"2024-06-02T16:45:11.284796+0000","last_active":"2024-06-02T16:45:13.325726+0000","last_peered":"2024-06-02T16:45:13.325726+0000","last_clean":"2024-06-02T16:45:13.325726+0000","last_became_active":"2024-06-02T16:45:11.284453+0000","last_became_peered":"2024-06-02T16:45:11.284453+0000","last_unstale":"2024-06-02T16:45:13.325726+0000","last_undegraded":"2024-06-02T16:45:13.325726+0000","last_fullsized":"2024-06-02T16:45:13.325726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.301961+0000","last_change":"2024-06-02T16:45:12.295217+0000","last_active":"2024-06-02T16:45:12.301961+0000","last_peered":"2024-06-02T16:45:12.301961+0000","last_clean":"2024-06-02T16:45:12.301961+0000","last_became_active":"2024-06-02T16:45:12.294918+0000","last_became_peered":"2024-06-02T16:45:12.294918+0000","last_unstale":"2024-06-02T16:45:12.301961+0000","last_undegraded":"2024-06-02T16:45:12.301961+0000","last_fullsized":"2024-06-02T16:45:12.301961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:40.403924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995110+0000","last_change":"2024-06-02T16:45:11.283792+0000","last_active":"2024-06-02T16:45:13.995110+0000","last_peered":"2024-06-02T16:45:13.995110+0000","last_clean":"2024-06-02T16:45:13.995110+0000","last_became_active":"2024-06-02T16:45:11.283275+0000","last_became_peered":"2024-06-02T16:45:11.283275+0000","last_unstale":"2024-06-02T16:45:13.995110+0000","last_undegraded":"2024-06-02T16:45:13.995110+0000","last_fullsized":"2024-06-02T16:45:13.995110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:37.892243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402663+0000","last_change":"2024-06-02T16:45:12.297797+0000","last_active":"2024-06-02T16:45:14.402663+0000","last_peered":"2024-06-02T16:45:14.402663+0000","last_clean":"2024-06-02T16:45:14.402663+0000","last_became_active":"2024-06-02T16:45:12.297359+0000","last_became_peered":"2024-06-02T16:45:12.297359+0000","last_unstale":"2024-06-02T16:45:14.402663+0000","last_undegraded":"2024-06-02T16:45:14.402663+0000","last_fullsized":"2024-06-02T16:45:14.402663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.267427+0000","last_change":"2024-06-02T16:45:11.278360+0000","last_active":"2024-06-02T16:45:12.267427+0000","last_peered":"2024-06-02T16:45:12.267427+0000","last_clean":"2024-06-02T16:45:12.267427+0000","last_became_active":"2024-06-02T16:45:11.277862+0000","last_became_peered":"2024-06-02T16:45:11.277862+0000","last_unstale":"2024-06-02T16:45:12.267427+0000","last_undegraded":"2024-06-02T16:45:12.267427+0000","last_fullsized":"2024-06-02T16:45:12.267427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:41:22.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296880+0000","last_change":"2024-06-02T16:45:12.306004+0000","last_active":"2024-06-02T16:45:13.296880+0000","last_peered":"2024-06-02T16:45:13.296880+0000","last_clean":"2024-06-02T16:45:13.296880+0000","last_became_active":"2024-06-02T16:45:12.305698+0000","last_became_peered":"2024-06-02T16:45:12.305698+0000","last_unstale":"2024-06-02T16:45:13.296880+0000","last_undegraded":"2024-06-02T16:45:13.296880+0000","last_fullsized":"2024-06-02T16:45:13.296880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.267784+0000","last_change":"2024-06-02T16:45:11.270577+0000","last_active":"2024-06-02T16:45:12.267784+0000","last_peered":"2024-06-02T16:45:12.267784+0000","last_clean":"2024-06-02T16:45:12.267784+0000","last_became_active":"2024-06-02T16:45:11.270316+0000","last_became_peered":"2024-06-02T16:45:11.270316+0000","last_unstale":"2024-06-02T16:45:12.267784+0000","last_undegraded":"2024-06-02T16:45:12.267784+0000","last_fullsized":"2024-06-02T16:45:12.267784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:49.398066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297767+0000","last_change":"2024-06-02T16:45:12.306883+0000","last_active":"2024-06-02T16:45:13.297767+0000","last_peered":"2024-06-02T16:45:13.297767+0000","last_clean":"2024-06-02T16:45:13.297767+0000","last_became_active":"2024-06-02T16:45:12.306582+0000","last_became_peered":"2024-06-02T16:45:12.306582+0000","last_unstale":"2024-06-02T16:45:13.297767+0000","last_undegraded":"2024-06-02T16:45:13.297767+0000","last_fullsized":"2024-06-02T16:45:13.297767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996343+0000","last_change":"2024-06-02T16:45:11.288038+0000","last_active":"2024-06-02T16:45:13.996343+0000","last_peered":"2024-06-02T16:45:13.996343+0000","last_clean":"2024-06-02T16:45:13.996343+0000","last_became_active":"2024-06-02T16:45:11.287757+0000","last_became_peered":"2024-06-02T16:45:11.287757+0000","last_unstale":"2024-06-02T16:45:13.996343+0000","last_undegraded":"2024-06-02T16:45:13.996343+0000","last_fullsized":"2024-06-02T16:45:13.996343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325212+0000","last_change":"2024-06-02T16:45:12.298140+0000","last_active":"2024-06-02T16:45:13.325212+0000","last_peered":"2024-06-02T16:45:13.325212+0000","last_clean":"2024-06-02T16:45:13.325212+0000","last_became_active":"2024-06-02T16:45:12.297832+0000","last_became_peered":"2024-06-02T16:45:12.297832+0000","last_unstale":"2024-06-02T16:45:13.325212+0000","last_undegraded":"2024-06-02T16:45:13.325212+0000","last_fullsized":"2024-06-02T16:45:13.325212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403511+0000","last_change":"2024-06-02T16:45:12.302894+0000","last_active":"2024-06-02T16:45:14.403511+0000","last_peered":"2024-06-02T16:45:14.403511+0000","last_clean":"2024-06-02T16:45:14.403511+0000","last_became_active":"2024-06-02T16:45:12.302609+0000","last_became_peered":"2024-06-02T16:45:12.302609+0000","last_unstale":"2024-06-02T16:45:14.403511+0000","last_undegraded":"2024-06-02T16:45:14.403511+0000","last_fullsized":"2024-06-02T16:45:14.403511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995933+0000","last_change":"2024-06-02T16:45:11.286611+0000","last_active":"2024-06-02T16:45:13.995933+0000","last_peered":"2024-06-02T16:45:13.995933+0000","last_clean":"2024-06-02T16:45:13.995933+0000","last_became_active":"2024-06-02T16:45:11.286294+0000","last_became_peered":"2024-06-02T16:45:11.286294+0000","last_unstale":"2024-06-02T16:45:13.995933+0000","last_undegraded":"2024-06-02T16:45:13.995933+0000","last_fullsized":"2024-06-02T16:45:13.995933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:07.092809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402591+0000","last_change":"2024-06-02T16:45:12.302182+0000","last_active":"2024-06-02T16:45:14.402591+0000","last_peered":"2024-06-02T16:45:14.402591+0000","last_clean":"2024-06-02T16:45:14.402591+0000","last_became_active":"2024-06-02T16:45:12.301903+0000","last_became_peered":"2024-06-02T16:45:12.301903+0000","last_unstale":"2024-06-02T16:45:14.402591+0000","last_undegraded":"2024-06-02T16:45:14.402591+0000","last_fullsized":"2024-06-02T16:45:14.402591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996321+0000","last_change":"2024-06-02T16:45:11.286446+0000","last_active":"2024-06-02T16:45:13.996321+0000","last_peered":"2024-06-02T16:45:13.996321+0000","last_clean":"2024-06-02T16:45:13.996321+0000","last_became_active":"2024-06-02T16:45:11.286095+0000","last_became_peered":"2024-06-02T16:45:11.286095+0000","last_unstale":"2024-06-02T16:45:13.996321+0000","last_undegraded":"2024-06-02T16:45:13.996321+0000","last_fullsized":"2024-06-02T16:45:13.996321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:28.668240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.311987+0000","last_change":"2024-06-02T16:45:12.309888+0000","last_active":"2024-06-02T16:45:12.311987+0000","last_peered":"2024-06-02T16:45:12.311987+0000","last_clean":"2024-06-02T16:45:12.311987+0000","last_became_active":"2024-06-02T16:45:12.309638+0000","last_became_peered":"2024-06-02T16:45:12.309638+0000","last_unstale":"2024-06-02T16:45:12.311987+0000","last_undegraded":"2024-06-02T16:45:12.311987+0000","last_fullsized":"2024-06-02T16:45:12.311987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298853+0000","last_change":"2024-06-02T16:45:11.271444+0000","last_active":"2024-06-02T16:45:13.298853+0000","last_peered":"2024-06-02T16:45:13.298853+0000","last_clean":"2024-06-02T16:45:13.298853+0000","last_became_active":"2024-06-02T16:45:11.271168+0000","last_became_peered":"2024-06-02T16:45:11.271168+0000","last_unstale":"2024-06-02T16:45:13.298853+0000","last_undegraded":"2024-06-02T16:45:13.298853+0000","last_fullsized":"2024-06-02T16:45:13.298853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:40.375189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298807+0000","last_change":"2024-06-02T16:45:12.303300+0000","last_active":"2024-06-02T16:45:13.298807+0000","last_peered":"2024-06-02T16:45:13.298807+0000","last_clean":"2024-06-02T16:45:13.298807+0000","last_became_active":"2024-06-02T16:45:12.303009+0000","last_became_peered":"2024-06-02T16:45:12.303009+0000","last_unstale":"2024-06-02T16:45:13.298807+0000","last_undegraded":"2024-06-02T16:45:13.298807+0000","last_fullsized":"2024-06-02T16:45:13.298807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-06-02T16:45:12.329788+0000","last_change":"2024-06-02T16:45:11.285228+0000","last_active":"2024-06-02T16:45:12.329788+0000","last_peered":"2024-06-02T16:45:12.329788+0000","last_clean":"2024-06-02T16:45:12.329788+0000","last_became_active":"2024-06-02T16:45:11.284770+0000","last_became_peered":"2024-06-02T16:45:11.284770+0000","last_unstale":"2024-06-02T16:45:12.329788+0000","last_undegraded":"2024-06-02T16:45:12.329788+0000","last_fullsized":"2024-06-02T16:45:12.329788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":670785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476740,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":823296,"data_stored":664541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":73535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:45:17.331 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T16:45:17.331 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T16:45:17.331 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-02T16:45:17.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-02T16:45:17.332 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-02T16:45:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.582+0000 7f5138a00640 1 Processor -- start 2024-06-02T16:45:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.582+0000 7f5138a00640 1 -- start start 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.583+0000 7f5138a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5134070700 0x7f51340b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.583+0000 7f5138a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5134161680 0x7f51340d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5138a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513415dcd0 con 0x7f513415d640 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5138a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f513415dab0 con 0x7f5134161680 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5138a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f513415dfb0 con 0x7f5134070700 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5133e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5134161680 0x7f51340d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5133e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5134161680 0x7f51340d3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52878/0 (socket says 172.21.15.52:52878) 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5133e00640 1 -- 172.21.15.52:0/490376107 learned_addr learned my addr 172.21.15.52:0/490376107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5132a00640 1 --1- 172.21.15.52:0/490376107 >> v1:172.21.15.52:6789/0 conn(0x7f513415d640 0x7f5134070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51798/0 (socket says 172.21.15.52:51798) 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.584+0000 7f5133400640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5134070700 0x7f51340b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.585+0000 7f5133e00640 1 -- 172.21.15.52:0/490376107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5134070700 msgr2=0x7f51340b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.585+0000 7f5133e00640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5134070700 0x7f51340b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.585+0000 7f5133e00640 1 -- 172.21.15.52:0/490376107 >> v1:172.21.15.52:6789/0 conn(0x7f513415d640 legacy=0x7f5134070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.585+0000 7f5133e00640 1 -- 172.21.15.52:0/490376107 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513415e290 con 0x7f5134161680 2024-06-02T16:45:17.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.586+0000 7f5133e00640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134161680 0x7f51340d3020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f512c009870 tx=0x7f512c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02e6cfeef3564be server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5132000640 1 -- 172.21.15.52:0/490376107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c037070 con 0x7f5134161680 2024-06-02T16:45:17.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5132000640 1 -- 172.21.15.52:0/490376107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c02adf0 con 0x7f5134161680 2024-06-02T16:45:17.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5132000640 1 -- 172.21.15.52:0/490376107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c032660 con 0x7f5134161680 2024-06-02T16:45:17.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 -- 172.21.15.52:0/490376107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134161680 msgr2=0x7f51340d3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134161680 0x7f51340d3020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f512c009870 tx=0x7f512c02a160 comp rx=0 tx=0).stop 2024-06-02T16:45:17.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 -- 172.21.15.52:0/490376107 shutdown_connections 2024-06-02T16:45:17.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134161680 0x7f51340d3020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 --2- 172.21.15.52:0/490376107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5134070700 0x7f51340b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 -- 172.21.15.52:0/490376107 >> 172.21.15.52:0/490376107 conn(0x7f513406c7a0 msgr2=0x7f51340b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:17.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.587+0000 7f5138a00640 1 -- 172.21.15.52:0/490376107 shutdown_connections 2024-06-02T16:45:17.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.588+0000 7f5138a00640 1 -- 172.21.15.52:0/490376107 wait complete. 2024-06-02T16:45:17.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.589+0000 7f5138a00640 1 Processor -- start 2024-06-02T16:45:17.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.589+0000 7f5138a00640 1 -- start start 2024-06-02T16:45:17.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 0x7f51341f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 0x7f51341f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f513415e570 con 0x7f5134070700 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5134161af0 con 0x7f5134161680 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.590+0000 7f5138a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5134146210 con 0x7f513415d640 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52888/0 (socket says 172.21.15.52:52888) 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 -- 172.21.15.52:0/1225946388 learned_addr learned my addr 172.21.15.52:0/1225946388 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5132a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 0x7f51341f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133e00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 0x7f51341f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 -- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 msgr2=0x7f51341f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 0x7f51341f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 -- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 msgr2=0x7f51341f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 0x7f51341f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133400640 1 -- 172.21.15.52:0/1225946388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5134140e30 con 0x7f5134070700 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5132a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 0x7f51341f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.591+0000 7f5133e00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 0x7f51341f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f5133400640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5124007ef0 tx=0x7f512400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124014620 con 0x7f5134070700 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124019070 con 0x7f5134070700 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124014a00 con 0x7f5134070700 2024-06-02T16:45:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5134141110 con 0x7f5134070700 2024-06-02T16:45:17.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.592+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51341416d0 con 0x7f5134070700 2024-06-02T16:45:17.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.593+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51340507e0 con 0x7f5134070700 2024-06-02T16:45:17.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.594+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5124014ba0 con 0x7f5134070700 2024-06-02T16:45:17.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.595+0000 7f512b400640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 0x7f5110078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:17.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.596+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5124097f50 con 0x7f5134070700 2024-06-02T16:45:17.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.596+0000 7f5132a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 0x7f5110078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:17.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.597+0000 7f5132a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 0x7f5110078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f513415a610 tx=0x7f511c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:17.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.600+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f51240618b0 con 0x7f5134070700 2024-06-02T16:45:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.871+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f51340b5690 con 0x7f5134070700 2024-06-02T16:45:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.876+0000 7f512b400640 1 -- 172.21.15.52:0/1225946388 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189528 (secure 0 0 0) 0x7f51240611b0 con 0x7f5134070700 2024-06-02T16:45:17.878 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 msgr2=0x7f5110078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 0x7f5110078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f513415a610 tx=0x7f511c009040 comp rx=0 tx=0).stop 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 msgr2=0x7f5134156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5124007ef0 tx=0x7f512400e4b0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 shutdown_connections 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f51100762d0 0x7f5110078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5134161680 0x7f51341f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f513415d640 0x7f51341f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 --2- 172.21.15.52:0/1225946388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5134070700 0x7f5134156dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:17.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.881+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 >> 172.21.15.52:0/1225946388 conn(0x7f513406c7a0 msgr2=0x7f51340635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:17.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.882+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 shutdown_connections 2024-06-02T16:45:17.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:17.882+0000 7f5138a00640 1 -- 172.21.15.52:0/1225946388 wait complete. 2024-06-02T16:45:17.900 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3580739334},{"type":"v1","addr":"172.21.15.114:6833","nonce":3580739334}]},"active_addr":"172.21.15.114:6833/3580739334","active_change":"2024-06-02T16:44:51.967706+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":4005733252}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1528735679}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3903360821}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1173513622}]}]} 2024-06-02T16:45:17.904 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-02T16:45:17.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-02T16:45:17.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:17.999 INFO:tasks.ceph.mds.b.smithi114.stderr:2024-06-02T16:45:18.000+0000 7f19b7a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T16:45:18.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.113+0000 7fd8fda00640 1 Processor -- start 2024-06-02T16:45:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.113+0000 7fd8fda00640 1 -- start start 2024-06-02T16:45:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.114+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f815d2d0 0x7fd8f80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.114+0000 7fd8fda00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8f806fed0 0x7fd8f806f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.114+0000 7fd8fda00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f80ae8e0 con 0x7fd8f80d1450 2024-06-02T16:45:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.114+0000 7fd8fda00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f815d6b0 con 0x7fd8f806fed0 2024-06-02T16:45:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.114+0000 7fd8fda00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f806ed90 con 0x7fd8f815d2d0 2024-06-02T16:45:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8ee000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8f806fed0 0x7fd8f806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8ee000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8f806fed0 0x7fd8f806f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52892/0 (socket says 172.21.15.52:52892) 2024-06-02T16:45:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8f7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd8f80d1450 0x7fd8f80727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51814/0 (socket says 172.21.15.52:51814) 2024-06-02T16:45:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8ee000640 1 -- 172.21.15.52:0/417894596 learned_addr learned my addr 172.21.15.52:0/417894596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8f6a00640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f815d2d0 0x7fd8f80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8ee000640 1 -- 172.21.15.52:0/417894596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f815d2d0 msgr2=0x7fd8f80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8ee000640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f815d2d0 0x7fd8f80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.115+0000 7fd8f6000640 1 -- 172.21.15.52:0/417894596 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54005570 0 0) 0x7fd8f0001110 con 0x7fd8f80d1450 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.116+0000 7fd8ee000640 1 -- 172.21.15.52:0/417894596 >> v1:172.21.15.52:6789/0 conn(0x7fd8f80d1450 legacy=0x7fd8f80727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.116+0000 7fd8ee000640 1 -- 172.21.15.52:0/417894596 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80ae600 con 0x7fd8f806fed0 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8ee000640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f806fed0 0x7fd8f806f220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009870 tx=0x7fd8e002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723bf0d23190d01f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8f6000640 1 -- 172.21.15.52:0/417894596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0037070 con 0x7fd8f806fed0 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8f6000640 1 -- 172.21.15.52:0/417894596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0032440 con 0x7fd8f806fed0 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8f6000640 1 -- 172.21.15.52:0/417894596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0032810 con 0x7fd8f806fed0 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8fda00640 1 -- 172.21.15.52:0/417894596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f806fed0 msgr2=0x7fd8f806f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.117+0000 7fd8fda00640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f806fed0 0x7fd8f806f220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009870 tx=0x7fd8e002a250 comp rx=0 tx=0).stop 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 -- 172.21.15.52:0/417894596 shutdown_connections 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f806fed0 0x7fd8f806f220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 --2- 172.21.15.52:0/417894596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f815d2d0 0x7fd8f80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 -- 172.21.15.52:0/417894596 >> 172.21.15.52:0/417894596 conn(0x7fd8f806c7a0 msgr2=0x7fd8f806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 -- 172.21.15.52:0/417894596 shutdown_connections 2024-06-02T16:45:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.118+0000 7fd8fda00640 1 -- 172.21.15.52:0/417894596 wait complete. 2024-06-02T16:45:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.119+0000 7fd8fda00640 1 Processor -- start 2024-06-02T16:45:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.120+0000 7fd8fda00640 1 -- start start 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.120+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f806fed0 0x7fd8f815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.120+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.120+0000 7fd8fda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 0x7fd8f81564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8fda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80741b0 con 0x7fd8f80d1450 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8fda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f806ea20 con 0x7fd8f815d2d0 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8fda00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f81f6cf0 con 0x7fd8f806fed0 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52906/0 (socket says 172.21.15.52:52906) 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 -- 172.21.15.52:0/736442151 learned_addr learned my addr 172.21.15.52:0/736442151 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8f7400640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 0x7fd8f81564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 -- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f806fed0 msgr2=0x7fd8f815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f806fed0 0x7fd8f815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 -- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 msgr2=0x7fd8f81564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 0x7fd8f81564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8ee000640 1 -- 172.21.15.52:0/736442151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f81f6f40 con 0x7fd8f80d1450 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.121+0000 7fd8f7400640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 0x7fd8f81564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8ee000640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0000c00 tx=0x7fd8e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0037040 con 0x7fd8f80d1450 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0042070 con 0x7fd8f80d1450 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0030880 con 0x7fd8f80d1450 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f81f7220 con 0x7fd8f80d1450 2024-06-02T16:45:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.122+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f81f77e0 con 0x7fd8f80d1450 2024-06-02T16:45:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.123+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f8069520 con 0x7fd8f80d1450 2024-06-02T16:45:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.124+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd8e0030a20 con 0x7fd8f80d1450 2024-06-02T16:45:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.125+0000 7fd8ef400640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 0x7fd8d40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.126+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd8e00b7f10 con 0x7fd8f80d1450 2024-06-02T16:45:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.126+0000 7fd8f6a00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 0x7fd8d40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.127+0000 7fd8f6a00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 0x7fd8d40787c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009fa0 tx=0x7fd8e800b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.130+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd8e0081860 con 0x7fd8f80d1450 2024-06-02T16:45:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.342+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8f80b3b30 con 0x7fd8f80d1450 2024-06-02T16:45:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.345+0000 7fd8ef400640 1 -- 172.21.15.52:0/736442151 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7fd8e0081160 con 0x7fd8f80d1450 2024-06-02T16:45:18.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:18.345 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.347+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 msgr2=0x7fd8d40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.347+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 0x7fd8d40787c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009fa0 tx=0x7fd8e800b040 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.347+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 msgr2=0x7fd8f8151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.347+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0000c00 tx=0x7fd8e00046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 shutdown_connections 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8d4076300 0x7fd8d40787c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8f815d2d0 0x7fd8f81564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8f80d1450 0x7fd8f8151110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 --2- 172.21.15.52:0/736442151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd8f806fed0 0x7fd8f815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 >> 172.21.15.52:0/736442151 conn(0x7fd8f806c7a0 msgr2=0x7fd8f81578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 shutdown_connections 2024-06-02T16:45:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.348+0000 7fd8fda00640 1 -- 172.21.15.52:0/736442151 wait complete. 2024-06-02T16:45:18.367 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-02T16:45:18.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:18.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.579+0000 7ff6dfe00640 1 Processor -- start 2024-06-02T16:45:18.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.579+0000 7ff6dfe00640 1 -- start start 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.580+0000 7ff6dfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6d815d2d0 0x7ff6d80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.580+0000 7ff6dfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6d806fed0 0x7ff6d806f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dfe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d80ae8e0 con 0x7ff6d80d1450 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d815d6b0 con 0x7ff6d806fed0 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dfe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d806ed90 con 0x7ff6d815d2d0 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6d806fed0 0x7ff6d806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6d806fed0 0x7ff6d806f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52922/0 (socket says 172.21.15.52:52922) 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dca00640 1 -- 172.21.15.52:0/1116137376 learned_addr learned my addr 172.21.15.52:0/1116137376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:18.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.581+0000 7ff6dd400640 1 --2- 172.21.15.52:0/1116137376 >> v2:172.21.15.114:3300/0 conn(0x7ff6d815d2d0 0x7ff6d80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.582+0000 7ff6dca00640 1 -- 172.21.15.52:0/1116137376 >> v2:172.21.15.114:3300/0 conn(0x7ff6d815d2d0 msgr2=0x7ff6d80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:18.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.582+0000 7ff6dca00640 1 --2- 172.21.15.52:0/1116137376 >> v2:172.21.15.114:3300/0 conn(0x7ff6d815d2d0 0x7ff6d80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.582+0000 7ff6dca00640 1 -- 172.21.15.52:0/1116137376 >> v1:172.21.15.114:6789/0 conn(0x7ff6d80d1450 legacy=0x7ff6d80727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:18.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.582+0000 7ff6dca00640 1 -- 172.21.15.52:0/1116137376 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d80ae600 con 0x7ff6d806fed0 2024-06-02T16:45:18.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.583+0000 7ff6dca00640 1 --2- 172.21.15.52:0/1116137376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d806f220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80b6440 tx=0x7ff6c802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711e7d7dcd097cb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.583+0000 7ff6d7e00640 1 -- 172.21.15.52:0/1116137376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8036070 con 0x7ff6d806fed0 2024-06-02T16:45:18.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.583+0000 7ff6d7e00640 1 -- 172.21.15.52:0/1116137376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c8031600 con 0x7ff6d806fed0 2024-06-02T16:45:18.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.583+0000 7ff6d7e00640 1 -- 172.21.15.52:0/1116137376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80319d0 con 0x7ff6d806fed0 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 -- 172.21.15.52:0/1116137376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 msgr2=0x7ff6d806f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/1116137376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d806f220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80b6440 tx=0x7ff6c802a6a0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 -- 172.21.15.52:0/1116137376 shutdown_connections 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/1116137376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d806f220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/1116137376 >> v2:172.21.15.114:3300/0 conn(0x7ff6d815d2d0 0x7ff6d80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 -- 172.21.15.52:0/1116137376 >> 172.21.15.52:0/1116137376 conn(0x7ff6d806c7a0 msgr2=0x7ff6d806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 -- 172.21.15.52:0/1116137376 shutdown_connections 2024-06-02T16:45:18.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.584+0000 7ff6dfe00640 1 -- 172.21.15.52:0/1116137376 wait complete. 2024-06-02T16:45:18.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.586+0000 7ff6dfe00640 1 Processor -- start 2024-06-02T16:45:18.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.586+0000 7ff6dfe00640 1 -- start start 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 0x7ff6d8150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 0x7ff6d8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d80741b0 con 0x7ff6d806fed0 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806ea20 con 0x7ff6d80d1450 2024-06-02T16:45:18.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dfe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d8156320 con 0x7ff6d815d2d0 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52934/0 (socket says 172.21.15.52:52934) 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dd400640 1 -- 172.21.15.52:0/3974549056 learned_addr learned my addr 172.21.15.52:0/3974549056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dca00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 0x7ff6d8150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dd400640 1 -- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 msgr2=0x7ff6d8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.587+0000 7ff6dde00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 0x7ff6d8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dd400640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 0x7ff6d8152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dd400640 1 -- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 msgr2=0x7ff6d8150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dd400640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 0x7ff6d8150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dd400640 1 -- 172.21.15.52:0/3974549056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8155710 con 0x7ff6d806fed0 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dca00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 0x7ff6d8150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dde00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 0x7ff6d8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:18.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dd400640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00d5f0 tx=0x7ff6cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0125f0 con 0x7ff6d806fed0 2024-06-02T16:45:18.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc019070 con 0x7ff6d806fed0 2024-06-02T16:45:18.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0129d0 con 0x7ff6d806fed0 2024-06-02T16:45:18.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81559f0 con 0x7ff6d806fed0 2024-06-02T16:45:18.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.588+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d8155fb0 con 0x7ff6d806fed0 2024-06-02T16:45:18.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.590+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d8069520 con 0x7ff6d806fed0 2024-06-02T16:45:18.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.591+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6cc012b70 con 0x7ff6d806fed0 2024-06-02T16:45:18.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.592+0000 7ff6d5600640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 0x7ff6bc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:18.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.592+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff6cc0979c0 con 0x7ff6d806fed0 2024-06-02T16:45:18.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.593+0000 7ff6dca00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 0x7ff6bc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:18.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.594+0000 7ff6dca00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 0x7ff6bc0787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8033000 tx=0x7ff6c8009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:18.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.596+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff6cc099e20 con 0x7ff6d806fed0 2024-06-02T16:45:18.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.812+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6d81585f0 con 0x7ff6d806fed0 2024-06-02T16:45:18.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.814+0000 7ff6d5600640 1 -- 172.21.15.52:0/3974549056 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7ff6cc061320 con 0x7ff6d806fed0 2024-06-02T16:45:18.815 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:18.815 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.817+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 msgr2=0x7ff6bc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.817+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 0x7ff6bc0787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8033000 tx=0x7ff6c8009000 comp rx=0 tx=0).stop 2024-06-02T16:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.817+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 msgr2=0x7ff6d80ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.817+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00d5f0 tx=0x7ff6cc00dab0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 shutdown_connections 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff6bc076300 0x7ff6bc0787c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff6d815d2d0 0x7ff6d8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6d80d1450 0x7ff6d8150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 --2- 172.21.15.52:0/3974549056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d806fed0 0x7ff6d80ccf20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 >> 172.21.15.52:0/3974549056 conn(0x7ff6d806c7a0 msgr2=0x7ff6d815dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 shutdown_connections 2024-06-02T16:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:18.818+0000 7ff6dfe00640 1 -- 172.21.15.52:0/3974549056 wait complete. 2024-06-02T16:45:18.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-02T16:45:18.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-02T16:45:18.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-02T16:45:18.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-02T16:45:18.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-02T16:45:18.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-02T16:45:18.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-02T16:45:18.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-02T16:45:19.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.142+0000 7fadb2800640 1 Processor -- start 2024-06-02T16:45:19.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.143+0000 7fadb2800640 1 -- start start 2024-06-02T16:45:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.145+0000 7fadb2800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 0x7fada40e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.145+0000 7fadb2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fada403c0a0 0x7fada4058050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.145+0000 7fadb2800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada4058590 con 0x7fada4053cb0 2024-06-02T16:45:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.145+0000 7fadb2800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fada4007b70 con 0x7fada403c0a0 2024-06-02T16:45:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.145+0000 7fadb2800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fada4058810 con 0x7fada40e3160 2024-06-02T16:45:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.146+0000 7fadb1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fada4053cb0 0x7fada4054120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:36486/0 (socket says 172.21.15.52:36486) 2024-06-02T16:45:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.146+0000 7fadb1e00640 1 -- 172.21.15.52:0/59065534 learned_addr learned my addr 172.21.15.52:0/59065534 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.146+0000 7fadb1400640 1 --2- 172.21.15.52:0/59065534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 0x7fada40e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.147+0000 7fadb0a00640 1 --2- 172.21.15.52:0/59065534 >> v2:172.21.15.114:3300/0 conn(0x7fada403c0a0 0x7fada4058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.147+0000 7fadb1400640 1 -- 172.21.15.52:0/59065534 >> v2:172.21.15.114:3300/0 conn(0x7fada403c0a0 msgr2=0x7fada4058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.147+0000 7fadb1400640 1 --2- 172.21.15.52:0/59065534 >> v2:172.21.15.114:3300/0 conn(0x7fada403c0a0 0x7fada4058050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.147+0000 7fadb1400640 1 -- 172.21.15.52:0/59065534 >> v1:172.21.15.114:6789/0 conn(0x7fada4053cb0 legacy=0x7fada4054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.147+0000 7fadb1400640 1 -- 172.21.15.52:0/59065534 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4058af0 con 0x7fada40e3160 2024-06-02T16:45:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.150+0000 7fadb1400640 1 --2- 172.21.15.52:0/59065534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 0x7fada40e7780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fada00097a0 tx=0x7fada0032910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964e51580645f128 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.150+0000 7f5eb4c00640 1 Processor -- start 2024-06-02T16:45:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.151+0000 7fadabe00640 1 -- 172.21.15.52:0/59065534 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada003c020 con 0x7fada40e3160 2024-06-02T16:45:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.151+0000 7fadabe00640 1 -- 172.21.15.52:0/59065534 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada0038810 con 0x7fada40e3160 2024-06-02T16:45:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.151+0000 7fadabe00640 1 -- 172.21.15.52:0/59065534 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0038c20 con 0x7fada40e3160 2024-06-02T16:45:19.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7fc815c00640 1 Processor -- start 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.151+0000 7f5eb4c00640 1 -- start start 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7f5eb4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 0x7f5eb00b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7f5eb4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5eb00d5f10 0x7f5eb00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7f5eb4c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb00b7b20 con 0x7f5eb0162ae0 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7f5eb4c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb00b7e00 con 0x7f5eb00b7130 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.153+0000 7f5eb4c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb006ee90 con 0x7f5eb00d5f10 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.154+0000 7f5ead400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5eb00d5f10 0x7f5eb00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.154+0000 7f5ead400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5eb00d5f10 0x7f5eb00b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52456/0 (socket says 172.21.15.52:52456) 2024-06-02T16:45:19.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.154+0000 7f5ead400640 1 -- 172.21.15.52:0/4213331116 learned_addr learned my addr 172.21.15.52:0/4213331116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.154+0000 7fc815c00640 1 -- start start 2024-06-02T16:45:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.154+0000 7f5eade00640 1 --2- 172.21.15.52:0/4213331116 >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 0x7f5eb00b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.155+0000 7fadb2800640 1 -- 172.21.15.52:0/59065534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 msgr2=0x7fada40e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.155+0000 7fadb2800640 1 --2- 172.21.15.52:0/59065534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 0x7fada40e7780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fada00097a0 tx=0x7fada0032910 comp rx=0 tx=0).stop 2024-06-02T16:45:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.155+0000 7f5ead400640 1 -- 172.21.15.52:0/4213331116 >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 msgr2=0x7f5eb00b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7fadb2800640 1 -- 172.21.15.52:0/59065534 shutdown_connections 2024-06-02T16:45:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7fadb2800640 1 --2- 172.21.15.52:0/59065534 >> v2:172.21.15.114:3300/0 conn(0x7fada403c0a0 0x7fada4058050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7fadb2800640 1 --2- 172.21.15.52:0/59065534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada40e3160 0x7fada40e7780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7fadb2800640 1 -- 172.21.15.52:0/59065534 >> 172.21.15.52:0/59065534 conn(0x7fada4058ee0 msgr2=0x7fada40592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7f5ead400640 1 --2- 172.21.15.52:0/4213331116 >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 0x7f5eb00b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7f5eaca00640 1 -- 172.21.15.52:0/4213331116 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700865942 0 0) 0x7f5eb00b7b20 con 0x7f5eb0162ae0 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7f5ead400640 1 -- 172.21.15.52:0/4213331116 >> v1:172.21.15.52:6789/0 conn(0x7f5eb0162ae0 legacy=0x7f5eb006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.156+0000 7f5ead400640 1 -- 172.21.15.52:0/4213331116 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb006f170 con 0x7f5eb00d5f10 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7f5eade00640 1 --2- 172.21.15.52:0/4213331116 >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 0x7f5eb00b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fc815c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8100d5f10 0x7fc8100b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fc815c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100b7b20 con 0x7fc8101631f0 2024-06-02T16:45:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7f7faea00640 1 Processor -- start 2024-06-02T16:45:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fc815c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc81006ee90 con 0x7fc8100b7130 2024-06-02T16:45:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fc815c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc8100b7e00 con 0x7fc8100d5f10 2024-06-02T16:45:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fadb2800640 1 -- 172.21.15.52:0/59065534 shutdown_connections 2024-06-02T16:45:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.157+0000 7fc80e000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc8101631f0 0x7fc8100cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51836/0 (socket says 172.21.15.52:51836) 2024-06-02T16:45:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.158+0000 7fc80e000640 1 -- 172.21.15.52:0/393061845 learned_addr learned my addr 172.21.15.52:0/393061845 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.158+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> v2:172.21.15.52:3300/0 conn(0x7fc8100d5f10 0x7fc8100b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.158+0000 7fadb2800640 1 -- 172.21.15.52:0/59065534 wait complete. 2024-06-02T16:45:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.158+0000 7f7faea00640 1 -- start start 2024-06-02T16:45:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.159+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851343258 0 0) 0x7fc8100b7b20 con 0x7fc8101631f0 2024-06-02T16:45:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.159+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7f4003520 con 0x7fc8101631f0 2024-06-02T16:45:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7faea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7faea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fa80d5f10 0x7f7fa80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.159+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891088233 0 0) 0x7fc81006ee90 con 0x7fc8100b7130 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.159+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8100b7b20 con 0x7fc8100b7130 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7faea00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa80b7b20 con 0x7f7fa8162ae0 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7faea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa80b7e00 con 0x7f7fa80d5f10 2024-06-02T16:45:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7faea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa806ee90 con 0x7f7fa80b7130 2024-06-02T16:45:19.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fadb2800640 1 Processor -- start 2024-06-02T16:45:19.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f5ead400640 1 --2- 172.21.15.52:0/4213331116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d5f10 0x7f5eb00b42b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5eb008e040 tx=0x7f5e9c02a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92037019f7909ba server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7fa7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4121056952 0 0) 0x7fc7f4003520 con 0x7fc8101631f0 2024-06-02T16:45:19.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 >> v2:172.21.15.52:3300/0 conn(0x7fc8100d5f10 msgr2=0x7fc8100b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7fa7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56282/0 (socket says 172.21.15.52:56282) 2024-06-02T16:45:19.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7f7fa7e00640 1 -- 172.21.15.52:0/3164086732 learned_addr learned my addr 172.21.15.52:0/3164086732 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fadb2800640 1 -- start start 2024-06-02T16:45:19.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 --2- 172.21.15.52:0/393061845 >> v2:172.21.15.52:3300/0 conn(0x7fc8100d5f10 0x7fc8100b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 >> v1:172.21.15.114:6789/0 conn(0x7fc8100b7130 legacy=0x7fc810162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81006f170 con 0x7fc8101631f0 2024-06-02T16:45:19.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fc7fc0016f0 con 0x7fc8101631f0 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 >> v1:172.21.15.52:6789/0 conn(0x7fc8101631f0 legacy=0x7fc8100cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7f4004c90 0x7fc7f4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7f40037a0 0x7fc7f4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc7f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100b7e00 con 0x7fc7f40037a0 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f400c190 con 0x7fc7f40041d0 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.160+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f400c390 con 0x7fc7f4004c90 2024-06-02T16:45:19.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f5eaca00640 1 -- 172.21.15.52:0/4213331116 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c037070 con 0x7f5eb00d5f10 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f7fa7e00640 1 -- 172.21.15.52:0/3164086732 >> v2:172.21.15.114:3300/0 conn(0x7f7fa80d5f10 msgr2=0x7f7fa80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f7fa7e00640 1 --2- 172.21.15.52:0/3164086732 >> v2:172.21.15.114:3300/0 conn(0x7f7fa80d5f10 0x7f7fa80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f7fa7e00640 1 -- 172.21.15.52:0/3164086732 >> v1:172.21.15.114:6789/0 conn(0x7f7fa8162ae0 legacy=0x7f7fa806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f7fa7e00640 1 -- 172.21.15.52:0/3164086732 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa806f170 con 0x7f7fa80b7130 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f5eaca00640 1 -- 172.21.15.52:0/4213331116 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c032440 con 0x7f5eb00d5f10 2024-06-02T16:45:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7f5eaca00640 1 -- 172.21.15.52:0/4213331116 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c032810 con 0x7f5eb00d5f10 2024-06-02T16:45:19.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.161+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> v2:172.21.15.52:3300/0 conn(0x7fc8100d5f10 0x7fc8100b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:19.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc7f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 0x7fada40e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fada4053cb0 0x7fada40d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fc80e000640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7f40037a0 0x7fc7f4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fc80ea00640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7f4004c90 0x7fc7f4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7f5eb4c00640 1 -- 172.21.15.52:0/4213331116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d5f10 msgr2=0x7f5eb00b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7f5eb4c00640 1 --2- 172.21.15.52:0/4213331116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d5f10 0x7f5eb00b42b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5eb008e040 tx=0x7f5e9c02a1f0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada40e3160 0x7fada404ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fada40e3540 con 0x7fada4053cb0 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fada4006640 con 0x7fada40e3160 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.162+0000 7fadb2800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fada4006b60 con 0x7fada403c0a0 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fadb1400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 0x7fada40e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fadb1400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 0x7fada40e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56296/0 (socket says 172.21.15.52:56296) 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fadb1400640 1 -- 172.21.15.52:0/628436333 learned_addr learned my addr 172.21.15.52:0/628436333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fadb0a00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fada4053cb0 0x7fada40d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fadb1400640 1 -- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada40e3160 msgr2=0x7fada404ffb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T16:45:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7f7fa7e00640 1 --2- 172.21.15.52:0/3164086732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009870 tx=0x7f7f9802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad38fafe3afec3a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fadb1400640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada40e3160 0x7fada404ffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fc80f400640 1 -- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7f4004c90 msgr2=0x7fc7f4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7f4004c90 0x7fc7f4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fc80f400640 1 -- 172.21.15.52:0/393061845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7f40037a0 msgr2=0x7fc7f4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7f40037a0 0x7fc7f4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.163+0000 7fc80f400640 1 -- 172.21.15.52:0/393061845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81006f170 con 0x7fc7f40041d0 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fc80f400640 1 -- 172.21.15.52:0/393061845 reap_dead start 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 -- 172.21.15.52:0/4213331116 shutdown_connections 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 --2- 172.21.15.52:0/4213331116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d5f10 0x7f5eb00b42b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 --2- 172.21.15.52:0/4213331116 >> v2:172.21.15.52:3300/0 conn(0x7f5eb00b7130 0x7f5eb00b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 -- 172.21.15.52:0/4213331116 >> 172.21.15.52:0/4213331116 conn(0x7f5eb008cf50 msgr2=0x7f5eb00d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fadb1400640 1 -- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fada4053cb0 msgr2=0x7fada40d87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fadb1400640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fada4053cb0 0x7fada40d87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fadb1400640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4052240 con 0x7fada403c0a0 2024-06-02T16:45:19.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fadb0a00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fada4053cb0 0x7fada40d87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:19.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7fc80f400640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc7f400b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc80800e320 tx=0x7fc7f4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcff4307411a0c51 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 -- 172.21.15.52:0/4213331116 shutdown_connections 2024-06-02T16:45:19.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f5eb4c00640 1 -- 172.21.15.52:0/4213331116 wait complete. 2024-06-02T16:45:19.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.164+0000 7f7fa6a00640 1 -- 172.21.15.52:0/3164086732 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98037070 con 0x7f7fa80b7130 2024-06-02T16:45:19.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.165+0000 7f7fa6a00640 1 -- 172.21.15.52:0/3164086732 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98032440 con 0x7f7fa80b7130 2024-06-02T16:45:19.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.165+0000 7f7fa6a00640 1 -- 172.21.15.52:0/3164086732 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98032810 con 0x7f7fa80b7130 2024-06-02T16:45:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.165+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808009de0 con 0x7fc7f40041d0 2024-06-02T16:45:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fadb1400640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 0x7fada40e5f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fada003b040 tx=0x7fada00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.165+0000 7fc80d600640 1 -- 172.21.15.52:0/393061845 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc808003b90 con 0x7fc7f40041d0 2024-06-02T16:45:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 -- 172.21.15.52:0/3164086732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 msgr2=0x7f7fa80b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 --2- 172.21.15.52:0/3164086732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009870 tx=0x7f7f9802a130 comp rx=0 tx=0).stop 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fc815c00640 1 -- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 msgr2=0x7fc7f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fc815c00640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc7f400b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc80800e320 tx=0x7fc7f4005830 comp rx=0 tx=0).stop 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 -- 172.21.15.52:0/3164086732 shutdown_connections 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 --2- 172.21.15.52:0/3164086732 >> v2:172.21.15.114:3300/0 conn(0x7f7fa80d5f10 0x7f7fa80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 --2- 172.21.15.52:0/3164086732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa80b7130 0x7f7fa80b7510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 -- 172.21.15.52:0/3164086732 >> 172.21.15.52:0/3164086732 conn(0x7f7fa808cf50 msgr2=0x7f7fa80d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada004c3f0 con 0x7fada403c0a0 2024-06-02T16:45:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada004c5b0 con 0x7fada403c0a0 2024-06-02T16:45:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada004c9a0 con 0x7fada403c0a0 2024-06-02T16:45:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.166+0000 7f7faea00640 1 -- 172.21.15.52:0/3164086732 shutdown_connections 2024-06-02T16:45:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7f7faea00640 1 -- 172.21.15.52:0/3164086732 wait complete. 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada4052520 con 0x7fada403c0a0 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fada40d8d00 con 0x7fada403c0a0 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7fc815c00640 1 -- 172.21.15.52:0/393061845 shutdown_connections 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7fc815c00640 1 --2- 172.21.15.52:0/393061845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc7f400b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7fc815c00640 1 -- 172.21.15.52:0/393061845 >> 172.21.15.52:0/393061845 conn(0x7fc81008cf50 msgr2=0x7fc8100d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7f5eb4c00640 1 Processor -- start 2024-06-02T16:45:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.167+0000 7f5eb4c00640 1 -- start start 2024-06-02T16:45:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fada4005390 con 0x7fada403c0a0 2024-06-02T16:45:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f9021200640 1 Processor -- start 2024-06-02T16:45:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f7be9e00640 1 Processor -- start 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f5eb4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 0x7f5eb015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f5eb4c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5eb00d5f10 0x7f5eb00cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f5eb4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb0162ae0 0x7f5eb00ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eb4c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb00d0ed0 con 0x7f5eb00b7130 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eb4c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb00b49f0 con 0x7f5eb0162ae0 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eb4c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb00d1050 con 0x7f5eb00d5f10 2024-06-02T16:45:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f7faea00640 1 Processor -- start 2024-06-02T16:45:19.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eade00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 0x7f5eb015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f7faea00640 1 -- start start 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eade00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 0x7f5eb015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52968/0 (socket says 172.21.15.52:52968) 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.169+0000 7f5eade00640 1 -- 172.21.15.52:0/852803622 learned_addr learned my addr 172.21.15.52:0/852803622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5ead400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5eb00d5f10 0x7f5eb00cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eae800640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb0162ae0 0x7f5eb00ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eade00640 1 -- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5eb00d5f10 msgr2=0x7f5eb00cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eade00640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5eb00d5f10 0x7f5eb00cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eade00640 1 -- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb0162ae0 msgr2=0x7f5eb00ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eade00640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb0162ae0 0x7f5eb00ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f5eade00640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb0070360 con 0x7f5eb00b7130 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f7be9e00640 1 -- start start 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f7be9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be40b4bc0 0x7f7be40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f7be9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 0x7f7be406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f7be9e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40b47f0 con 0x7f7be40b3ed0 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f7be9e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7be4073460 con 0x7f7be40738f0 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.170+0000 7f7be9e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7be4072850 con 0x7f7be40b4bc0 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7fc815c00640 1 -- 172.21.15.52:0/393061845 shutdown_connections 2024-06-02T16:45:19.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7fc815c00640 1 -- 172.21.15.52:0/393061845 wait complete. 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.168+0000 7f9021200640 1 -- start start 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f9021200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f901c0b3ed0 0x7f901c164910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f9021200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 0x7f901c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f9021200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901c164e50 con 0x7f901c0738f0 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f9021200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f901c073460 con 0x7f901c0b4bc0 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f9021200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f901c0b47f0 con 0x7f901c0b3ed0 2024-06-02T16:45:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f5eade00640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 0x7f5eb015abd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ebe0 tx=0x7f5ea000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.171+0000 7f7faea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 0x7f7fa80b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7be3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 0x7f7be406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7be3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 0x7f7be406eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52978/0 (socket says 172.21.15.52:52978) 2024-06-02T16:45:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7be3400640 1 -- 172.21.15.52:0/2715727770 learned_addr learned my addr 172.21.15.52:0/2715727770 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7faea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa80d5f10 0x7f7fa80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f9019400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 0x7f901c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7faea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa8162ae0 0x7f7fa81f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f9019400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 0x7f901c0b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52986/0 (socket says 172.21.15.52:52986) 2024-06-02T16:45:19.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f9019400640 1 -- 172.21.15.52:0/376933673 learned_addr learned my addr 172.21.15.52:0/376933673 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7be2000640 1 --2- 172.21.15.52:0/2715727770 >> v2:172.21.15.114:3300/0 conn(0x7f7be40b4bc0 0x7f7be40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7faea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa80d0ed0 con 0x7f7fa80d5f10 2024-06-02T16:45:19.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f7fa7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 0x7f7fa80b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.172+0000 7f9019e00640 1 --2- 172.21.15.52:0/376933673 >> v2:172.21.15.114:3300/0 conn(0x7f901c0b3ed0 0x7f901c164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7faea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa80b49f0 con 0x7f7fa80b7130 2024-06-02T16:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7faea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa80d1050 con 0x7f7fa8162ae0 2024-06-02T16:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7fa7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 0x7f7fa80b80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52506/0 (socket says 172.21.15.52:52506) 2024-06-02T16:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7fa7e00640 1 -- 172.21.15.52:0/588907044 learned_addr learned my addr 172.21.15.52:0/588907044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7faca00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa8162ae0 0x7f7fa81f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x7f5eb00b7130 2024-06-02T16:45:19.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea000cc30 con 0x7f5eb00b7130 2024-06-02T16:45:19.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7be2000640 1 -- 172.21.15.52:0/2715727770 >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 msgr2=0x7f7be406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f5eb4c00640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb0073460 con 0x7f5eb00b7130 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7fa7400640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa80d5f10 0x7f7fa80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f7fa7e00640 1 -- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa8162ae0 msgr2=0x7f7fa81f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f7fa7e00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7fa8162ae0 0x7f7fa81f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f7fa7e00640 1 -- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa80d5f10 msgr2=0x7f7fa80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7fc815c00640 1 Processor -- start 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7be2000640 1 --2- 172.21.15.52:0/2715727770 >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 0x7f7be406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.173+0000 7f7be2000640 1 -- 172.21.15.52:0/2715727770 >> v1:172.21.15.52:6789/0 conn(0x7f7be40b3ed0 legacy=0x7f7be4164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f7fa7e00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa80d5f10 0x7f7fa80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f7fa7e00640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa80c9bf0 con 0x7f7fa80b7130 2024-06-02T16:45:19.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f5eb4c00640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb00b9650 con 0x7f5eb00b7130 2024-06-02T16:45:19.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0013470 con 0x7f5eb00b7130 2024-06-02T16:45:19.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f7be2000640 1 -- 172.21.15.52:0/2715727770 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be4072b30 con 0x7f7be40b4bc0 2024-06-02T16:45:19.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f9019e00640 1 -- 172.21.15.52:0/376933673 >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 msgr2=0x7f901c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f9019e00640 1 --2- 172.21.15.52:0/376933673 >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 0x7f901c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f9019e00640 1 -- 172.21.15.52:0/376933673 >> v1:172.21.15.52:6789/0 conn(0x7f901c0738f0 legacy=0x7f901c06eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7fc815c00640 1 -- start start 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fe164600640 1 Processor -- start 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc81015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8100bae40 0x7fc8100cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81015ea50 0x7fc8100b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100d4270 con 0x7fc81015ea50 2024-06-02T16:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100b49f0 con 0x7fc7f40041d0 2024-06-02T16:45:19.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc815c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc8100d43f0 con 0x7fc8100bae40 2024-06-02T16:45:19.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7f7be2000640 1 --2- 172.21.15.52:0/2715727770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b4bc0 0x7f7be40b42b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7be40724d0 tx=0x7f7bd002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f173b48600d68a8a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.174+0000 7f9019e00640 1 -- 172.21.15.52:0/376933673 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c072850 con 0x7f901c0b3ed0 2024-06-02T16:45:19.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f5eb4c00640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5eb0069520 con 0x7f5eb00b7130 2024-06-02T16:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f9019e00640 1 --2- 172.21.15.52:0/376933673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0b3ed0 0x7f901c164910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f901c074670 tx=0x7f900c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880d13a784d8bc04 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f7fa7e00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 0x7f7fa80b80f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009870 tx=0x7f7f980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fc80f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81015ea50 0x7fc8100b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.175+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fada0053060 con 0x7fada403c0a0 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fada9600640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad8c076300 0x7fad8c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fada00c0c00 con 0x7fada403c0a0 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fada9600640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fad8c07e520 0x7fad8c080940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad8c080ff0 con 0x7fad8c07e520 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fada00c0ff0 con 0x7fada403c0a0 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fadb0a00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad8c076300 0x7fad8c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fc80ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc81015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fc80ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc81015a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52520/0 (socket says 172.21.15.52:52520) 2024-06-02T16:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fc80ea00640 1 -- 172.21.15.52:0/1025951707 learned_addr learned my addr 172.21.15.52:0/1025951707 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7fc80e000640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8100bae40 0x7fc8100cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f7be1600640 1 -- 172.21.15.52:0/2715727770 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0037070 con 0x7f7be40b4bc0 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f7be1600640 1 -- 172.21.15.52:0/2715727770 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd0032440 con 0x7f7be40b4bc0 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f7be1600640 1 -- 172.21.15.52:0/2715727770 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0032810 con 0x7f7be40b4bc0 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.177+0000 7f9018a00640 1 -- 172.21.15.52:0/376933673 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c037070 con 0x7f901c0b3ed0 2024-06-02T16:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f9018a00640 1 -- 172.21.15.52:0/376933673 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c032440 con 0x7f901c0b3ed0 2024-06-02T16:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f9018a00640 1 -- 172.21.15.52:0/376933673 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c032850 con 0x7f901c0b3ed0 2024-06-02T16:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80ea00640 1 -- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8100bae40 msgr2=0x7fc8100cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80ea00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8100bae40 0x7fc8100cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80ea00640 1 -- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81015ea50 msgr2=0x7fc8100b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f7be9e00640 1 -- 172.21.15.52:0/2715727770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b4bc0 msgr2=0x7f7be40b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f7be9e00640 1 --2- 172.21.15.52:0/2715727770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b4bc0 0x7f7be40b42b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7be40724d0 tx=0x7f7bd002a1a0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80ea00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81015ea50 0x7fc8100b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98041070 con 0x7f7fa80b7130 2024-06-02T16:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9803c870 con 0x7f7fa80b7130 2024-06-02T16:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98037040 con 0x7f7fa80b7130 2024-06-02T16:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80ea00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81015f330 con 0x7fc7f40041d0 2024-06-02T16:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.178+0000 7fc80f400640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc81015ea50 0x7fc8100b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fadb1e00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fad8c07e520 0x7fad8c080940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.176+0000 7fe164600640 1 -- start start 2024-06-02T16:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe164600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0738f0 0x7fe15c06eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f9021200640 1 -- 172.21.15.52:0/376933673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0b3ed0 msgr2=0x7f901c164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe164600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c072850 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe164600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c072b30 con 0x7fe15c0b4bc0 2024-06-02T16:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe164600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c073460 con 0x7fe15c0738f0 2024-06-02T16:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f9021200640 1 --2- 172.21.15.52:0/376933673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0b3ed0 0x7f901c164910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f901c074670 tx=0x7f900c02a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 -- 172.21.15.52:0/2715727770 shutdown_connections 2024-06-02T16:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 --2- 172.21.15.52:0/2715727770 >> v2:172.21.15.52:3300/0 conn(0x7f7be40738f0 0x7f7be406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7faea00640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa80c9ec0 con 0x7f7fa80b7130 2024-06-02T16:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 --2- 172.21.15.52:0/2715727770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b4bc0 0x7f7be40b42b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 -- 172.21.15.52:0/2715727770 >> 172.21.15.52:0/2715727770 conn(0x7f7be40b3200 msgr2=0x7f7be40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7faea00640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa80ca480 con 0x7f7fa80b7130 2024-06-02T16:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fc80ea00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc81015a3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc80000e7e0 tx=0x7fc80000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 -- 172.21.15.52:0/2715727770 shutdown_connections 2024-06-02T16:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe161c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe15c0b3ed0 0x7fe15c164910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51850/0 (socket says 172.21.15.52:51850) 2024-06-02T16:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7f7be9e00640 1 -- 172.21.15.52:0/2715727770 wait complete. 2024-06-02T16:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.179+0000 7fe161c00640 1 -- 172.21.15.52:0/1861380534 learned_addr learned my addr 172.21.15.52:0/1861380534 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fe162600640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0738f0 0x7fe15c06eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fadb0a00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad8c076300 0x7fad8c0787c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fada4178960 tx=0x7fad98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033031179 0 0) 0x7fe15c072850 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe144003520 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800001d30 con 0x7fc7f40041d0 2024-06-02T16:45:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8000050d0 con 0x7fc7f40041d0 2024-06-02T16:45:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000052c0 con 0x7fc7f40041d0 2024-06-02T16:45:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7f9021200640 1 -- 172.21.15.52:0/376933673 shutdown_connections 2024-06-02T16:45:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7f9021200640 1 --2- 172.21.15.52:0/376933673 >> v2:172.21.15.52:3300/0 conn(0x7f901c0b4bc0 0x7f901c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ea001a070 con 0x7f5eb00b7130 2024-06-02T16:45:19.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.180+0000 7f9021200640 1 --2- 172.21.15.52:0/376933673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0b3ed0 0x7f901c164910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7f9021200640 1 -- 172.21.15.52:0/376933673 >> 172.21.15.52:0/376933673 conn(0x7f901c0b3200 msgr2=0x7f901c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8100b4e40 con 0x7fc7f40041d0 2024-06-02T16:45:19.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f7c001030 con 0x7f7fa80b7130 2024-06-02T16:45:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8100b5400 con 0x7fc7f40041d0 2024-06-02T16:45:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.181+0000 7fadb1e00640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fad8c07e520 0x7fad8c080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733350998 0 0) 0x7fe15c072b30 con 0x7fe15c0b4bc0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe15c072850 con 0x7fe15c0b4bc0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753597345 0 0) 0x7fe144003520 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0738f0 msgr2=0x7fe15c06eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0738f0 0x7fe15c06eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 >> v1:172.21.15.114:6789/0 conn(0x7fe15c0b4bc0 legacy=0x7fe15c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c072e10 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fe1540019f0 con 0x7fe15c0b3ed0 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 >> v1:172.21.15.52:6789/0 conn(0x7fe15c0b3ed0 legacy=0x7fe15c164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe144003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe144004800 0x7fe144004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1440051c0 0x7fe14400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c073460 con 0x7fe144003bc0 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe14400bfb0 con 0x7fe144004800 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe14400c180 con 0x7fe1440051c0 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7f9021200640 1 -- 172.21.15.52:0/376933673 shutdown_connections 2024-06-02T16:45:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7f7be9e00640 1 Processor -- start 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f7be9e00640 1 -- start start 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7f5ea6000640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5e90076320 0x7f5e900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.182+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ea0097970 con 0x7f5eb00b7130 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f5ea6000640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7f5e9007e520 0x7f5e90080940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea0016ec0 con 0x7f5e9007e520 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5ea0097e00 con 0x7f5eb00b7130 2024-06-02T16:45:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7fe161200640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe144004800 0x7fe144004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f5eae800640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7f5e9007e520 0x7f5e90080940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7fe161c00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe144003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7f9021200640 1 -- 172.21.15.52:0/376933673 wait complete. 2024-06-02T16:45:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== osd.0 v2:172.21.15.52:6817/3406856297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad8c080ff0 con 0x7fad8c07e520 2024-06-02T16:45:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.183+0000 7fe162600640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1440051c0 0x7fe14400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fe161c00640 1 -- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1440051c0 msgr2=0x7fe14400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f5ead400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5e90076320 0x7f5e900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f5eae800640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7f5e9007e520 0x7f5e90080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fe161c00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1440051c0 0x7fe14400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fe161c00640 1 -- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe144004800 msgr2=0x7fe144004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fe161c00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe144004800 0x7fe144004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fe161c00640 1 -- 172.21.15.52:0/1861380534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c072e10 con 0x7fe144003bc0 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40738f0 0x7f7be4147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b3ed0 0x7f7be4147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be40b4bc0 0x7f7be414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4072520 con 0x7f7be40b4bc0 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40730f0 con 0x7f7be40b3ed0 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7be9e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7be4073d20 con 0x7f7be40738f0 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f98044070 con 0x7f7fa80b7130 2024-06-02T16:45:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7fe161c00640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe144003fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe15400a7b0 tx=0x7fe144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4003168a166dd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== osd.1 v2:172.21.15.52:6809/2484681760 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea0016ec0 con 0x7f5e9007e520 2024-06-02T16:45:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7f9fe00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7f880763a0 0x7f7f88078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7f980b8370 con 0x7f7fa80b7130 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40738f0 0x7f7be4147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7be3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be40b4bc0 0x7f7be414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.184+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc81015a8e0 con 0x7fc7f40041d0 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7f9fe00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7f7f8807e5c0 0x7f7f880809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f98067e80 con 0x7f7f8807e5c0 2024-06-02T16:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7f980b8760 con 0x7f7fa80b7130 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f9021200640 1 Processor -- start 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7f6ba8400640 1 Processor -- start 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400a3d0 con 0x7fe144003bc0 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7be2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b3ed0 0x7f7be4147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40738f0 0x7f7be4147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56348/0 (socket says 172.21.15.52:56348) 2024-06-02T16:45:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.186+0000 7f7be2a00640 1 -- 172.21.15.52:0/763670608 learned_addr learned my addr 172.21.15.52:0/763670608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15402f070 con 0x7fe144003bc0 2024-06-02T16:45:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7fe15be00640 1 -- 172.21.15.52:0/1861380534 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400a3d0 con 0x7fe144003bc0 2024-06-02T16:45:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7f7fa7400640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7f880763a0 0x7f7f88078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7f7faca00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7f7f8807e5c0 0x7f7f880809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7f6ba8400640 1 -- start start 2024-06-02T16:45:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7be2000640 1 -- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40738f0 msgr2=0x7f7be4147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7be2000640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40738f0 0x7f7be4147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7faca00640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7f7f8807e5c0 0x7f7f880809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7be2000640 1 -- 172.21.15.52:0/763670608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be40b4bc0 msgr2=0x7f7be414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7be2000640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be40b4bc0 0x7f7be414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f7be2000640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be4146580 con 0x7f7be40b3ed0 2024-06-02T16:45:19.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7f9021200640 1 -- start start 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0738f0 0x7f901c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f901c0b3ed0 0x7f901c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 0x7f901c147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f901c0730f0 con 0x7f901c0b4bc0 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f901c072e10 con 0x7f901c0738f0 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7f9021200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f901c072520 con 0x7f901c0b3ed0 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.187+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc80001a020 con 0x7fc7f40041d0 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.188+0000 7fc806a00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc7f0076470 0x7fc7f0078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc800097580 con 0x7fc7f40041d0 2024-06-02T16:45:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f7be2000640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b3ed0 0x7f7be4147ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0031000 tx=0x7f7bd00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7fc806a00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fc7f007e690 0x7fc7f0080ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc800001d30 con 0x7fc7f007e690 2024-06-02T16:45:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc800097970 con 0x7fc7f40041d0 2024-06-02T16:45:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f901a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 0x7f901c147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f5ead400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5e90076320 0x7f5e900787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c034000 tx=0x7f5e9c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f7fa7400640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7f880763a0 0x7f7f88078860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80cbb50 tx=0x7f7f94009110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7fc80f400640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fc7f007e690 0x7fc7f0080ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f901a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 0x7f901c147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53050/0 (socket says 172.21.15.52:53050) 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f901a800640 1 -- 172.21.15.52:0/696127410 learned_addr learned my addr 172.21.15.52:0/696127410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f9019e00640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0738f0 0x7f901c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f6ba8400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ba00b3ed0 0x7f6ba0164910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f6ba8400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ba00738f0 0x7f6ba006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f6ba8400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba0164e50 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f6ba8400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba0073460 con 0x7f6ba00b3ed0 2024-06-02T16:45:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f6ba8400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba0072850 con 0x7f6ba00738f0 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 -- 172.21.15.52:0/1861380534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 msgr2=0x7fe144003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 --2- 172.21.15.52:0/1861380534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe144003fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe15400a7b0 tx=0x7fe144005830 comp rx=0 tx=0).stop 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe162600640 1 -- 172.21.15.52:0/1861380534 reap_dead start 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.189+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== osd.2 v2:172.21.15.52:6800/1994685313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f98067e80 con 0x7f7f8807e5c0 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f901a800640 1 -- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f901c0b3ed0 msgr2=0x7f901c14ced0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T16:45:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f9019400640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f901c0b3ed0 0x7f901c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0041030 con 0x7f7be40b3ed0 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd0030500 con 0x7f7be40b3ed0 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0037040 con 0x7f7be40b3ed0 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 -- 172.21.15.52:0/1861380534 shutdown_connections 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 -- 172.21.15.52:0/1861380534 >> 172.21.15.52:0/1861380534 conn(0x7fe15c0b3200 msgr2=0x7fe15c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 -- 172.21.15.52:0/1861380534 shutdown_connections 2024-06-02T16:45:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fe164600640 1 -- 172.21.15.52:0/1861380534 wait complete. 2024-06-02T16:45:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fc80e000640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc7f0076470 0x7fc7f0078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f901a800640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f901c0b3ed0 0x7f901c14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f901a800640 1 -- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0738f0 msgr2=0x7f901c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f7be9e00640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be4146860 con 0x7f7be40b3ed0 2024-06-02T16:45:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f7be9e00640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be4146e20 con 0x7f7be40b3ed0 2024-06-02T16:45:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f6ba6400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ba00738f0 0x7f6ba006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f6ba6400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ba00738f0 0x7f6ba006eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52532/0 (socket says 172.21.15.52:52532) 2024-06-02T16:45:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7f6ba6400640 1 -- 172.21.15.52:0/2306362099 learned_addr learned my addr 172.21.15.52:0/2306362099 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.190+0000 7fc80f400640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fc7f007e690 0x7fc7f0080ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== osd.3 v2:172.21.15.52:6808/3679883112 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc800001d30 con 0x7fc7f007e690 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f901a800640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0738f0 0x7f901c14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.192+0000 7f901a800640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1485b0 con 0x7f901c0b4bc0 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.192+0000 7f9019e00640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f901c0738f0 0x7f901c14c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.192+0000 7f901a800640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 0x7f901c147840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f900400c3f0 tx=0x7f900400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.192+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004017070 con 0x7f901c0b4bc0 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f6ba6400640 1 -- 172.21.15.52:0/2306362099 >> v2:172.21.15.52:3300/0 conn(0x7f6ba00b3ed0 msgr2=0x7f6ba0164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f6ba6400640 1 --2- 172.21.15.52:0/2306362099 >> v2:172.21.15.52:3300/0 conn(0x7f6ba00b3ed0 0x7f6ba0164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f6ba6400640 1 -- 172.21.15.52:0/2306362099 >> v1:172.21.15.114:6789/0 conn(0x7f6ba00b4bc0 legacy=0x7f6ba00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.191+0000 7f6ba6400640 1 -- 172.21.15.52:0/2306362099 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba0072b30 con 0x7f6ba00738f0 2024-06-02T16:45:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.192+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bb8001030 con 0x7f7be40b3ed0 2024-06-02T16:45:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.193+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90040052d0 con 0x7f901c0b4bc0 2024-06-02T16:45:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7fc80e000640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc7f0076470 0x7fc7f0078930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000c00 tx=0x7fc7fc007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c14b430 con 0x7f901c0b4bc0 2024-06-02T16:45:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7f6ba6400640 1 --2- 172.21.15.52:0/2306362099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba006eb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00cd040 tx=0x7f6b9802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1670f3e64bdbb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c14a950 con 0x7f901c0b4bc0 2024-06-02T16:45:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.195+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004003830 con 0x7f901c0b4bc0 2024-06-02T16:45:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ff4001030 con 0x7f901c0b4bc0 2024-06-02T16:45:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7f6b9fe00640 1 -- 172.21.15.52:0/2306362099 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98037070 con 0x7f6ba00738f0 2024-06-02T16:45:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7f6b9fe00640 1 -- 172.21.15.52:0/2306362099 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b98032440 con 0x7f6ba00738f0 2024-06-02T16:45:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7f6b9fe00640 1 -- 172.21.15.52:0/2306362099 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980327f0 con 0x7f6ba00738f0 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7fe164600640 1 Processor -- start 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.194+0000 7fe164600640 1 -- start start 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe15c160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15c1fbe20 0x7fe15c202770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0cfce0 0x7fe15c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c073d80 con 0x7fe144003bc0 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c072520 con 0x7fe15c1fbe20 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe164600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c15e200 con 0x7fe15c0cfce0 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.196+0000 7fe161c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe15c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe15c160860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53070/0 (socket says 172.21.15.52:53070) 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 -- 172.21.15.52:0/1260575206 learned_addr learned my addr 172.21.15.52:0/1260575206 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161200640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15c1fbe20 0x7fe15c202770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 -- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0cfce0 msgr2=0x7fe15c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15c0cfce0 0x7fe15c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 -- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15c1fbe20 msgr2=0x7fe15c202770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15c1fbe20 0x7fe15c202770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7fe161c00640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c15f830 con 0x7fe144003bc0 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7f6ba8400640 1 -- 172.21.15.52:0/2306362099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 msgr2=0x7f6ba006eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7f6ba8400640 1 --2- 172.21.15.52:0/2306362099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba006eb40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00cd040 tx=0x7f6b9802a200 comp rx=0 tx=0).stop 2024-06-02T16:45:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.197+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7bd0044070 con 0x7f7be40b3ed0 2024-06-02T16:45:19.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.198+0000 7fe161c00640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe15c160860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe15400a8d0 tx=0x7fe154001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f900401a070 con 0x7f901c0b4bc0 2024-06-02T16:45:19.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154044070 con 0x7fe144003bc0 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 -- 172.21.15.52:0/2306362099 shutdown_connections 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 --2- 172.21.15.52:0/2306362099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba006eb40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 --2- 172.21.15.52:0/2306362099 >> v2:172.21.15.52:3300/0 conn(0x7f6ba00b3ed0 0x7f6ba0164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 -- 172.21.15.52:0/2306362099 >> 172.21.15.52:0/2306362099 conn(0x7f6ba00b3200 msgr2=0x7f6ba00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 -- 172.21.15.52:0/2306362099 shutdown_connections 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe154004b60 con 0x7fe144003bc0 2024-06-02T16:45:19.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400a3d0 con 0x7fe144003bc0 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f7bdb400640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7bc4076300 0x7f7bc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd00b7b10 con 0x7f7be40b3ed0 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f7bdb400640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f7bc407e520 0x7f7bc4080940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.200+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bd003ee50 con 0x7f7bc407e520 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.200+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7bd00bc2a0 con 0x7f7be40b3ed0 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.200+0000 7f7be2a00640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7bc4076300 0x7f7bc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.200+0000 7f9012000640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ff80762d0 0x7f8ff8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.200+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9004097030 con 0x7f901c0b4bc0 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7f9012000640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7f8ff807e4d0 0x7f8ff80808f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ff8080fa0 con 0x7f8ff807e4d0 2024-06-02T16:45:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f90040974c0 con 0x7f901c0b4bc0 2024-06-02T16:45:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7f7be3400640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f7bc407e520 0x7f7bc4080940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c15faa0 con 0x7fe144003bc0 2024-06-02T16:45:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.201+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c160060 con 0x7fe144003bc0 2024-06-02T16:45:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.199+0000 7f6ba8400640 1 -- 172.21.15.52:0/2306362099 wait complete. 2024-06-02T16:45:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.202+0000 7f7be2a00640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7bc4076300 0x7f7bc40787c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0012e0 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.202+0000 7f6ba8400640 1 Processor -- start 2024-06-02T16:45:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.202+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe15c069520 con 0x7fe144003bc0 2024-06-02T16:45:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.202+0000 7f6ba8400640 1 -- start start 2024-06-02T16:45:19.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.203+0000 7f9019e00640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ff80762d0 0x7f8ff8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.203+0000 7f9019400640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7f8ff807e4d0 0x7f8ff80808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.203+0000 7f6ba8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f7be3400640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f7bc407e520 0x7f7bc4080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f6ba8400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6ba00b3ed0 0x7f6ba009cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f6ba8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ba00b4bc0 0x7f6ba009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f6ba8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0072520 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f6ba8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00730f0 con 0x7f6ba00738f0 2024-06-02T16:45:19.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f6ba8400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba0073d40 con 0x7f6ba00b3ed0 2024-06-02T16:45:19.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.204+0000 7f9019e00640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ff80762d0 0x7f8ff8078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f900c034000 tx=0x7f900c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba5000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6ba00b3ed0 0x7f6ba009cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba5000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6ba00b3ed0 0x7f6ba009cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56376/0 (socket says 172.21.15.52:56376) 2024-06-02T16:45:19.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba5000640 1 -- 172.21.15.52:0/487460053 learned_addr learned my addr 172.21.15.52:0/487460053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f9019400640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7f8ff807e4d0 0x7f8ff80808f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ba00b4bc0 0x7f6ba009d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba5a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 -- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6ba00b3ed0 msgr2=0x7f6ba009cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6ba00b3ed0 0x7f6ba009cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 -- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 msgr2=0x7f6ba0155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ba00738f0 0x7f6ba0155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.205+0000 7f6ba6400640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba009bb60 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.206+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe154034470 con 0x7fe144003bc0 2024-06-02T16:45:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.206+0000 7f6ba6400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ba00b4bc0 0x7f6ba009d140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031000 tx=0x7f6b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.206+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98041020 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== osd.4 v2:172.21.15.114:6800/4257704278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ff8080fa0 con 0x7f8ff807e4d0 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.206+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== osd.5 v2:172.21.15.114:6808/1412776483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7bd003ee50 con 0x7f7bc407e520 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.207+0000 7fe159600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe13c076350 0x7fe13c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.207+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe1540b7fe0 con 0x7fe144003bc0 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7fe159600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7fe13c07e570 0x7fe13c080990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe13c081040 con 0x7fe13c07e570 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe1540b83f0 con 0x7fe144003bc0 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7fe161200640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe13c076350 0x7fe13c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.208+0000 7fe162600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7fe13c07e570 0x7fe13c080990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.207+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba009be40 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.207+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980325f0 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.210+0000 7fe162600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7fe13c07e570 0x7fe13c080990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.210+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98037040 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.210+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b98044020 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.210+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba009c400 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.211+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ba0069520 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.212+0000 7f6b9d600640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6b80076350 0x7f6b80078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.212+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6b980bc2b0 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.213+0000 7f6ba5a00640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6b80076350 0x7f6b80078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.213+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== osd.6 v2:172.21.15.114:6824/2173533746 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe13c081040 con 0x7fe13c07e570 2024-06-02T16:45:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.213+0000 7fe161200640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe13c076350 0x7fe13c078810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe15c167ff0 tx=0x7fe150009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.213+0000 7f6b9d600640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7f6b8007e550 0x7f6b80080970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.214+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b980325f0 con 0x7f6b8007e550 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.214+0000 7f6ba5a00640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6b80076350 0x7f6b80078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009f20 tx=0x7f6b900094f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.214+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6b9807d150 con 0x7f6ba00b4bc0 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.214+0000 7f6ba5000640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7f6b8007e550 0x7f6b80080970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.215+0000 7f6ba5000640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7f6b8007e550 0x7f6b80080970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.217+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 --> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f7c002dd0 con 0x7f7f8807e5c0 2024-06-02T16:45:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.217+0000 7f7f9fe00640 1 -- 172.21.15.52:0/588907044 <== osd.2 v2:172.21.15.52:6800/1994685313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f7c002dd0 con 0x7f7f8807e5c0 2024-06-02T16:45:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.218+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== osd.7 v2:172.21.15.114:6816/181579839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b980325f0 con 0x7f6b8007e550 2024-06-02T16:45:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.218+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7f7f8807e5c0 msgr2=0x7f7f880809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.218+0000 7f7f9d600640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7f7f8807e5c0 0x7f7f880809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 --> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fada4058040 con 0x7fad8c07e520 2024-06-02T16:45:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7f880763a0 msgr2=0x7f7f88078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7f880763a0 0x7f7f88078860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80cbb50 tx=0x7f7f94009110 comp rx=0 tx=0).stop 2024-06-02T16:45:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 msgr2=0x7f7fa80b80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 --2- 172.21.15.52:0/588907044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa80b7130 0x7f7fa80b80f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009870 tx=0x7f7f980046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7faca00640 1 -- 172.21.15.52:0/588907044 reap_dead start 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 shutdown_connections 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.220+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 >> 172.21.15.52:0/588907044 conn(0x7f7fa808cf50 msgr2=0x7f7fa80b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.221+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 shutdown_connections 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.221+0000 7f7f9d600640 1 -- 172.21.15.52:0/588907044 wait complete. 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.222+0000 7fada9600640 1 -- 172.21.15.52:0/628436333 <== osd.0 v2:172.21.15.52:6817/3406856297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fada4058040 con 0x7fad8c07e520 2024-06-02T16:45:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7f5eb4c00640 1 -- 172.21.15.52:0/852803622 --> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5eb00d2860 con 0x7f5e9007e520 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fad8c07e520 msgr2=0x7fad8c080940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fad8c07e520 0x7fad8c080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad8c076300 msgr2=0x7fad8c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad8c076300 0x7fad8c0787c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fada4178960 tx=0x7fad98008040 comp rx=0 tx=0).stop 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 msgr2=0x7fada40e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb2800640 1 --2- 172.21.15.52:0/628436333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fada403c0a0 0x7fada40e5f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fada003b040 tx=0x7fada00046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.224+0000 7fadb1e00640 1 -- 172.21.15.52:0/628436333 reap_dead start 2024-06-02T16:45:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.225+0000 7f5ea6000640 1 -- 172.21.15.52:0/852803622 <== osd.1 v2:172.21.15.52:6809/2484681760 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5eb00d2860 con 0x7f5e9007e520 2024-06-02T16:45:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.225+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 shutdown_connections 2024-06-02T16:45:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.225+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 >> 172.21.15.52:0/628436333 conn(0x7fada4058ee0 msgr2=0x7fada4039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.225+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 shutdown_connections 2024-06-02T16:45:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.225+0000 7fadb2800640 1 -- 172.21.15.52:0/628436333 wait complete. 2024-06-02T16:45:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.227+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7f5e9007e520 msgr2=0x7f5e90080940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.227+0000 7f5e9b400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7f5e9007e520 0x7f5e90080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.227+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5e90076320 msgr2=0x7f5e900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.228+0000 7f5e9b400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5e90076320 0x7f5e900787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c034000 tx=0x7f5e9c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.228+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 msgr2=0x7f5eb015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.228+0000 7f5e9b400640 1 --2- 172.21.15.52:0/852803622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb00b7130 0x7f5eb015abd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ebe0 tx=0x7f5ea000c520 comp rx=0 tx=0).stop 2024-06-02T16:45:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.228+0000 7f5eae800640 1 -- 172.21.15.52:0/852803622 reap_dead start 2024-06-02T16:45:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.229+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 --> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc810069520 con 0x7fc7f007e690 2024-06-02T16:45:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.230+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 shutdown_connections 2024-06-02T16:45:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.230+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 >> 172.21.15.52:0/852803622 conn(0x7f5eb008cf50 msgr2=0x7f5eb006e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.231+0000 7fc806a00640 1 -- 172.21.15.52:0/1025951707 <== osd.3 v2:172.21.15.52:6808/3679883112 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc810069520 con 0x7fc7f007e690 2024-06-02T16:45:19.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.231+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 shutdown_connections 2024-06-02T16:45:19.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.231+0000 7f5e9b400640 1 -- 172.21.15.52:0/852803622 wait complete. 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fc7f007e690 msgr2=0x7fc7f0080ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fc7f007e690 0x7fc7f0080ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc7f0076470 msgr2=0x7fc7f0078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc7f0076470 0x7fc7f0078930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000c00 tx=0x7fc7fc007040 comp rx=0 tx=0).stop 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 msgr2=0x7fc81015a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 --2- 172.21.15.52:0/1025951707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f40041d0 0x7fc81015a3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc80000e7e0 tx=0x7fc80000eca0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc80f400640 1 -- 172.21.15.52:0/1025951707 reap_dead start 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 shutdown_connections 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.236+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 >> 172.21.15.52:0/1025951707 conn(0x7fc81008cf50 msgr2=0x7fc810160d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.237+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 shutdown_connections 2024-06-02T16:45:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.237+0000 7fc815c00640 1 -- 172.21.15.52:0/1025951707 wait complete. 2024-06-02T16:45:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.240+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 --> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ff4002dd0 con 0x7f8ff807e4d0 2024-06-02T16:45:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.240+0000 7f9012000640 1 -- 172.21.15.52:0/696127410 <== osd.4 v2:172.21.15.114:6800/4257704278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ff4002dd0 con 0x7f8ff807e4d0 2024-06-02T16:45:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7f8ff807e4d0 msgr2=0x7f8ff80808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7f8ff807e4d0 0x7f8ff80808f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ff80762d0 msgr2=0x7f8ff8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ff80762d0 0x7f8ff8078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f900c034000 tx=0x7f900c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 msgr2=0x7f901c147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.241+0000 7f9021200640 1 --2- 172.21.15.52:0/696127410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f901c0b4bc0 0x7f901c147840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f900400c3f0 tx=0x7f900400c8b0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.242+0000 7f901a800640 1 -- 172.21.15.52:0/696127410 reap_dead start 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.242+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 shutdown_connections 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.242+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 >> 172.21.15.52:0/696127410 conn(0x7f901c0b3200 msgr2=0x7f901c166530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.242+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 shutdown_connections 2024-06-02T16:45:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.242+0000 7f9021200640 1 -- 172.21.15.52:0/696127410 wait complete. 2024-06-02T16:45:19.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.243+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 --> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7bb8002dd0 con 0x7f7bc407e520 2024-06-02T16:45:19.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.244+0000 7f7bdb400640 1 -- 172.21.15.52:0/763670608 <== osd.5 v2:172.21.15.114:6808/1412776483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7bb8002dd0 con 0x7f7bc407e520 2024-06-02T16:45:19.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.244+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 --> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe15c1604b0 con 0x7fe13c07e570 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f7bc407e520 msgr2=0x7f7bc4080940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f7bc407e520 0x7f7bc4080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7bc4076300 msgr2=0x7f7bc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7bc4076300 0x7f7bc40787c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0012e0 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b3ed0 msgr2=0x7f7be4147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7bd8c00640 1 --2- 172.21.15.52:0/763670608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be40b3ed0 0x7f7be4147ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0031000 tx=0x7f7bd00046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7f7be3400640 1 -- 172.21.15.52:0/763670608 reap_dead start 2024-06-02T16:45:19.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 shutdown_connections 2024-06-02T16:45:19.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 >> 172.21.15.52:0/763670608 conn(0x7f7be40b3200 msgr2=0x7f7be4162fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 shutdown_connections 2024-06-02T16:45:19.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7f7bd8c00640 1 -- 172.21.15.52:0/763670608 wait complete. 2024-06-02T16:45:19.264 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-06-02T16:45:19.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.245+0000 7fe159600640 1 -- 172.21.15.52:0/1260575206 <== osd.6 v2:172.21.15.114:6824/2173533746 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe15c1604b0 con 0x7fe13c07e570 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7fe13c07e570 msgr2=0x7fe13c080990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7fe13c07e570 0x7fe13c080990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe13c076350 msgr2=0x7fe13c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe13c076350 0x7fe13c078810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe15c167ff0 tx=0x7fe150009040 comp rx=0 tx=0).stop 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 msgr2=0x7fe15c160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.246+0000 7fe164600640 1 --2- 172.21.15.52:0/1260575206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144003bc0 0x7fe15c160860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe15400a8d0 tx=0x7fe154001b90 comp rx=0 tx=0).stop 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.247+0000 7fe162600640 1 -- 172.21.15.52:0/1260575206 reap_dead start 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.247+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 shutdown_connections 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.247+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 >> 172.21.15.52:0/1260575206 conn(0x7fe15c0b3200 msgr2=0x7fe15c162f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.247+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 shutdown_connections 2024-06-02T16:45:19.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.247+0000 7fe164600640 1 -- 172.21.15.52:0/1260575206 wait complete. 2024-06-02T16:45:19.266 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-06-02T16:45:19.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T16:45:19.267 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2024-06-02T16:45:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.256+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 --> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ba009c890 con 0x7f6b8007e550 2024-06-02T16:45:19.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T16:45:19.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.257+0000 7f6b9d600640 1 -- 172.21.15.52:0/487460053 <== osd.7 v2:172.21.15.114:6816/181579839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ba009c890 con 0x7f6b8007e550 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.257+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7f6b8007e550 msgr2=0x7f6b80080970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.257+0000 7f6ba8400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7f6b8007e550 0x7f6b80080970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.258+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6b80076350 msgr2=0x7f6b80078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.258+0000 7f6ba8400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6b80076350 0x7f6b80078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009f20 tx=0x7f6b900094f0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.258+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ba00b4bc0 msgr2=0x7f6ba009d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.258+0000 7f6ba8400640 1 --2- 172.21.15.52:0/487460053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ba00b4bc0 0x7f6ba009d140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031000 tx=0x7f6b980046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.259+0000 7f6ba6400640 1 -- 172.21.15.52:0/487460053 reap_dead start 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.259+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 shutdown_connections 2024-06-02T16:45:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.259+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 >> 172.21.15.52:0/487460053 conn(0x7f6ba00b3200 msgr2=0x7f6ba01654c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.259+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 shutdown_connections 2024-06-02T16:45:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.259+0000 7f6ba8400640 1 -- 172.21.15.52:0/487460053 wait complete. 2024-06-02T16:45:19.270 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-06-02T16:45:19.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T16:45:19.271 INFO:teuthology.orchestra.run.smithi052.stdout:68719476741 2024-06-02T16:45:19.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T16:45:19.272 INFO:teuthology.orchestra.run.smithi052.stdout:68719476743 2024-06-02T16:45:19.273 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T16:45:19.274 INFO:teuthology.orchestra.run.smithi052.stdout:68719476743 2024-06-02T16:45:19.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T16:45:19.281 INFO:teuthology.orchestra.run.smithi052.stdout:68719476744 2024-06-02T16:45:19.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T16:45:19.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.557+0000 7fa38d800640 1 Processor -- start 2024-06-02T16:45:19.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.557+0000 7fa38d800640 1 -- start start 2024-06-02T16:45:19.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.559+0000 7fa38d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3880adef0 0x7fa388072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.559+0000 7fa38d800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa38815b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.560+0000 7fa38d800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa388162110 con 0x7fa38815efd0 2024-06-02T16:45:19.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.560+0000 7fa38d800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa3880b4750 con 0x7fa3880adef0 2024-06-02T16:45:19.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.560+0000 7fa38d800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fa3880b4a30 con 0x7fa3880b3680 2024-06-02T16:45:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.561+0000 7fa387400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa38815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.561+0000 7fa387400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa38815b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56380/0 (socket says 172.21.15.52:56380) 2024-06-02T16:45:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.561+0000 7fa387400640 1 -- 172.21.15.52:0/1886801377 learned_addr learned my addr 172.21.15.52:0/1886801377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.561+0000 7fa387e00640 1 --2- 172.21.15.52:0/1886801377 >> v2:172.21.15.52:3300/0 conn(0x7fa3880adef0 0x7fa388072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.561+0000 7f4e23c00640 1 Processor -- start 2024-06-02T16:45:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.562+0000 7f4e23c00640 1 -- start start 2024-06-02T16:45:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.562+0000 7fa387e00640 1 -- 172.21.15.52:0/1886801377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 msgr2=0x7fa38815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.562+0000 7fa387e00640 1 --2- 172.21.15.52:0/1886801377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa38815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.562+0000 7fa387e00640 1 -- 172.21.15.52:0/1886801377 >> v1:172.21.15.52:6789/0 conn(0x7fa38815efd0 legacy=0x7fa38815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.562+0000 7fa387e00640 1 -- 172.21.15.52:0/1886801377 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3880b4d10 con 0x7fa3880adef0 2024-06-02T16:45:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.564+0000 7f0601800640 1 Processor -- start 2024-06-02T16:45:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.564+0000 7f0601800640 1 -- start start 2024-06-02T16:45:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.564+0000 7fa387e00640 1 --2- 172.21.15.52:0/1886801377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3880adef0 0x7fa388072d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097a0 tx=0x7fa37802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3851487fdfc4ca5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7f4e23c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e14048100 0x7f4e14006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7f4e23c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e1404f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7f4e23c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e14005ec0 con 0x7f4e14007460 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7f4e23c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4e140e7b90 con 0x7f4e14048100 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7f4e23c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4e14006a90 con 0x7f4e14054560 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7fa386a00640 1 -- 172.21.15.52:0/1886801377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378037070 con 0x7fa3880adef0 2024-06-02T16:45:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7fa386a00640 1 -- 172.21.15.52:0/1886801377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37802ae40 con 0x7fa3880adef0 2024-06-02T16:45:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.565+0000 7fa386a00640 1 -- 172.21.15.52:0/1886801377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378037070 con 0x7fa3880adef0 2024-06-02T16:45:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.566+0000 7f4e21200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e14048100 0x7f4e14006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.566+0000 7f4e21200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e14048100 0x7f4e14006f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53108/0 (socket says 172.21.15.52:53108) 2024-06-02T16:45:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.566+0000 7f4e21200640 1 -- 172.21.15.52:0/1271048263 learned_addr learned my addr 172.21.15.52:0/1271048263 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.566+0000 7f0601800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05f400a460 0x7f05f4055db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.566+0000 7f4e21c00640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e1404f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7fa38d800640 1 -- 172.21.15.52:0/1886801377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3880adef0 msgr2=0x7fa388072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7fa38d800640 1 --2- 172.21.15.52:0/1886801377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3880adef0 0x7fa388072d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097a0 tx=0x7fa37802a0f0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f0601800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f4054d10 con 0x7f05f40e1310 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f0601800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f4054ff0 con 0x7f05f400ab40 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f0601800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f05f4055920 con 0x7f05f400a460 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7fa38d800640 1 -- 172.21.15.52:0/1886801377 shutdown_connections 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f4e21200640 1 -- 172.21.15.52:0/1271048263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 msgr2=0x7f4e1404f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f4e21200640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e1404f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f4e21200640 1 -- 172.21.15.52:0/1271048263 >> v1:172.21.15.114:6789/0 conn(0x7f4e14007460 legacy=0x7f4e14053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f4e21200640 1 -- 172.21.15.52:0/1271048263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e14053280 con 0x7f4e14048100 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f05fb400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f05f400ab40 0x7f05f4009d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:36538/0 (socket says 172.21.15.52:36538) 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7f05fb400640 1 -- 172.21.15.52:0/1792888858 learned_addr learned my addr 172.21.15.52:0/1792888858 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.568+0000 7f0600e00640 1 --2- 172.21.15.52:0/1792888858 >> v2:172.21.15.52:3300/0 conn(0x7f05f400a460 0x7f05f4055db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.567+0000 7fa38d800640 1 --2- 172.21.15.52:0/1886801377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa38815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7fa38d800640 1 --2- 172.21.15.52:0/1886801377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3880adef0 0x7fa388072d50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7fa38d800640 1 -- 172.21.15.52:0/1886801377 >> 172.21.15.52:0/1886801377 conn(0x7fa3880b2b60 msgr2=0x7fa3880b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f4e21200640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e14006f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c000b60 tx=0x7f4e1c0a6e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a7d1f8daf97ac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7fa38d800640 1 -- 172.21.15.52:0/1886801377 shutdown_connections 2024-06-02T16:45:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f4e1b400640 1 -- 172.21.15.52:0/1271048263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0a7790 con 0x7f4e14048100 2024-06-02T16:45:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f4e1b400640 1 -- 172.21.15.52:0/1271048263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c0a7970 con 0x7f4e14048100 2024-06-02T16:45:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f4e1b400640 1 -- 172.21.15.52:0/1271048263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0a7de0 con 0x7f4e14048100 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f0600e00640 1 -- 172.21.15.52:0/1792888858 >> v1:172.21.15.114:6789/0 conn(0x7f05f400ab40 legacy=0x7f05f4009d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f0600e00640 1 -- 172.21.15.52:0/1792888858 >> v1:172.21.15.52:6789/0 conn(0x7f05f40e1310 legacy=0x7f05f403a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f0600e00640 1 -- 172.21.15.52:0/1792888858 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f40552d0 con 0x7f05f400a460 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.569+0000 7f05faa00640 1 -- 172.21.15.52:0/1792888858 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218525026 0 0) 0x7f05f4054ff0 con 0x7f05f400ab40 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.570+0000 7f0600e00640 1 --2- 172.21.15.52:0/1792888858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400a460 0x7f05f4055db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05fc06b3e0 tx=0x7f05fc0a6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f774d50bd0ce896f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.570+0000 7f4e23c00640 1 -- 172.21.15.52:0/1271048263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 msgr2=0x7f4e14006f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.570+0000 7f4e23c00640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e14006f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c000b60 tx=0x7f4e1c0a6e50 comp rx=0 tx=0).stop 2024-06-02T16:45:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7f05faa00640 1 -- 172.21.15.52:0/1792888858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0a75b0 con 0x7f05f400a460 2024-06-02T16:45:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7f05faa00640 1 -- 172.21.15.52:0/1792888858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc0a7770 con 0x7f05f400a460 2024-06-02T16:45:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7f05faa00640 1 -- 172.21.15.52:0/1792888858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0a7c20 con 0x7f05f400a460 2024-06-02T16:45:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7fb6e4a00640 1 Processor -- start 2024-06-02T16:45:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7fa38d800640 1 -- 172.21.15.52:0/1886801377 wait complete. 2024-06-02T16:45:19.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 -- 172.21.15.52:0/1792888858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400a460 msgr2=0x7f05f4055db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 --2- 172.21.15.52:0/1792888858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400a460 0x7f05f4055db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05fc06b3e0 tx=0x7f05fc0a6d30 comp rx=0 tx=0).stop 2024-06-02T16:45:19.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.571+0000 7fb6e4a00640 1 -- start start 2024-06-02T16:45:19.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f4e23c00640 1 -- 172.21.15.52:0/1271048263 shutdown_connections 2024-06-02T16:45:19.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f4e23c00640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e1404f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f4e23c00640 1 --2- 172.21.15.52:0/1271048263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e14006f20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f4e23c00640 1 -- 172.21.15.52:0/1271048263 >> 172.21.15.52:0/1271048263 conn(0x7f4e14009fe0 msgr2=0x7f4e1400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 -- 172.21.15.52:0/1792888858 shutdown_connections 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 --2- 172.21.15.52:0/1792888858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400a460 0x7f05f4055db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 -- 172.21.15.52:0/1792888858 >> 172.21.15.52:0/1792888858 conn(0x7f05f4056cd0 msgr2=0x7f05f40570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 -- 172.21.15.52:0/1792888858 shutdown_connections 2024-06-02T16:45:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.572+0000 7f0601800640 1 -- 172.21.15.52:0/1792888858 wait complete. 2024-06-02T16:45:19.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.573+0000 7f4e23c00640 1 -- 172.21.15.52:0/1271048263 shutdown_connections 2024-06-02T16:45:19.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.573+0000 7fd2a5600640 1 Processor -- start 2024-06-02T16:45:19.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.573+0000 7fd2a5600640 1 -- start start 2024-06-02T16:45:19.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.574+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.574+0000 7fb6e4a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 0x7fb6e006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.573+0000 7f4e23c00640 1 -- 172.21.15.52:0/1271048263 wait complete. 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.574+0000 7fb6e4a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e00ae4a0 con 0x7fb6e00b4650 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fb6e4a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e015ef00 con 0x7fb6e006f470 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fb6e4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0073710 con 0x7fb6e015eb20 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56394/0 (socket says 172.21.15.52:56394) 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fb6dde00640 1 -- 172.21.15.52:0/2802717366 learned_addr learned my addr 172.21.15.52:0/2802717366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7f0601800640 1 Processor -- start 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fd2a5600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fd2a5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2a00d2260 0x7fd2a00b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fd2a5600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a00d61c0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fd2a5600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a00d3990 con 0x7fd2a00d2260 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fd2a5600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a0162f80 con 0x7fd2a0162ba0 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.574+0000 7fa38d800640 1 Processor -- start 2024-06-02T16:45:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.575+0000 7fa38d800640 1 -- start start 2024-06-02T16:45:19.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7f0601800640 1 -- start start 2024-06-02T16:45:19.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7fb6dd400640 1 --2- 172.21.15.52:0/2802717366 >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 0x7fb6e006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7fb6dde00640 1 -- 172.21.15.52:0/2802717366 >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 msgr2=0x7fb6e006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7fa38d800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7f4e23c00640 1 Processor -- start 2024-06-02T16:45:19.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7fa38d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 0x7fa38814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.576+0000 7fd2a4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2a00d2260 0x7fd2a00b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa38d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa38814d800 0x7fa3880ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7f4e23c00640 1 -- start start 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa38d800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa388073330 con 0x7fa38815efd0 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa38d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa38815b780 con 0x7fa38814d800 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa38d800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fa3880734b0 con 0x7fa3880b3680 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa387e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa387e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56402/0 (socket says 172.21.15.52:56402) 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa387e00640 1 -- 172.21.15.52:0/2403681439 learned_addr learned my addr 172.21.15.52:0/2403681439 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa387400640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 0x7fa38814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fa38ce00640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa38814d800 0x7fa3880ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fb6dde00640 1 --2- 172.21.15.52:0/2802717366 >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 0x7fb6e006f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fb6dde00640 1 -- 172.21.15.52:0/2802717366 >> v1:172.21.15.52:6789/0 conn(0x7fb6e00b4650 legacy=0x7fb6e0073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7fb6dde00640 1 -- 172.21.15.52:0/2802717366 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e0072de0 con 0x7fb6e015eb20 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7f0601800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f400a460 0x7f05f40e0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.577+0000 7f0601800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7f0601800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 0x7f05f404f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7f0601800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4054a20 con 0x7f05f400ab40 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7f0601800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05f40548a0 con 0x7f05f40e1310 2024-06-02T16:45:19.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7f0601800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f05f40516e0 con 0x7f05f400a460 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2a00d2260 0x7fd2a00b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52556/0 (socket says 172.21.15.52:52556) 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 -- 172.21.15.52:0/2221382240 learned_addr learned my addr 172.21.15.52:0/2221382240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 -- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 msgr2=0x7fd2a00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f0600e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 0x7f05f404f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 --2- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 -- 172.21.15.52:0/2221382240 >> v1:172.21.15.114:6789/0 conn(0x7fd2a00d5c50 legacy=0x7fd2a00d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.578+0000 7fd2a4c00640 1 -- 172.21.15.52:0/2221382240 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a00d3c30 con 0x7fd2a00d2260 2024-06-02T16:45:19.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e14007460 0x7f4e140d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387400640 1 -- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 msgr2=0x7fa3881fbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f0600e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 0x7f05f404f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52578/0 (socket says 172.21.15.52:52578) 2024-06-02T16:45:19.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f05fb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f05fb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53138/0 (socket says 172.21.15.52:53138) 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f05fb400640 1 -- 172.21.15.52:0/2460477422 learned_addr learned my addr 172.21.15.52:0/2460477422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387400640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387400640 1 -- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa38814d800 msgr2=0x7fa3880ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387400640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa38814d800 0x7fa3880ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387400640 1 -- 172.21.15.52:0/2403681439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38815d170 con 0x7fa38815efd0 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fa387e00640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7fb6dd400640 1 --2- 172.21.15.52:0/2802717366 >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 0x7fb6e006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7fb6dde00640 1 --2- 172.21.15.52:0/2802717366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800bf50 tx=0x7fb6d802c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1715cb1bd33c636d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fc84e800640 1 Processor -- start 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e140e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14006720 con 0x7f4e14048100 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14006440 con 0x7f4e14007460 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e23c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1404fe70 con 0x7f4e14054560 2024-06-02T16:45:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53144/0 (socket says 172.21.15.52:53144) 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e1be00640 1 -- 172.21.15.52:0/239109882 learned_addr learned my addr 172.21.15.52:0/239109882 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7f4e21200640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e14007460 0x7f4e140d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f4e1be00640 1 -- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 msgr2=0x7f4e140e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.579+0000 7fc84e800640 1 -- start start 2024-06-02T16:45:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f4e1be00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e140e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f4e1be00640 1 -- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e14007460 msgr2=0x7f4e140d6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f4e1be00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e14007460 0x7f4e140d6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.580+0000 7f4e1be00640 1 -- 172.21.15.52:0/239109882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e140d73c0 con 0x7f4e14048100 2024-06-02T16:45:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f4e1be00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c430 tx=0x7f4e1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f002ac00640 1 Processor -- start 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fbe00640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f400a460 0x7f05f40e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fb400640 1 -- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f400a460 msgr2=0x7f05f40e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fb400640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f400a460 0x7f05f40e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fb400640 1 -- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 msgr2=0x7f05f404f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fb400640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 0x7f05f404f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f05fb400640 1 -- 172.21.15.52:0/2460477422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f40e0570 con 0x7f05f400ab40 2024-06-02T16:45:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fd2a4c00640 1 --2- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a00b8340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e50 tx=0x7fd29802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f87a728a7dbee0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fc84e800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 0x7fc8480b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fa387400640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 0x7fa38814d2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e900 tx=0x7fa37000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fb6dca00640 1 -- 172.21.15.52:0/2802717366 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8033770 con 0x7fb6e015eb20 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370017070 con 0x7fa38815efd0 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fc84e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8481653e0 0x7fc848165870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fc84e800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8480b7750 con 0x7fc848164ce0 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fc84e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc8480d0a70 con 0x7fc8481653e0 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7fc84e800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc8480cfb80 con 0x7fc8480b6e30 2024-06-02T16:45:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37000c7f0 con 0x7fa38815efd0 2024-06-02T16:45:19.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38815d450 con 0x7fa38815efd0 2024-06-02T16:45:19.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10011790 con 0x7f4e14048100 2024-06-02T16:45:19.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f05fb400640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c490 tx=0x7f05e800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e10017070 con 0x7f4e14048100 2024-06-02T16:45:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10011b70 con 0x7f4e14048100 2024-06-02T16:45:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fd29ea00640 1 -- 172.21.15.52:0/2221382240 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298036070 con 0x7fd2a00d2260 2024-06-02T16:45:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fc847400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 0x7fc8480b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fd29ea00640 1 -- 172.21.15.52:0/2221382240 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd298031600 con 0x7fd2a00d2260 2024-06-02T16:45:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fd29ea00640 1 -- 172.21.15.52:0/2221382240 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980319d0 con 0x7fd2a00d2260 2024-06-02T16:45:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37000cbc0 con 0x7fa38815efd0 2024-06-02T16:45:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38815da10 con 0x7fa38815efd0 2024-06-02T16:45:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fb6dca00640 1 -- 172.21.15.52:0/2802717366 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d8039070 con 0x7fb6e015eb20 2024-06-02T16:45:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fb6dca00640 1 -- 172.21.15.52:0/2802717366 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8033b70 con 0x7fb6e015eb20 2024-06-02T16:45:19.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fc847400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 0x7fc8480b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56432/0 (socket says 172.21.15.52:56432) 2024-06-02T16:45:19.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fc847400640 1 -- 172.21.15.52:0/1395558195 learned_addr learned my addr 172.21.15.52:0/1395558195 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7fc847e00640 1 --2- 172.21.15.52:0/1395558195 >> v2:172.21.15.52:3300/0 conn(0x7fc8481653e0 0x7fc848165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2802717366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 msgr2=0x7fb6e00adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2802717366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800bf50 tx=0x7fb6d802c900 comp rx=0 tx=0).stop 2024-06-02T16:45:19.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7fd2a5600640 1 -- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 msgr2=0x7fd2a00b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7fd2a5600640 1 --2- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a00b8340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e50 tx=0x7fd29802a5f0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1404c680 con 0x7f4e14048100 2024-06-02T16:45:19.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1404cc40 con 0x7f4e14048100 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8018070 con 0x7f05f400ab40 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e80074e0 con 0x7f05f400ab40 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.582+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f4009b50 con 0x7f05f400ab40 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8004a20 con 0x7f05f400ab40 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.583+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f4050440 con 0x7f05f400ab40 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fc847e00640 1 -- 172.21.15.52:0/1395558195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 msgr2=0x7fc8480b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fc847e00640 1 --2- 172.21.15.52:0/1395558195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 0x7fc8480b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fc847e00640 1 -- 172.21.15.52:0/1395558195 >> v1:172.21.15.114:6789/0 conn(0x7fc848164ce0 legacy=0x7fc8480d5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fc847e00640 1 -- 172.21.15.52:0/1395558195 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480cfe60 con 0x7fc8481653e0 2024-06-02T16:45:19.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fd2a5600640 1 -- 172.21.15.52:0/2221382240 shutdown_connections 2024-06-02T16:45:19.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fd2a5600640 1 --2- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a00b8340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fd2a5600640 1 --2- 172.21.15.52:0/2221382240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fd2a5600640 1 -- 172.21.15.52:0/2221382240 >> 172.21.15.52:0/2221382240 conn(0x7fd2a009e5f0 msgr2=0x7fd2a00d5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa360005290 con 0x7fa38815efd0 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.581+0000 7f002ac00640 1 -- start start 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7f002ac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00241631f0 0x7f00240b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7f002ac00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 0x7f00240b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7f002ac00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00240b7b20 con 0x7f00240b7130 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7f002ac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f00240b7e00 con 0x7f00241631f0 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.584+0000 7f002ac00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f002406ee90 con 0x7f00240d5f10 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fd2a5600640 1 -- 172.21.15.52:0/2221382240 shutdown_connections 2024-06-02T16:45:19.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fd2a5600640 1 -- 172.21.15.52:0/2221382240 wait complete. 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e140053c0 con 0x7f4e14048100 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2802717366 shutdown_connections 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2802717366 >> v2:172.21.15.52:3300/0 conn(0x7fb6e006f470 0x7fb6e006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2802717366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e00adf60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.585+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2802717366 >> 172.21.15.52:0/2802717366 conn(0x7fb6e00b2ff0 msgr2=0x7fb6e00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f404a400 con 0x7f05f400ab40 2024-06-02T16:45:19.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2802717366 shutdown_connections 2024-06-02T16:45:19.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7f001be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00241631f0 0x7f00240b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7f0028c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 0x7f00240b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7f0028c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 0x7f00240b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56444/0 (socket says 172.21.15.52:56444) 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7f0028c00640 1 -- 172.21.15.52:0/2116101480 learned_addr learned my addr 172.21.15.52:0/2116101480 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.587+0000 7f001be00640 1 -- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 msgr2=0x7f00240b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.587+0000 7f001be00640 1 --2- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 0x7f00240b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.587+0000 7f001be00640 1 -- 172.21.15.52:0/2116101480 >> v1:172.21.15.52:6789/0 conn(0x7f00240b7130 legacy=0x7f0024162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.587+0000 7f001be00640 1 -- 172.21.15.52:0/2116101480 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002406f170 con 0x7f00241631f0 2024-06-02T16:45:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.588+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05e801b070 con 0x7f05f400ab40 2024-06-02T16:45:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.586+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2802717366 wait complete. 2024-06-02T16:45:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.588+0000 7fc847e00640 1 --2- 172.21.15.52:0/1395558195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8481653e0 0x7fc848165870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc840009d90 tx=0x7fc84002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c4df86974bc9d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.588+0000 7f001be00640 1 --2- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f00240b7510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f000c0097a0 tx=0x7f000c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18b3b513199b6b7b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.589+0000 7fb6e4a00640 1 Processor -- start 2024-06-02T16:45:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.589+0000 7fb6e4a00640 1 -- start start 2024-06-02T16:45:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.588+0000 7f833ca00640 1 Processor -- start 2024-06-02T16:45:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.589+0000 7f833ca00640 1 -- start start 2024-06-02T16:45:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f0023400640 1 -- 172.21.15.52:0/2116101480 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c037070 con 0x7f00241631f0 2024-06-02T16:45:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f0023400640 1 -- 172.21.15.52:0/2116101480 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c02adb0 con 0x7f00241631f0 2024-06-02T16:45:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f0023400640 1 -- 172.21.15.52:0/2116101480 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c032660 con 0x7f00241631f0 2024-06-02T16:45:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f05efe00640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 0x7f05dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f05e80967d0 con 0x7f05f400ab40 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f833ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 0x7f8330057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f833ca00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 0x7f83300068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f833ca00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83300582d0 con 0x7f833003e840 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f833ca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8330058570 con 0x7f83300e30c0 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7f833ca00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f8330058850 con 0x7f8330054300 2024-06-02T16:45:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.590+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa37001a070 con 0x7fa38815efd0 2024-06-02T16:45:19.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f8336a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f833003e840 0x7f8330053bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51884/0 (socket says 172.21.15.52:51884) 2024-06-02T16:45:19.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f8336a00640 1 -- 172.21.15.52:0/2259506785 learned_addr learned my addr 172.21.15.52:0/2259506785 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:19.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e10011d10 con 0x7f4e14048100 2024-06-02T16:45:19.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 -- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 msgr2=0x7f00240b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 --2- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f00240b7510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f000c0097a0 tx=0x7f000c02a060 comp rx=0 tx=0).stop 2024-06-02T16:45:19.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f05fbe00640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 0x7f05dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f8337e00640 1 --2- 172.21.15.52:0/2259506785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 0x7f83300068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 -- 172.21.15.52:0/2116101480 shutdown_connections 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 --2- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240d5f10 0x7f00240b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 --2- 172.21.15.52:0/2116101480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f00240b7510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 -- 172.21.15.52:0/2116101480 >> 172.21.15.52:0/2116101480 conn(0x7f002408cf50 msgr2=0x7f00240d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.588+0000 7fd2a5600640 1 Processor -- start 2024-06-02T16:45:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f8337400640 1 --2- 172.21.15.52:0/2259506785 >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 0x7f8330057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f8337e00640 1 -- 172.21.15.52:0/2259506785 >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 msgr2=0x7f8330057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f8337e00640 1 --2- 172.21.15.52:0/2259506785 >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 0x7f8330057d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f8337e00640 1 -- 172.21.15.52:0/2259506785 >> v1:172.21.15.52:6789/0 conn(0x7f833003e840 legacy=0x7f8330053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f8337e00640 1 -- 172.21.15.52:0/2259506785 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8330058b30 con 0x7f8330054300 2024-06-02T16:45:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7fa37fe00640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 0x7fa364078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f05fbe00640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 0x7f05dc0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05f404a620 tx=0x7f05f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa370097b60 con 0x7fa38815efd0 2024-06-02T16:45:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e00b4650 0x7fb6e00c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7fb6e4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f8337400640 1 --2- 172.21.15.52:0/2259506785 >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 0x7f8330057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6e4a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e006e780 con 0x7fb6e00b4650 2024-06-02T16:45:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6e4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e00733a0 con 0x7fb6e006f470 2024-06-02T16:45:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6e4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e00c97b0 con 0x7fb6e015eb20 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.591+0000 7f002ac00640 1 -- 172.21.15.52:0/2116101480 shutdown_connections 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f002ac00640 1 -- 172.21.15.52:0/2116101480 wait complete. 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52614/0 (socket says 172.21.15.52:52614) 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6dde00640 1 -- 172.21.15.52:0/2717419582 learned_addr learned my addr 172.21.15.52:0/2717419582 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fd2a5600640 1 -- start start 2024-06-02T16:45:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fa387e00640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 0x7fa364078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.592+0000 7f4e18c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 0x7f4dfc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4e100973a0 con 0x7f4e14048100 2024-06-02T16:45:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7f4e21200640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 0x7f4dfc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6de800640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.593+0000 7fb6dd400640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e00b4650 0x7fb6e00c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7f8337e00640 1 --2- 172.21.15.52:0/2259506785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 0x7f83300068d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f833806b3e0 tx=0x7f83380a6e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1a976c212c56419 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7fb6dde00640 1 -- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 msgr2=0x7fb6e015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7fb6dde00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7fb6dde00640 1 -- 172.21.15.52:0/2717419582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e00b4650 msgr2=0x7fb6e00c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7fb6dde00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e00b4650 0x7fb6e00c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7fb6dde00640 1 -- 172.21.15.52:0/2717419582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e00c9a90 con 0x7fb6e006f470 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7f4e21200640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 0x7f4dfc0787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400bad0 tx=0x7f4e1c0ab000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7f8336000640 1 -- 172.21.15.52:0/2259506785 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380a77b0 con 0x7f8330054300 2024-06-02T16:45:19.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7f8336000640 1 -- 172.21.15.52:0/2259506785 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83380a79b0 con 0x7f8330054300 2024-06-02T16:45:19.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.594+0000 7f002ac00640 1 Processor -- start 2024-06-02T16:45:19.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7f8336000640 1 -- 172.21.15.52:0/2259506785 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380a7e60 con 0x7f8330054300 2024-06-02T16:45:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a01f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fa387e00640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 0x7fa364078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa378000c00 tx=0x7fa37802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00d10f0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00d41f0 con 0x7fd2a00d2260 2024-06-02T16:45:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a5600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00d1270 con 0x7fd2a0162ba0 2024-06-02T16:45:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7f002ac00640 1 -- start start 2024-06-02T16:45:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd29f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd29f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53166/0 (socket says 172.21.15.52:53166) 2024-06-02T16:45:19.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fb6dde00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6d802cef0 tx=0x7fb6d8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd29f400640 1 -- 172.21.15.52:0/1680438057 learned_addr learned my addr 172.21.15.52:0/1680438057 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd29fe00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a01f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.595+0000 7fd2a4c00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 -- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 msgr2=0x7fd2a015e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8044070 con 0x7fb6e006f470 2024-06-02T16:45:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d8033e50 con 0x7fb6e006f470 2024-06-02T16:45:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d803d420 con 0x7fb6e006f470 2024-06-02T16:45:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e0203140 con 0x7fb6e006f470 2024-06-02T16:45:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7f833ca00640 1 -- 172.21.15.52:0/2259506785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 msgr2=0x7f83300068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7f833ca00640 1 --2- 172.21.15.52:0/2259506785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 0x7f83300068d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f833806b3e0 tx=0x7f83380a6e70 comp rx=0 tx=0).stop 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a015e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 -- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 msgr2=0x7fd2a01f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a01f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 -- 172.21.15.52:0/1680438057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a01f95a0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd2a4c00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e00c9d70 con 0x7fb6e006f470 2024-06-02T16:45:19.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29f400640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c440 tx=0x7fd28c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7fd29fe00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a01f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 -- 172.21.15.52:0/2259506785 shutdown_connections 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 --2- 172.21.15.52:0/2259506785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8330054300 0x7f83300068d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.596+0000 7f002ac00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 0x7f00241eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f002ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 0x7f00240cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f002ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f002415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f002ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00240d4270 con 0x7f00240d5f10 2024-06-02T16:45:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f002ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00240b49f0 con 0x7f00241631f0 2024-06-02T16:45:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f002ac00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f00240d43f0 con 0x7f00240b7130 2024-06-02T16:45:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 --2- 172.21.15.52:0/2259506785 >> v2:172.21.15.52:3300/0 conn(0x7f83300e30c0 0x7f8330057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 -- 172.21.15.52:0/2259506785 >> 172.21.15.52:0/2259506785 conn(0x7f83300559e0 msgr2=0x7f8330055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f001be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 0x7f00240cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f001be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 0x7f00240cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53174/0 (socket says 172.21.15.52:53174) 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f001be00640 1 -- 172.21.15.52:0/30735113 learned_addr learned my addr 172.21.15.52:0/30735113 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f0023e00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 0x7f00241eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 -- 172.21.15.52:0/2259506785 shutdown_connections 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f833ca00640 1 -- 172.21.15.52:0/2259506785 wait complete. 2024-06-02T16:45:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7f0028c00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f002415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.597+0000 7fc846000640 1 -- 172.21.15.52:0/1395558195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840007740 con 0x7fc8481653e0 2024-06-02T16:45:19.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e0069520 con 0x7fb6e006f470 2024-06-02T16:45:19.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7f0023e00640 1 -- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 msgr2=0x7f002415e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa370060e50 con 0x7fa38815efd0 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7f0023e00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f002415e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7f0023e00640 1 -- 172.21.15.52:0/30735113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 msgr2=0x7f00240cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7f0023e00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 0x7f00240cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.598+0000 7f0023e00640 1 -- 172.21.15.52:0/30735113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241ee130 con 0x7f00240b7130 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7f0023e00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 0x7f00241eaef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f001400c440 tx=0x7f001400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014011790 con 0x7f00240b7130 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241ee410 con 0x7f00240b7130 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f002415e570 con 0x7f00240b7130 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c017070 con 0x7fd2a00d5c50 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a01f9880 con 0x7fd2a00d5c50 2024-06-02T16:45:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.599+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a015a330 con 0x7fd2a00d5c50 2024-06-02T16:45:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.601+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0014017070 con 0x7f00240b7130 2024-06-02T16:45:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.601+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014011b70 con 0x7f00240b7130 2024-06-02T16:45:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.601+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc005290 con 0x7f00240b7130 2024-06-02T16:45:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.600+0000 7f833ca00640 1 Processor -- start 2024-06-02T16:45:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.600+0000 7f833ca00640 1 -- start start 2024-06-02T16:45:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 0x7f83300d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83300e30c0 0x7f833003d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83300e34a0 con 0x7f8330054300 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f833003bfc0 con 0x7f83300e30c0 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f833ca00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f8330006e10 con 0x7f833003e840 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f8336a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f8337400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 0x7f83300d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f8337400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 0x7f83300d70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56480/0 (socket says 172.21.15.52:56480) 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f8336a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53186/0 (socket says 172.21.15.52:53186) 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7f8337400640 1 -- 172.21.15.52:0/62559502 learned_addr learned my addr 172.21.15.52:0/62559502 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8337e00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83300e30c0 0x7f833003d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8336a00640 1 -- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 msgr2=0x7f83300d70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.602+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6d8005d10 con 0x7fb6e006f470 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8336a00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 0x7f83300d70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8336a00640 1 -- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83300e30c0 msgr2=0x7f833003d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8336a00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83300e30c0 0x7f833003d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7f8336a00640 1 -- 172.21.15.52:0/62559502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300e3870 con 0x7f8330054300 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.604+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05e805fc50 con 0x7f05f400ab40 2024-06-02T16:45:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.603+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a00507e0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.604+0000 7fb6d6000640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 0x7fb6bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.604+0000 7f8336a00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8324005880 tx=0x7f832400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.604+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb6d80b9510 con 0x7fb6e006f470 2024-06-02T16:45:19.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.605+0000 7fb6dd400640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 0x7fb6bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.605+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0014011d10 con 0x7f00240b7130 2024-06-02T16:45:19.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.606+0000 7f0020c00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 0x7f00000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.606+0000 7fb6dd400640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 0x7fb6bc078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6e015de80 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.606+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0014097bb0 con 0x7f00240b7130 2024-06-02T16:45:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.607+0000 7f001be00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 0x7f00000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.608+0000 7f001be00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 0x7f00000787c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f000c02a0a0 tx=0x7f000c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c0035f0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c021060 con 0x7fd2a00d5c50 2024-06-02T16:45:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7fc846000640 1 -- 172.21.15.52:0/1395558195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400078e0 con 0x7fc8481653e0 2024-06-02T16:45:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7fc846000640 1 -- 172.21.15.52:0/1395558195 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840007cb0 con 0x7fc8481653e0 2024-06-02T16:45:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324017070 con 0x7f8330054300 2024-06-02T16:45:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83300e3b50 con 0x7f8330054300 2024-06-02T16:45:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.613+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83300e4110 con 0x7f8330054300 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.614+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e10060ce0 con 0x7f4e14048100 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.614+0000 7fc84e800640 1 -- 172.21.15.52:0/1395558195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8481653e0 msgr2=0x7fc848165870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.614+0000 7fc84e800640 1 --2- 172.21.15.52:0/1395558195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8481653e0 0x7fc848165870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc840009d90 tx=0x7fc84002a660 comp rx=0 tx=0).stop 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.615+0000 7fc84e800640 1 -- 172.21.15.52:0/1395558195 shutdown_connections 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.615+0000 7fc84e800640 1 --2- 172.21.15.52:0/1395558195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8481653e0 0x7fc848165870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.615+0000 7fc84e800640 1 --2- 172.21.15.52:0/1395558195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8480b6e30 0x7fc8480b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.615+0000 7fc84e800640 1 -- 172.21.15.52:0/1395558195 >> 172.21.15.52:0/1395558195 conn(0x7fc84809e710 msgr2=0x7fc8480d53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.614+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324005ce0 con 0x7f8330054300 2024-06-02T16:45:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.616+0000 7fc84e800640 1 -- 172.21.15.52:0/1395558195 shutdown_connections 2024-06-02T16:45:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.616+0000 7fc84e800640 1 -- 172.21.15.52:0/1395558195 wait complete. 2024-06-02T16:45:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.615+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83300e4310 con 0x7f8330054300 2024-06-02T16:45:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.616+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240072f0 con 0x7f8330054300 2024-06-02T16:45:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.617+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd28c01a070 con 0x7fd2a00d5c50 2024-06-02T16:45:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.618+0000 7fc84e800640 1 Processor -- start 2024-06-02T16:45:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.618+0000 7fc84e800640 1 -- start start 2024-06-02T16:45:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.619+0000 7fd297e00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 0x7fd280078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.619+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd28c096dc0 con 0x7fd2a00d5c50 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fd29fe00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 0x7fd280078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8480b6e30 0x7fc848151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8480badc0 0x7fc8480d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8480d0700 con 0x7fc8480badc0 2024-06-02T16:45:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8480d0420 con 0x7fc8480b6e30 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.620+0000 7fc84e800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc848165db0 con 0x7fc8481653e0 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fc847e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8480badc0 0x7fc8480d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fc846a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fc846a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56482/0 (socket says 172.21.15.52:56482) 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fc846a00640 1 -- 172.21.15.52:0/2236093290 learned_addr learned my addr 172.21.15.52:0/2236093290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fc847400640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8480b6e30 0x7fc848151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.621+0000 7fd29fe00640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 0x7fd280078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd290009890 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 -- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8480b6e30 msgr2=0x7fc848151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8480b6e30 0x7fc848151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 -- 172.21.15.52:0/2236093290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8480badc0 msgr2=0x7fc8480d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8480badc0 0x7fc8480d2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 -- 172.21.15.52:0/2236093290 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480ca270 con 0x7fc8481653e0 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.622+0000 7fc846a00640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c500 tx=0x7fc83400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.623+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd28c060090 con 0x7fd2a00d5c50 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.626+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f832401a070 con 0x7f8330054300 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.628+0000 7f832b400640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 0x7f8318078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.628+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8324096ec0 con 0x7f8330054300 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.629+0000 7f8337400640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 0x7f8318078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.630+0000 7f8337400640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 0x7f8318078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f832c006d40 tx=0x7f832c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.630+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83300e4310 con 0x7f8330054300 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.634+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6d80829b0 con 0x7fb6e006f470 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.636+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340052d0 con 0x7fc8481653e0 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.636+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834005470 con 0x7fc8481653e0 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.636+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834012870 con 0x7fc8481653e0 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.636+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8480cdd00 con 0x7fc8481653e0 2024-06-02T16:45:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.636+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8480ce2c0 con 0x7fc8481653e0 2024-06-02T16:45:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.638+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0014061030 con 0x7f00240b7130 2024-06-02T16:45:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.638+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc848164540 con 0x7fc8481653e0 2024-06-02T16:45:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.641+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc834012a10 con 0x7fc8481653e0 2024-06-02T16:45:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.643+0000 7fc83f400640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 0x7fc828078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.643+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc834097a30 con 0x7fc8481653e0 2024-06-02T16:45:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.645+0000 7fc847400640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 0x7fc828078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.646+0000 7fc847400640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 0x7fc828078810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc838009bd0 tx=0x7fc838009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:19.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:19.655+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc848164540 con 0x7fc8481653e0 2024-06-02T16:45:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.032+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa360005850 con 0x7fa38815efd0 2024-06-02T16:45:20.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.033+0000 7fa37fe00640 1 -- 172.21.15.52:0/2403681439 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa370065150 con 0x7fa38815efd0 2024-06-02T16:45:20.035 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2024-06-02T16:45:20.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.038+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 msgr2=0x7fa364078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.038+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 0x7fa364078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa378000c00 tx=0x7fa37802e000 comp rx=0 tx=0).stop 2024-06-02T16:45:20.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.038+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 msgr2=0x7fa38814d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.038+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 0x7fa38814d2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e900 tx=0x7fa37000edc0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 shutdown_connections 2024-06-02T16:45:20.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3640763a0 0x7fa364078860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa38814d800 0x7fa3880ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa38815efd0 0x7fa38814d2c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 --2- 172.21.15.52:0/2403681439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3880b3680 0x7fa3881fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.039+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 >> 172.21.15.52:0/2403681439 conn(0x7fa3880b2b60 msgr2=0x7fa3880b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.040+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 shutdown_connections 2024-06-02T16:45:20.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.040+0000 7fa38d800640 1 -- 172.21.15.52:0/2403681439 wait complete. 2024-06-02T16:45:20.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-06-02T16:45:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.068+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f05f4005d30 con 0x7f05f400ab40 2024-06-02T16:45:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.069+0000 7f05efe00640 1 -- 172.21.15.52:0/2460477422 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05e8068290 con 0x7f05f400ab40 2024-06-02T16:45:20.068 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-06-02T16:45:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.072+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 msgr2=0x7f05dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.072+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 0x7f05dc0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05f404a620 tx=0x7f05f0009040 comp rx=0 tx=0).stop 2024-06-02T16:45:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.072+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 msgr2=0x7f05f4050f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.072+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c490 tx=0x7f05e800c950 comp rx=0 tx=0).stop 2024-06-02T16:45:20.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 shutdown_connections 2024-06-02T16:45:20.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc076320 0x7f05dc0787e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f40e1310 0x7f05f404f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f400ab40 0x7f05f4050f20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 --2- 172.21.15.52:0/2460477422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f400a460 0x7f05f40e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 >> 172.21.15.52:0/2460477422 conn(0x7f05f4056cd0 msgr2=0x7f05f40e4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 shutdown_connections 2024-06-02T16:45:20.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.073+0000 7f0601800640 1 -- 172.21.15.52:0/2460477422 wait complete. 2024-06-02T16:45:20.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.080+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e14036a10 con 0x7f4e14048100 2024-06-02T16:45:20.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.081+0000 7f4e18c00640 1 -- 172.21.15.52:0/239109882 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e100605e0 con 0x7f4e14048100 2024-06-02T16:45:20.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.083+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efffc005850 con 0x7f00240b7130 2024-06-02T16:45:20.083 INFO:teuthology.orchestra.run.smithi052.stdout:64424509444 2024-06-02T16:45:20.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.084+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 msgr2=0x7f4dfc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.084+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 0x7f4dfc0787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400bad0 tx=0x7f4e1c0ab000 comp rx=0 tx=0).stop 2024-06-02T16:45:20.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.084+0000 7f0020c00640 1 -- 172.21.15.52:0/30735113 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0014065330 con 0x7f00240b7130 2024-06-02T16:45:20.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.084+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 msgr2=0x7f4e1404bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.084+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c430 tx=0x7f4e1000c8f0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.086 INFO:teuthology.orchestra.run.smithi052.stdout:68719476742 2024-06-02T16:45:20.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 shutdown_connections 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4dfc076320 0x7f4dfc0787e0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400bad0 tx=0x7f4e1c0ab000 comp rx=0 tx=0).stop 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e14054560 0x7f4e140e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e14048100 0x7f4e1404bbc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 --2- 172.21.15.52:0/239109882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e14007460 0x7f4e140d6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.085+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 >> 172.21.15.52:0/239109882 conn(0x7f4e14009fe0 msgr2=0x7f4e14039140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.086+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 shutdown_connections 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.086+0000 7f4e23c00640 1 -- 172.21.15.52:0/239109882 wait complete. 2024-06-02T16:45:20.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd2a0159e20 con 0x7fd2a00d5c50 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 msgr2=0x7f00000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 0x7f00000787c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f000c02a0a0 tx=0x7f000c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 msgr2=0x7f00241eaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 0x7f00241eaef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f001400c440 tx=0x7f001400c900 comp rx=0 tx=0).stop 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 shutdown_connections 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0000076300 0x7f00000787c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00241631f0 0x7f002415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00240d5f10 0x7f00240cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 --2- 172.21.15.52:0/30735113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00240b7130 0x7f00241eaef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.088+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 >> 172.21.15.52:0/30735113 conn(0x7f002408cf50 msgr2=0x7f0024161350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.089+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 shutdown_connections 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.089+0000 7fd297e00640 1 -- 172.21.15.52:0/1680438057 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd28c064390 con 0x7fd2a00d5c50 2024-06-02T16:45:20.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.089+0000 7f002ac00640 1 -- 172.21.15.52:0/30735113 wait complete. 2024-06-02T16:45:20.091 INFO:teuthology.orchestra.run.smithi052.stdout:64424509444 2024-06-02T16:45:20.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 msgr2=0x7fd280078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 0x7fd280078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd290009890 tx=0x7fd290008040 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 msgr2=0x7fd2a015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c440 tx=0x7fd28c00c900 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 shutdown_connections 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2800762d0 0x7fd280078790 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd290009890 tx=0x7fd290008040 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2a0162ba0 0x7fd2a015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a00d5c50 0x7fd2a015e300 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c440 tx=0x7fd28c00c900 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 --2- 172.21.15.52:0/1680438057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2a00d2260 0x7fd2a01f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.092+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 >> 172.21.15.52:0/1680438057 conn(0x7fd2a009e5f0 msgr2=0x7fd2a006d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.093+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 shutdown_connections 2024-06-02T16:45:20.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.093+0000 7fd2a5600640 1 -- 172.21.15.52:0/1680438057 wait complete. 2024-06-02T16:45:20.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.094+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb6e00ae280 con 0x7fb6e006f470 2024-06-02T16:45:20.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.095+0000 7fb6d6000640 1 -- 172.21.15.52:0/2717419582 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6d8086cb0 con 0x7fb6e006f470 2024-06-02T16:45:20.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.095+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f83300dce80 con 0x7f8330054300 2024-06-02T16:45:20.095 INFO:teuthology.orchestra.run.smithi052.stdout:68719476740 2024-06-02T16:45:20.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.096+0000 7f832b400640 1 -- 172.21.15.52:0/62559502 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8324021020 con 0x7f8330054300 2024-06-02T16:45:20.096 INFO:teuthology.orchestra.run.smithi052.stdout:68719476743 2024-06-02T16:45:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.099+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 msgr2=0x7fb6bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.099+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 0x7fb6bc078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6e015de80 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2024-06-02T16:45:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.099+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 msgr2=0x7fb6e015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.099+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6d802cef0 tx=0x7fb6d8004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:20.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.1 2024-06-02T16:45:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 shutdown_connections 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb6bc0762d0 0x7fb6bc078790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6e015eb20 0x7fb6e015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e00b4650 0x7fb6e00c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 --2- 172.21.15.52:0/2717419582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6e006f470 0x7fb6e015a000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 >> 172.21.15.52:0/2717419582 conn(0x7fb6e00b2ff0 msgr2=0x7fb6e00b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 shutdown_connections 2024-06-02T16:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7fb6e4a00640 1 -- 172.21.15.52:0/2717419582 wait complete. 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 msgr2=0x7f8318078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.100+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 0x7f8318078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f832c006d40 tx=0x7f832c008040 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 msgr2=0x7f83300e4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8324005880 tx=0x7f832400c960 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 shutdown_connections 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83180762d0 0x7f8318078790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83300e30c0 0x7f833003d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8330054300 0x7f83300e4ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 --2- 172.21.15.52:0/62559502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f833003e840 0x7f83300d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 >> 172.21.15.52:0/62559502 conn(0x7f83300559e0 msgr2=0x7f8330057b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 shutdown_connections 2024-06-02T16:45:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.101+0000 7f833ca00640 1 -- 172.21.15.52:0/62559502 wait complete. 2024-06-02T16:45:20.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.111+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc848069c30 con 0x7fc8481653e0 2024-06-02T16:45:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.111+0000 7fc83f400640 1 -- 172.21.15.52:0/2236093290 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8480ca270 con 0x7fc8481653e0 2024-06-02T16:45:20.111 INFO:teuthology.orchestra.run.smithi052.stdout:68719476742 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.114+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 msgr2=0x7fc828078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.114+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 0x7fc828078810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc838009bd0 tx=0x7fc838009240 comp rx=0 tx=0).stop 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.114+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 msgr2=0x7fc8480cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.114+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c500 tx=0x7fc83400c9c0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 shutdown_connections 2024-06-02T16:45:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc828076350 0x7fc828078810 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8480badc0 0x7fc8480d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8481653e0 0x7fc8480cd440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 --2- 172.21.15.52:0/2236093290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8480b6e30 0x7fc848151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 >> 172.21.15.52:0/2236093290 conn(0x7fc84809e710 msgr2=0x7fc8480b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 shutdown_connections 2024-06-02T16:45:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:20.115+0000 7fc84e800640 1 -- 172.21.15.52:0/2236093290 wait complete. 2024-06-02T16:45:20.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.5 2024-06-02T16:45:20.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-06-02T16:45:20.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-06-02T16:45:20.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.6 2024-06-02T16:45:20.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476743 for osd.7 2024-06-02T16:45:20.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.4 2024-06-02T16:45:21.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T16:45:21.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T16:45:21.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T16:45:21.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T16:45:21.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T16:45:21.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T16:45:21.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T16:45:21.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T16:45:21.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.344+0000 7fda39200640 1 Processor -- start 2024-06-02T16:45:21.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.344+0000 7fda39200640 1 -- start start 2024-06-02T16:45:21.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.347+0000 7fda39200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 0x7fda34140010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.347+0000 7fda39200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda3415dfc0 0x7fda340d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.347+0000 7fda39200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda340b60a0 con 0x7fda340d0e70 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.347+0000 7fda39200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fda340d09e0 con 0x7fda34161ad0 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.347+0000 7fda39200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fda34160dc0 con 0x7fda3415dfc0 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.348+0000 7fda31400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fda340d0e70 0x7fda3415d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51894/0 (socket says 172.21.15.52:51894) 2024-06-02T16:45:21.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.348+0000 7fda31400640 1 -- 172.21.15.52:0/4090463446 learned_addr learned my addr 172.21.15.52:0/4090463446 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:21.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.348+0000 7fda32800640 1 --2- 172.21.15.52:0/4090463446 >> v2:172.21.15.114:3300/0 conn(0x7fda3415dfc0 0x7fda340d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.350+0000 7fda32800640 1 -- 172.21.15.52:0/4090463446 >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 msgr2=0x7fda34140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.352+0000 7fda31e00640 1 --2- 172.21.15.52:0/4090463446 >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 0x7fda34140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.352+0000 7fda32800640 1 --2- 172.21.15.52:0/4090463446 >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 0x7fda34140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.352+0000 7fda32800640 1 -- 172.21.15.52:0/4090463446 >> v1:172.21.15.52:6789/0 conn(0x7fda340d0e70 legacy=0x7fda3415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.352+0000 7fda32800640 1 -- 172.21.15.52:0/4090463446 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34160ff0 con 0x7fda3415dfc0 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.354+0000 7fda31e00640 1 --2- 172.21.15.52:0/4090463446 >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 0x7fda34140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.355+0000 7fda32800640 1 --2- 172.21.15.52:0/4090463446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda340d1320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda34161eb0 tx=0x7fda2c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b809860c140fa0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.358+0000 7fda30a00640 1 -- 172.21.15.52:0/4090463446 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007740 con 0x7fda3415dfc0 2024-06-02T16:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.359+0000 7fda30a00640 1 -- 172.21.15.52:0/4090463446 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0078e0 con 0x7fda3415dfc0 2024-06-02T16:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.359+0000 7fda30a00640 1 -- 172.21.15.52:0/4090463446 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007cf0 con 0x7fda3415dfc0 2024-06-02T16:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 -- 172.21.15.52:0/4090463446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 msgr2=0x7fda340d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 --2- 172.21.15.52:0/4090463446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda340d1320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda34161eb0 tx=0x7fda2c02a6c0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 -- 172.21.15.52:0/4090463446 shutdown_connections 2024-06-02T16:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 --2- 172.21.15.52:0/4090463446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda340d1320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 --2- 172.21.15.52:0/4090463446 >> v2:172.21.15.52:3300/0 conn(0x7fda34161ad0 0x7fda34140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.360+0000 7fda39200640 1 -- 172.21.15.52:0/4090463446 >> 172.21.15.52:0/4090463446 conn(0x7fda3406c380 msgr2=0x7fda3406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.361+0000 7fda39200640 1 -- 172.21.15.52:0/4090463446 shutdown_connections 2024-06-02T16:45:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.361+0000 7fda39200640 1 -- 172.21.15.52:0/4090463446 wait complete. 2024-06-02T16:45:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.364+0000 7fda39200640 1 Processor -- start 2024-06-02T16:45:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.364+0000 7fda39200640 1 -- start start 2024-06-02T16:45:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.366+0000 7fda39200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda31e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda39200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda3413bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda39200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda34161ad0 0x7fda3413c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda39200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda34157be0 con 0x7fda340d0e70 2024-06-02T16:45:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda39200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda341615b0 con 0x7fda3415dfc0 2024-06-02T16:45:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda39200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fda34140550 con 0x7fda34161ad0 2024-06-02T16:45:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda31e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53220/0 (socket says 172.21.15.52:53220) 2024-06-02T16:45:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.367+0000 7fda31e00640 1 -- 172.21.15.52:0/3151808029 learned_addr learned my addr 172.21.15.52:0/3151808029 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.369+0000 7fda31e00640 1 -- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda34161ad0 msgr2=0x7fda3413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.369+0000 7fda31e00640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda34161ad0 0x7fda3413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.369+0000 7fda31e00640 1 -- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 msgr2=0x7fda3413bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.369+0000 7fda31e00640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda3413bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.369+0000 7fda31e00640 1 -- 172.21.15.52:0/3151808029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34159080 con 0x7fda340d0e70 2024-06-02T16:45:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.370+0000 7fda31e00640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c7f0 tx=0x7fda2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.371+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20015070 con 0x7fda340d0e70 2024-06-02T16:45:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.371+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20007820 con 0x7fda340d0e70 2024-06-02T16:45:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.371+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20007bf0 con 0x7fda340d0e70 2024-06-02T16:45:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.372+0000 7fda39200640 1 -- 172.21.15.52:0/3151808029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda34159360 con 0x7fda340d0e70 2024-06-02T16:45:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.372+0000 7fda39200640 1 -- 172.21.15.52:0/3151808029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3415d510 con 0x7fda340d0e70 2024-06-02T16:45:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.379+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda20018070 con 0x7fda340d0e70 2024-06-02T16:45:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.380+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda08005290 con 0x7fda340d0e70 2024-06-02T16:45:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.386+0000 7fda2a000640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.386+0000 7fb06f200640 1 Processor -- start 2024-06-02T16:45:21.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.386+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fda20097590 con 0x7fda340d0e70 2024-06-02T16:45:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.386+0000 7fb06f200640 1 -- start start 2024-06-02T16:45:21.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.388+0000 7fda31400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb070159000 0x7fb07015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0700b3780 0x7fb07006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb07015ca00 con 0x7fb070159000 2024-06-02T16:45:21.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb07015ba70 con 0x7fb0700b3780 2024-06-02T16:45:21.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.389+0000 7fb06f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb0701593e0 con 0x7fb07015f060 2024-06-02T16:45:21.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.390+0000 7fb06d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.390+0000 7fb06d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56512/0 (socket says 172.21.15.52:56512) 2024-06-02T16:45:21.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.390+0000 7fb06d400640 1 -- 172.21.15.52:0/673960715 learned_addr learned my addr 172.21.15.52:0/673960715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06e800640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.114:3300/0 conn(0x7fb0700b3780 0x7fb07006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06de00640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.52:3300/0 conn(0x7fb070159000 0x7fb07015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06d400640 1 -- 172.21.15.52:0/673960715 >> v2:172.21.15.114:3300/0 conn(0x7fb0700b3780 msgr2=0x7fb07006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06d400640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.114:3300/0 conn(0x7fb0700b3780 0x7fb07006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06d400640 1 -- 172.21.15.52:0/673960715 >> v2:172.21.15.52:3300/0 conn(0x7fb070159000 msgr2=0x7fb07015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06d400640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.52:3300/0 conn(0x7fb070159000 0x7fb07015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.391+0000 7fb06d400640 1 -- 172.21.15.52:0/673960715 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07015fa40 con 0x7fb07015f060 2024-06-02T16:45:21.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.392+0000 7fda31400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda24005880 tx=0x7fda24007a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.393+0000 7fb06d400640 1 --2- 172.21.15.52:0/673960715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0700d0c00 tx=0x7fb05c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc6ff581c30d9b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.394+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda20060e50 con 0x7fda340d0e70 2024-06-02T16:45:21.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.394+0000 7fb06ca00640 1 -- 172.21.15.52:0/673960715 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c037070 con 0x7fb07015f060 2024-06-02T16:45:21.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.394+0000 7fb06ca00640 1 -- 172.21.15.52:0/673960715 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c032440 con 0x7fb07015f060 2024-06-02T16:45:21.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.394+0000 7fb06ca00640 1 -- 172.21.15.52:0/673960715 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c032850 con 0x7fb07015f060 2024-06-02T16:45:21.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.395+0000 7fb06f200640 1 -- 172.21.15.52:0/673960715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 msgr2=0x7fb07006f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.395+0000 7fb06f200640 1 --2- 172.21.15.52:0/673960715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0700d0c00 tx=0x7fb05c02a210 comp rx=0 tx=0).stop 2024-06-02T16:45:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7f569d000640 1 Processor -- start 2024-06-02T16:45:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7f569d000640 1 -- start start 2024-06-02T16:45:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7fb06f200640 1 -- 172.21.15.52:0/673960715 shutdown_connections 2024-06-02T16:45:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7fb06f200640 1 --2- 172.21.15.52:0/673960715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb07015f060 0x7fb07006f670 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7fb06f200640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.114:3300/0 conn(0x7fb0700b3780 0x7fb07006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7fb06f200640 1 --2- 172.21.15.52:0/673960715 >> v2:172.21.15.52:3300/0 conn(0x7fb070159000 0x7fb07015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.396+0000 7fb06f200640 1 -- 172.21.15.52:0/673960715 >> 172.21.15.52:0/673960715 conn(0x7fb0700b2c90 msgr2=0x7fb0700b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.397+0000 7fb06f200640 1 -- 172.21.15.52:0/673960715 shutdown_connections 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.397+0000 7fb06f200640 1 -- 172.21.15.52:0/673960715 wait complete. 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.398+0000 7f569d000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f56980b7130 0x7f56980b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.398+0000 7f569d000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56980b7b20 con 0x7f56981631f0 2024-06-02T16:45:21.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.398+0000 7f569d000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f569806ee90 con 0x7f56980d5f10 2024-06-02T16:45:21.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.398+0000 7f569d000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f56980b7e00 con 0x7f56980b7130 2024-06-02T16:45:21.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.399+0000 7f5695e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f56980b7130 0x7f56980b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.399+0000 7f5696800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f56981631f0 0x7f56980cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51908/0 (socket says 172.21.15.52:51908) 2024-06-02T16:45:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.399+0000 7f5696800640 1 -- 172.21.15.52:0/589248734 learned_addr learned my addr 172.21.15.52:0/589248734 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.399+0000 7fb06f200640 1 Processor -- start 2024-06-02T16:45:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.400+0000 7fb06f200640 1 -- start start 2024-06-02T16:45:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.400+0000 7f5695e00640 1 -- 172.21.15.52:0/589248734 >> v1:172.21.15.114:6789/0 conn(0x7f56980d5f10 legacy=0x7f5698162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.400+0000 7f5695e00640 1 -- 172.21.15.52:0/589248734 >> v1:172.21.15.52:6789/0 conn(0x7f56981631f0 legacy=0x7f56980cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.400+0000 7f5695e00640 1 -- 172.21.15.52:0/589248734 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569806f170 con 0x7f56980b7130 2024-06-02T16:45:21.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.401+0000 7f5695e00640 1 --2- 172.21.15.52:0/589248734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b7510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c827d69c3e593ae4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb070159000 0x7fb070149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7f5694a00640 1 -- 172.21.15.52:0/589248734 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690007740 con 0x7f56980b7130 2024-06-02T16:45:21.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7f5694a00640 1 -- 172.21.15.52:0/589248734 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56900078e0 con 0x7f56980b7130 2024-06-02T16:45:21.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7f5694a00640 1 -- 172.21.15.52:0/589248734 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690007cb0 con 0x7f56980b7130 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 0x7fb0700b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb07015bfa0 con 0x7fb07015f060 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb07015bcc0 con 0x7fb0700b3780 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.402+0000 7fb06f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb0700d06c0 con 0x7fb070159000 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7fb06de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7fb06de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52708/0 (socket says 172.21.15.52:52708) 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7fb06de00640 1 -- 172.21.15.52:0/3587882613 learned_addr learned my addr 172.21.15.52:0/3587882613 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7fb06d400640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb070159000 0x7fb070149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 -- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb070159000 msgr2=0x7fb070149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7f569d000640 1 -- 172.21.15.52:0/589248734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 msgr2=0x7f56980b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.403+0000 7f569d000640 1 --2- 172.21.15.52:0/589248734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b7510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569002a530 comp rx=0 tx=0).stop 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7f569d000640 1 -- 172.21.15.52:0/589248734 shutdown_connections 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7f569d000640 1 --2- 172.21.15.52:0/589248734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b7510 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7f569d000640 1 -- 172.21.15.52:0/589248734 >> 172.21.15.52:0/589248734 conn(0x7f569808cf50 msgr2=0x7f56980d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06e800640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 0x7fb0700b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb070159000 0x7fb070149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 -- 172.21.15.52:0/3587882613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 msgr2=0x7fb0700b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 0x7fb0700b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 -- 172.21.15.52:0/3587882613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb070148500 con 0x7fb0700b3780 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06e800640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 0x7fb0700b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7fb06de00640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb068007ef0 tx=0x7fb06800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7f569d000640 1 -- 172.21.15.52:0/589248734 shutdown_connections 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.404+0000 7f569d000640 1 -- 172.21.15.52:0/589248734 wait complete. 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.405+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068014620 con 0x7fb0700b3780 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.405+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb068019070 con 0x7fb0700b3780 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.405+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0680149e0 con 0x7fb0700b3780 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.405+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0701487e0 con 0x7fb0700b3780 2024-06-02T16:45:21.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.406+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb070148da0 con 0x7fb0700b3780 2024-06-02T16:45:21.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.408+0000 7f569d000640 1 Processor -- start 2024-06-02T16:45:21.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.408+0000 7f569d000640 1 -- start start 2024-06-02T16:45:21.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980d5f10 0x7f5698071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56980d4270 con 0x7f56981631f0 2024-06-02T16:45:21.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b49f0 con 0x7f56980b7130 2024-06-02T16:45:21.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7f569d000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f56980d43f0 con 0x7f56980d5f10 2024-06-02T16:45:21.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.410+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb068014b80 con 0x7fb0700b3780 2024-06-02T16:45:21.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.411+0000 7f5696800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.411+0000 7f5695e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.411+0000 7f5696800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53256/0 (socket says 172.21.15.52:53256) 2024-06-02T16:45:21.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.411+0000 7f5696800640 1 -- 172.21.15.52:0/419676044 learned_addr learned my addr 172.21.15.52:0/419676044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.411+0000 7f5695400640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980d5f10 0x7f5698071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7f5696800640 1 -- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980d5f10 msgr2=0x7f5698071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7f5696800640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980d5f10 0x7f5698071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7f5696800640 1 -- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 msgr2=0x7f56980b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7f5696800640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7f5696800640 1 -- 172.21.15.52:0/419676044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56980728b0 con 0x7f56981631f0 2024-06-02T16:45:21.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.412+0000 7fb066000640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 0x7fb050078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.413+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb068097ec0 con 0x7fb0700b3780 2024-06-02T16:45:21.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.413+0000 7f5696800640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f568000b4c0 tx=0x7f568000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.414+0000 7fb06d400640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 0x7fb050078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.414+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680015020 con 0x7f56981631f0 2024-06-02T16:45:21.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.414+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5680011850 con 0x7f56981631f0 2024-06-02T16:45:21.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.414+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0700507e0 con 0x7fb0700b3780 2024-06-02T16:45:21.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.414+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680011c40 con 0x7f56981631f0 2024-06-02T16:45:21.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.415+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5698072b90 con 0x7f56981631f0 2024-06-02T16:45:21.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.415+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5698073150 con 0x7f56981631f0 2024-06-02T16:45:21.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.416+0000 7fb1ae800640 1 Processor -- start 2024-06-02T16:45:21.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.417+0000 7fb06d400640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 0x7fb050078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb05c034000 tx=0x7fb05c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.417+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56981625b0 con 0x7f56981631f0 2024-06-02T16:45:21.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.417+0000 7fb1ae800640 1 -- start start 2024-06-02T16:45:21.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.417+0000 7efc3fa00640 1 Processor -- start 2024-06-02T16:45:21.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.417+0000 7efc3fa00640 1 -- start start 2024-06-02T16:45:21.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.419+0000 7efc3fa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.419+0000 7efc3fa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc380d5b50 0x7efc380d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.419+0000 7efc3fa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc380d62c0 con 0x7efc380d1e30 2024-06-02T16:45:21.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.419+0000 7efc3fa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efc380d00f0 con 0x7efc380d5b50 2024-06-02T16:45:21.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.419+0000 7efc3fa00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7efc380d03d0 con 0x7efc380b4790 2024-06-02T16:45:21.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.420+0000 7efc3d000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.420+0000 7efc3d000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56542/0 (socket says 172.21.15.52:56542) 2024-06-02T16:45:21.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.420+0000 7efc3d000640 1 -- 172.21.15.52:0/236626636 learned_addr learned my addr 172.21.15.52:0/236626636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.420+0000 7fb1ae800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1ae800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a80738b0 con 0x7fb1a80d0510 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1ae800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a8073b90 con 0x7fb1a815f5b0 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1ae800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a80d08f0 con 0x7fb1a815fc30 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1a6a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1a6a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56544/0 (socket says 172.21.15.52:56544) 2024-06-02T16:45:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.421+0000 7fb1a6a00640 1 -- 172.21.15.52:0/1218610972 learned_addr learned my addr 172.21.15.52:0/1218610972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.420+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5680018020 con 0x7f56981631f0 2024-06-02T16:45:21.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7fb1a6a00640 1 -- 172.21.15.52:0/1218610972 >> v1:172.21.15.114:6789/0 conn(0x7fb1a815f5b0 legacy=0x7fb1a8155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7fb1a6a00640 1 -- 172.21.15.52:0/1218610972 >> v1:172.21.15.52:6789/0 conn(0x7fb1a80d0510 legacy=0x7fb1a8072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7fb1a6a00640 1 -- 172.21.15.52:0/1218610972 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a8073e70 con 0x7fb1a815fc30 2024-06-02T16:45:21.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7efc3d000640 1 -- 172.21.15.52:0/236626636 >> v2:172.21.15.52:3300/0 conn(0x7efc380d5b50 msgr2=0x7efc380d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7f568e000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 0x7f5674078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f56800973e0 con 0x7f56981631f0 2024-06-02T16:45:21.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7efc3d000640 1 --2- 172.21.15.52:0/236626636 >> v2:172.21.15.52:3300/0 conn(0x7efc380d5b50 0x7efc380d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.422+0000 7efc3d000640 1 -- 172.21.15.52:0/236626636 >> v1:172.21.15.52:6789/0 conn(0x7efc380d1e30 legacy=0x7efc3806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.423+0000 7f5695e00640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 0x7f5674078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.423+0000 7efc3d000640 1 -- 172.21.15.52:0/236626636 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc380d06b0 con 0x7efc380b4790 2024-06-02T16:45:21.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.424+0000 7fb1a6a00640 1 --2- 172.21.15.52:0/1218610972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb198009210 tx=0x7fb19802b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10bdc9f57535544a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.424+0000 7f5695e00640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 0x7f5674078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7fb1a6000640 1 -- 172.21.15.52:0/1218610972 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198037070 con 0x7fb1a815fc30 2024-06-02T16:45:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7efc3d000640 1 --2- 172.21.15.52:0/236626636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc28009e50 tx=0x7efc2802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d975a75890a818a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7fb1a6000640 1 -- 172.21.15.52:0/1218610972 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb198030710 con 0x7fb1a815fc30 2024-06-02T16:45:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7fb1a6000640 1 -- 172.21.15.52:0/1218610972 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198030ae0 con 0x7fb1a815fc30 2024-06-02T16:45:21.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7efc37e00640 1 -- 172.21.15.52:0/236626636 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28036070 con 0x7efc380b4790 2024-06-02T16:45:21.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7efc37e00640 1 -- 172.21.15.52:0/236626636 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28031600 con 0x7efc380b4790 2024-06-02T16:45:21.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.425+0000 7efc37e00640 1 -- 172.21.15.52:0/236626636 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc280319d0 con 0x7efc380b4790 2024-06-02T16:45:21.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 -- 172.21.15.52:0/236626636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 msgr2=0x7efc380d3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 --2- 172.21.15.52:0/236626636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc28009e50 tx=0x7efc2802a680 comp rx=0 tx=0).stop 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7fb1ae800640 1 -- 172.21.15.52:0/1218610972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 msgr2=0x7fb1a815f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7fb1ae800640 1 --2- 172.21.15.52:0/1218610972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb198009210 tx=0x7fb19802b4f0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 -- 172.21.15.52:0/236626636 shutdown_connections 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 --2- 172.21.15.52:0/236626636 >> v2:172.21.15.52:3300/0 conn(0x7efc380d5b50 0x7efc380d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 --2- 172.21.15.52:0/236626636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380b4790 0x7efc380d3f50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.426+0000 7efc3fa00640 1 -- 172.21.15.52:0/236626636 >> 172.21.15.52:0/236626636 conn(0x7efc3808cf50 msgr2=0x7efc380d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.427+0000 7fb1ae800640 1 -- 172.21.15.52:0/1218610972 shutdown_connections 2024-06-02T16:45:21.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.427+0000 7fb1ae800640 1 --2- 172.21.15.52:0/1218610972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815fc30 0x7fb1a815f070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.427+0000 7fb1ae800640 1 -- 172.21.15.52:0/1218610972 >> 172.21.15.52:0/1218610972 conn(0x7fb1a80b3200 msgr2=0x7fb1a80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.427+0000 7efc3fa00640 1 -- 172.21.15.52:0/236626636 shutdown_connections 2024-06-02T16:45:21.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.427+0000 7efc3fa00640 1 -- 172.21.15.52:0/236626636 wait complete. 2024-06-02T16:45:21.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.429+0000 7fb1ae800640 1 -- 172.21.15.52:0/1218610972 shutdown_connections 2024-06-02T16:45:21.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.429+0000 7fb1ae800640 1 -- 172.21.15.52:0/1218610972 wait complete. 2024-06-02T16:45:21.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.430+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56981625b0 con 0x7f56981631f0 2024-06-02T16:45:21.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.430+0000 7efc3fa00640 1 Processor -- start 2024-06-02T16:45:21.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.430+0000 7efc3fa00640 1 -- start start 2024-06-02T16:45:21.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc380b4790 0x7efc381548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efc380b4cf0 con 0x7efc380d5b50 2024-06-02T16:45:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc380b4b70 con 0x7efc380b4790 2024-06-02T16:45:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3fa00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7efc380d13f0 con 0x7efc380d1e30 2024-06-02T16:45:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7fb1ae800640 1 Processor -- start 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.433+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56546/0 (socket says 172.21.15.52:56546) 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.433+0000 7efc2fe00640 1 -- 172.21.15.52:0/2308373 learned_addr learned my addr 172.21.15.52:0/2308373 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.433+0000 7efc3d000640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc380b4790 0x7efc381548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.432+0000 7efc3da00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53284/0 (socket says 172.21.15.52:53284) 2024-06-02T16:45:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.433+0000 7fb1ae800640 1 -- start start 2024-06-02T16:45:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.433+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb068061800 con 0x7fb0700b3780 2024-06-02T16:45:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.434+0000 7efc2fe00640 1 -- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc380b4790 msgr2=0x7efc381548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.434+0000 7efc2fe00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc380b4790 0x7efc381548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.434+0000 7efc2fe00640 1 -- 172.21.15.52:0/2308373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 msgr2=0x7efc380ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.434+0000 7efc2fe00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.435+0000 7efc2fe00640 1 -- 172.21.15.52:0/2308373 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc38154df0 con 0x7efc380d1e30 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.435+0000 7fb1ae800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.435+0000 7efc3da00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:21.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.435+0000 7fb1ae800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815f5b0 0x7fb1a806c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.436+0000 7efc2fe00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc2000b4a0 tx=0x7efc2000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.436+0000 7fb1ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a815fc30 0x7fb1a806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.436+0000 7fb1ae800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8074430 con 0x7fb1a80d0510 2024-06-02T16:45:21.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.436+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20014070 con 0x7efc380d1e30 2024-06-02T16:45:21.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc20005a10 con 0x7efc380d1e30 2024-06-02T16:45:21.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20005e40 con 0x7efc380d1e30 2024-06-02T16:45:21.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7fb1ae800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8073670 con 0x7fb1a815fc30 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7fb1a7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a815fc30 0x7fb1a806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7fb1a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7fb1ae800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a806f590 con 0x7fb1a815f5b0 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.438+0000 7fb1a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53290/0 (socket says 172.21.15.52:53290) 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.438+0000 7fb1a7400640 1 -- 172.21.15.52:0/3376723464 learned_addr learned my addr 172.21.15.52:0/3376723464 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a6a00640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815f5b0 0x7fb1a806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a7400640 1 -- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815f5b0 msgr2=0x7fb1a806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a7400640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815f5b0 0x7fb1a806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a7400640 1 -- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a815fc30 msgr2=0x7fb1a806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a7400640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a815fc30 0x7fb1a806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.439+0000 7fb1a7400640 1 -- 172.21.15.52:0/3376723464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a80b0870 con 0x7fb1a80d0510 2024-06-02T16:45:21.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.437+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc380b9a10 con 0x7efc380d1e30 2024-06-02T16:45:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.440+0000 7fb1a7400640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c7b0 tx=0x7fb19400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.440+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc380c8e20 con 0x7efc380d1e30 2024-06-02T16:45:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.442+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc38069520 con 0x7efc380d1e30 2024-06-02T16:45:21.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.443+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194017070 con 0x7fb1a80d0510 2024-06-02T16:45:21.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.443+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a80b0b50 con 0x7fb1a80d0510 2024-06-02T16:45:21.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.443+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a80b1110 con 0x7fb1a80d0510 2024-06-02T16:45:21.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.443+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194005290 con 0x7fb1a80d0510 2024-06-02T16:45:21.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.443+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19400ce60 con 0x7fb1a80d0510 2024-06-02T16:45:21.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.445+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc20010610 con 0x7efc380d1e30 2024-06-02T16:45:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.445+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb180005290 con 0x7fb1a80d0510 2024-06-02T16:45:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.447+0000 7efc35600640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 0x7efc14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.447+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc200973d0 con 0x7efc380d1e30 2024-06-02T16:45:21.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.449+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb19401a070 con 0x7fb1a80d0510 2024-06-02T16:45:21.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.450+0000 7fb19f400640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 0x7fb188078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.451+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb194096d50 con 0x7fb1a80d0510 2024-06-02T16:45:21.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.451+0000 7efc3d000640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 0x7efc14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.452+0000 7fb1a6a00640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 0x7fb188078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.453+0000 7fb1a6a00640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 0x7fb188078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb198034000 tx=0x7fb198008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.455+0000 7efc3d000640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 0x7efc14078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc28033000 tx=0x7efc28009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.457+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb194021020 con 0x7fb1a80d0510 2024-06-02T16:45:21.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.458+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc20060650 con 0x7efc380d1e30 2024-06-02T16:45:21.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.466+0000 7fb568e00640 1 Processor -- start 2024-06-02T16:45:21.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.466+0000 7fb568e00640 1 -- start start 2024-06-02T16:45:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.468+0000 7fb568e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb564163320 0x7fb5640ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.468+0000 7fb568e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163700 0x7fb5640723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.468+0000 7fb568e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb564163c30 con 0x7fb5640b5690 2024-06-02T16:45:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.468+0000 7fb568e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb56406e5f0 con 0x7fb564163320 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.468+0000 7fb568e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb56406ee90 con 0x7fb564163700 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.469+0000 7fb563400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb564163320 0x7fb5640ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.469+0000 7fb563400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb564163320 0x7fb5640ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52750/0 (socket says 172.21.15.52:52750) 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.469+0000 7fb563400640 1 -- 172.21.15.52:0/3407859549 learned_addr learned my addr 172.21.15.52:0/3407859549 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.470+0000 7fb563400640 1 -- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163700 msgr2=0x7fb5640723b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.470+0000 7fb563400640 1 --2- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163700 0x7fb5640723b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.470+0000 7fb563400640 1 -- 172.21.15.52:0/3407859549 >> v1:172.21.15.114:6789/0 conn(0x7fb5640b5690 legacy=0x7fb56406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.470+0000 7fb563400640 1 -- 172.21.15.52:0/3407859549 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56406e840 con 0x7fb564163320 2024-06-02T16:45:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.472+0000 7fb563400640 1 --2- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb564163320 0x7fb5640ade40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8533c125fcf9f1c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.472+0000 7fb562000640 1 -- 172.21.15.52:0/3407859549 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554037070 con 0x7fb564163320 2024-06-02T16:45:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.473+0000 7fb562000640 1 -- 172.21.15.52:0/3407859549 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb554032440 con 0x7fb564163320 2024-06-02T16:45:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.473+0000 7fb562000640 1 -- 172.21.15.52:0/3407859549 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554032810 con 0x7fb564163320 2024-06-02T16:45:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.474+0000 7fb568e00640 1 -- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb564163320 msgr2=0x7fb5640ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.474+0000 7fb568e00640 1 --2- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb564163320 0x7fb5640ade40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402a160 comp rx=0 tx=0).stop 2024-06-02T16:45:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.475+0000 7fb568e00640 1 -- 172.21.15.52:0/3407859549 shutdown_connections 2024-06-02T16:45:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.475+0000 7fb568e00640 1 --2- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163700 0x7fb5640723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.475+0000 7fb568e00640 1 --2- 172.21.15.52:0/3407859549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb564163320 0x7fb5640ade40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.475+0000 7fb568e00640 1 -- 172.21.15.52:0/3407859549 >> 172.21.15.52:0/3407859549 conn(0x7fb5640b2b60 msgr2=0x7fb5640b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.475+0000 7fb568e00640 1 -- 172.21.15.52:0/3407859549 shutdown_connections 2024-06-02T16:45:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.476+0000 7fb568e00640 1 -- 172.21.15.52:0/3407859549 wait complete. 2024-06-02T16:45:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.478+0000 7fca3a400640 1 Processor -- start 2024-06-02T16:45:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.478+0000 7fca3a400640 1 -- start start 2024-06-02T16:45:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.479+0000 7fb568e00640 1 Processor -- start 2024-06-02T16:45:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fb568e00640 1 -- start start 2024-06-02T16:45:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca3a400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca340badc0 0x7fca340d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca3a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca3a400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca340d3e20 con 0x7fca3415f420 2024-06-02T16:45:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca3a400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fca340d4a30 con 0x7fca340badc0 2024-06-02T16:45:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca3a400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fca340d3bc0 con 0x7fca340d0660 2024-06-02T16:45:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.480+0000 7fca39a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca39a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52764/0 (socket says 172.21.15.52:52764) 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca39a00640 1 -- 172.21.15.52:0/4235104271 learned_addr learned my addr 172.21.15.52:0/4235104271 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca33e00640 1 --2- 172.21.15.52:0/4235104271 >> v2:172.21.15.52:3300/0 conn(0x7fca340badc0 0x7fca340d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca33e00640 1 -- 172.21.15.52:0/4235104271 >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 msgr2=0x7fca340b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca33e00640 1 --2- 172.21.15.52:0/4235104271 >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca33e00640 1 -- 172.21.15.52:0/4235104271 >> v1:172.21.15.114:6789/0 conn(0x7fca3415f420 legacy=0x7fca340d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.481+0000 7fca33e00640 1 -- 172.21.15.52:0/4235104271 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340d4100 con 0x7fca340badc0 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fca39a00640 1 --2- 172.21.15.52:0/4235104271 >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 0x7fb5641573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163320 0x7fb5641eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 0x7fb56415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b5ef0 con 0x7fb564163700 2024-06-02T16:45:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b5d70 con 0x7fb5640b5690 2024-06-02T16:45:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.482+0000 7fb568e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640b6070 con 0x7fb564163320 2024-06-02T16:45:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fca33e00640 1 --2- 172.21.15.52:0/4235104271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340badc0 0x7fca340d0120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca340d49a0 tx=0x7fca2402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469a1d0b456a5532 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fb563400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 0x7fb5641573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fb563400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 0x7fb5641573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52778/0 (socket says 172.21.15.52:52778) 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fb563400640 1 -- 172.21.15.52:0/394032749 learned_addr learned my addr 172.21.15.52:0/394032749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fb562a00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163320 0x7fb5641eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.483+0000 7fb563e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 0x7fb56415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.484+0000 7fca33400640 1 -- 172.21.15.52:0/4235104271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24037070 con 0x7fca340badc0 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.484+0000 7fca33400640 1 -- 172.21.15.52:0/4235104271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca24032440 con 0x7fca340badc0 2024-06-02T16:45:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.484+0000 7fca33400640 1 -- 172.21.15.52:0/4235104271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24032850 con 0x7fca340badc0 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 -- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163320 msgr2=0x7fb5641eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163320 0x7fb5641eac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 -- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 msgr2=0x7fb5641573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 -- 172.21.15.52:0/4235104271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340badc0 msgr2=0x7fca340d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 --2- 172.21.15.52:0/4235104271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340badc0 0x7fca340d0120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca340d49a0 tx=0x7fca2402a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 0x7fb5641573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 -- 172.21.15.52:0/394032749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5641eb680 con 0x7fb564163700 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 -- 172.21.15.52:0/4235104271 shutdown_connections 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 --2- 172.21.15.52:0/4235104271 >> v2:172.21.15.114:3300/0 conn(0x7fca340d0660 0x7fca340b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 --2- 172.21.15.52:0/4235104271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340badc0 0x7fca340d0120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 -- 172.21.15.52:0/4235104271 >> 172.21.15.52:0/4235104271 conn(0x7fca340740e0 msgr2=0x7fca3406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 -- 172.21.15.52:0/4235104271 shutdown_connections 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fca3a400640 1 -- 172.21.15.52:0/4235104271 wait complete. 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.485+0000 7fb563e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 0x7fb56415ad10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c650 tx=0x7fb55c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.486+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c016020 con 0x7fb564163700 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.486+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c00a840 con 0x7fb564163700 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.486+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c016020 con 0x7fb564163700 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.486+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641f8fa0 con 0x7fb564163700 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.487+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564157930 con 0x7fb564163700 2024-06-02T16:45:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.488+0000 7fca3a400640 1 Processor -- start 2024-06-02T16:45:21.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.491+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb55c019020 con 0x7fb564163700 2024-06-02T16:45:21.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.491+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5640507e0 con 0x7fb564163700 2024-06-02T16:45:21.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.492+0000 7fca3a400640 1 -- start start 2024-06-02T16:45:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340d0660 0x7fca341569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca3415f420 0x7fca340cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca340d4ec0 con 0x7fca340d0660 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca340d46c0 con 0x7fca340ca1c0 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.493+0000 7fca3a400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fca340ca710 con 0x7fca3415f420 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.494+0000 7fca39a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.494+0000 7fca33e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca3415f420 0x7fca340cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.494+0000 7fca39a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:52790/0 (socket says 172.21.15.52:52790) 2024-06-02T16:45:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.494+0000 7fca39a00640 1 -- 172.21.15.52:0/372961521 learned_addr learned my addr 172.21.15.52:0/372961521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 -- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca3415f420 msgr2=0x7fca340cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca3415f420 0x7fca340cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 -- 172.21.15.52:0/372961521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340d0660 msgr2=0x7fca341569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340d0660 0x7fca341569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 -- 172.21.15.52:0/372961521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340ca9f0 con 0x7fca340ca1c0 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.492+0000 7fb55b400640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 0x7fb544078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.495+0000 7fca39a00640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca2000e930 tx=0x7fca2000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fb563400640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 0x7fb544078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20017070 con 0x7fca340ca1c0 2024-06-02T16:45:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2000ca00 con 0x7fca340ca1c0 2024-06-02T16:45:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb55c09b060 con 0x7fb564163700 2024-06-02T16:45:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2000cdb0 con 0x7fca340ca1c0 2024-06-02T16:45:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.496+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca340cacd0 con 0x7fca340ca1c0 2024-06-02T16:45:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.497+0000 7efdd9600640 1 Processor -- start 2024-06-02T16:45:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.497+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca340cb290 con 0x7fca340ca1c0 2024-06-02T16:45:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.498+0000 7fb563400640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 0x7fb544078990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5540090b0 tx=0x7fb55402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.497+0000 7efdd9600640 1 -- start start 2024-06-02T16:45:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.499+0000 7efdd9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdd41631f0 0x7efdd40b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.499+0000 7efdd9600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.499+0000 7efdd9600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd40b7b20 con 0x7efdd40b7130 2024-06-02T16:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.499+0000 7efdd9600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efdd40b7e00 con 0x7efdd41631f0 2024-06-02T16:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.499+0000 7efdd9600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7efdd406ee90 con 0x7efdd40d5f10 2024-06-02T16:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.500+0000 7efdd3400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.500+0000 7efdd3400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56590/0 (socket says 172.21.15.52:56590) 2024-06-02T16:45:21.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.500+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca34156740 con 0x7fca340ca1c0 2024-06-02T16:45:21.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.500+0000 7efdd3400640 1 -- 172.21.15.52:0/543758243 learned_addr learned my addr 172.21.15.52:0/543758243 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.500+0000 7efdd2000640 1 --2- 172.21.15.52:0/543758243 >> v2:172.21.15.114:3300/0 conn(0x7efdd41631f0 0x7efdd40b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.501+0000 7efdd3400640 1 -- 172.21.15.52:0/543758243 >> v2:172.21.15.114:3300/0 conn(0x7efdd41631f0 msgr2=0x7efdd40b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.501+0000 7efdd3400640 1 --2- 172.21.15.52:0/543758243 >> v2:172.21.15.114:3300/0 conn(0x7efdd41631f0 0x7efdd40b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.501+0000 7efdd3400640 1 -- 172.21.15.52:0/543758243 >> v1:172.21.15.114:6789/0 conn(0x7efdd40b7130 legacy=0x7efdd4162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.501+0000 7efdd3400640 1 -- 172.21.15.52:0/543758243 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd406f170 con 0x7efdd40d5f10 2024-06-02T16:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.503+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca20004020 con 0x7fca340ca1c0 2024-06-02T16:45:21.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7efdd3400640 1 --2- 172.21.15.52:0/543758243 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009e50 tx=0x7efdcc02a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb8b70aa91205de server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb55c05f810 con 0x7fb564163700 2024-06-02T16:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7fca30c00640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 0x7fca14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fca20098070 con 0x7fca340ca1c0 2024-06-02T16:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7efdd1600640 1 -- 172.21.15.52:0/543758243 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc036070 con 0x7efdd40d5f10 2024-06-02T16:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7efdd1600640 1 -- 172.21.15.52:0/543758243 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc031600 con 0x7efdd40d5f10 2024-06-02T16:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.505+0000 7efdd1600640 1 -- 172.21.15.52:0/543758243 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0319b0 con 0x7efdd40d5f10 2024-06-02T16:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7efdd9600640 1 -- 172.21.15.52:0/543758243 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 msgr2=0x7efdd40b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7efdd9600640 1 --2- 172.21.15.52:0/543758243 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009e50 tx=0x7efdcc02a6c0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7fca39000640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 0x7fca14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7efdd9600640 1 -- 172.21.15.52:0/543758243 shutdown_connections 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7efdd9600640 1 --2- 172.21.15.52:0/543758243 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40d5f10 0x7efdd40b42b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.506+0000 7efdd9600640 1 --2- 172.21.15.52:0/543758243 >> v2:172.21.15.114:3300/0 conn(0x7efdd41631f0 0x7efdd40b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.507+0000 7efdd9600640 1 -- 172.21.15.52:0/543758243 >> 172.21.15.52:0/543758243 conn(0x7efdd408cf50 msgr2=0x7efdd40d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.507+0000 7efdd9600640 1 -- 172.21.15.52:0/543758243 shutdown_connections 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.507+0000 7efdd9600640 1 -- 172.21.15.52:0/543758243 wait complete. 2024-06-02T16:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.507+0000 7fca39000640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 0x7fca14078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001c50 tx=0x7fca2c007cf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.510+0000 7efdd9600640 1 Processor -- start 2024-06-02T16:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.510+0000 7efdd9600640 1 -- start start 2024-06-02T16:45:21.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd9600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 0x7efdd40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdd41631f0 0x7efdd40b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd2a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd9600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40d4270 con 0x7efdd40d5f10 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.513+0000 7efdd9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40b49f0 con 0x7efdd41631f0 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.513+0000 7efdd9600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7efdd40d43f0 con 0x7efdd40b7130 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.512+0000 7efdd2a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:56600/0 (socket says 172.21.15.52:56600) 2024-06-02T16:45:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.513+0000 7efdd2a00640 1 -- 172.21.15.52:0/137740329 learned_addr learned my addr 172.21.15.52:0/137740329 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.513+0000 7efdd2000640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 0x7efdd40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2a00640 1 -- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdd41631f0 msgr2=0x7efdd40b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2a00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdd41631f0 0x7efdd40b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2a00640 1 -- 172.21.15.52:0/137740329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 msgr2=0x7efdd40b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2a00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 0x7efdd40b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2a00640 1 -- 172.21.15.52:0/137740329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd415e5a0 con 0x7efdd40b7130 2024-06-02T16:45:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.514+0000 7efdd2000640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 0x7efdd40b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdd2a00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c500 tx=0x7efdc000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00052d0 con 0x7efdd40b7130 2024-06-02T16:45:21.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc0005470 con 0x7efdd40b7130 2024-06-02T16:45:21.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0012870 con 0x7efdd40b7130 2024-06-02T16:45:21.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdd9600640 1 -- 172.21.15.52:0/137740329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd415e840 con 0x7efdd40b7130 2024-06-02T16:45:21.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.515+0000 7efdd9600640 1 -- 172.21.15.52:0/137740329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd415ee00 con 0x7efdd40b7130 2024-06-02T16:45:21.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.516+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca20061a40 con 0x7fca340ca1c0 2024-06-02T16:45:21.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.517+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd41625b0 con 0x7efdd40b7130 2024-06-02T16:45:21.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.522+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efdc0012a10 con 0x7efdd40b7130 2024-06-02T16:45:21.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.523+0000 7efdcaa00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 0x7efdb4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:21.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.524+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efdc0097c10 con 0x7efdd40b7130 2024-06-02T16:45:21.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.524+0000 7efdd2000640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 0x7efdb4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:21.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.526+0000 7efdd2000640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 0x7efdb4078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efdd40cbf90 tx=0x7efdc4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:21.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.533+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efdd41625b0 con 0x7efdd40b7130 2024-06-02T16:45:21.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.855+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fda08005580 con 0x7fda340d0e70 2024-06-02T16:45:21.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.856+0000 7fda2a000640 1 -- 172.21.15.52:0/3151808029 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda20060750 con 0x7fda340d0e70 2024-06-02T16:45:21.856 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-06-02T16:45:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.860+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 msgr2=0x7fda14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.860+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda24005880 tx=0x7fda24007a20 comp rx=0 tx=0).stop 2024-06-02T16:45:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.860+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 msgr2=0x7fda340ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c7f0 tx=0x7fda2000ccb0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 shutdown_connections 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda34161ad0 0x7fda3413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda3415dfc0 0x7fda3413bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 --2- 172.21.15.52:0/3151808029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda340d0e70 0x7fda340ad2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.861+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 >> 172.21.15.52:0/3151808029 conn(0x7fda3406c380 msgr2=0x7fda340b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.862+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 shutdown_connections 2024-06-02T16:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.862+0000 7fda1f400640 1 -- 172.21.15.52:0/3151808029 wait complete. 2024-06-02T16:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.871+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5698069520 con 0x7f56981631f0 2024-06-02T16:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.872+0000 7f568e000640 1 -- 172.21.15.52:0/419676044 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f568001f020 con 0x7f56981631f0 2024-06-02T16:45:21.874 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2024-06-02T16:45:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.876+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 msgr2=0x7f5674078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.876+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 0x7f5674078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002f000 comp rx=0 tx=0).stop 2024-06-02T16:45:21.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.876+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 msgr2=0x7f5698070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.876+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f568000b4c0 tx=0x7f568000b980 comp rx=0 tx=0).stop 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 shutdown_connections 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f56740763a0 0x7f5674078860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56981631f0 0x7f5698070040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980d5f10 0x7f5698071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 --2- 172.21.15.52:0/419676044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980b7130 0x7f56980b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.877+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 >> 172.21.15.52:0/419676044 conn(0x7f569808cf50 msgr2=0x7f56980b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.878+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 shutdown_connections 2024-06-02T16:45:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.878+0000 7f569d000640 1 -- 172.21.15.52:0/419676044 wait complete. 2024-06-02T16:45:21.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-06-02T16:45:21.889 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.899+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb0700d0c50 con 0x7fb0700b3780 2024-06-02T16:45:21.900 INFO:teuthology.orchestra.run.smithi052.stdout:68719476743 2024-06-02T16:45:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.900+0000 7fb066000640 1 -- 172.21.15.52:0/3587882613 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb068061100 con 0x7fb0700b3780 2024-06-02T16:45:21.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.903+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 msgr2=0x7fb050078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.903+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 0x7fb050078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb05c034000 tx=0x7fb05c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 msgr2=0x7fb07014d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb068007ef0 tx=0x7fb06800e4b0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 shutdown_connections 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb0500763a0 0x7fb050078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb07015f060 0x7fb0700b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb070159000 0x7fb070149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 --2- 172.21.15.52:0/3587882613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0700b3780 0x7fb07014d470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.904+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 >> 172.21.15.52:0/3587882613 conn(0x7fb0700b2c90 msgr2=0x7fb07014a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.905+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 shutdown_connections 2024-06-02T16:45:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.905+0000 7fb06f200640 1 -- 172.21.15.52:0/3587882613 wait complete. 2024-06-02T16:45:21.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-06-02T16:45:21.907 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.910+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb180005850 con 0x7fb1a80d0510 2024-06-02T16:45:21.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.910+0000 7fb19f400640 1 -- 172.21.15.52:0/3376723464 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1940010c0 con 0x7fb1a80d0510 2024-06-02T16:45:21.910 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-06-02T16:45:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 msgr2=0x7fb188078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 0x7fb188078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb198034000 tx=0x7fb198008030 comp rx=0 tx=0).stop 2024-06-02T16:45:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 msgr2=0x7fb1a815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c7b0 tx=0x7fb19400cc70 comp rx=0 tx=0).stop 2024-06-02T16:45:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 shutdown_connections 2024-06-02T16:45:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1880763a0 0x7fb188078860 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a815fc30 0x7fb1a806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1a815f5b0 0x7fb1a806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 --2- 172.21.15.52:0/3376723464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1a80d0510 0x7fb1a815d950 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.914+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 >> 172.21.15.52:0/3376723464 conn(0x7fb1a80b3200 msgr2=0x7fb1a8072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.915+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 shutdown_connections 2024-06-02T16:45:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.915+0000 7fb1ae800640 1 -- 172.21.15.52:0/3376723464 wait complete. 2024-06-02T16:45:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.916+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efc380d0f50 con 0x7efc380d1e30 2024-06-02T16:45:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.917+0000 7efc35600640 1 -- 172.21.15.52:0/2308373 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc20064950 con 0x7efc380d1e30 2024-06-02T16:45:21.917 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-06-02T16:45:21.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 msgr2=0x7efc14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 0x7efc14078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc28033000 tx=0x7efc28009000 comp rx=0 tx=0).stop 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 msgr2=0x7efc380c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc2000b4a0 tx=0x7efc2000b960 comp rx=0 tx=0).stop 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 shutdown_connections 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efc140762d0 0x7efc14078790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc380d5b50 0x7efc380ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc380d1e30 0x7efc380c9620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 --2- 172.21.15.52:0/2308373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc380b4790 0x7efc381548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 >> 172.21.15.52:0/2308373 conn(0x7efc3808cf50 msgr2=0x7efc380b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.921+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 shutdown_connections 2024-06-02T16:45:21.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.922+0000 7efc3fa00640 1 -- 172.21.15.52:0/2308373 wait complete. 2024-06-02T16:45:21.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2024-06-02T16:45:21.925 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.943+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb5640b3830 con 0x7fb564163700 2024-06-02T16:45:21.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-06-02T16:45:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.944+0000 7fb55b400640 1 -- 172.21.15.52:0/394032749 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb55c063b10 con 0x7fb564163700 2024-06-02T16:45:21.944 INFO:teuthology.orchestra.run.smithi052.stdout:68719476741 2024-06-02T16:45:21.944 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-06-02T16:45:21.945 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 msgr2=0x7fb544078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 0x7fb544078990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5540090b0 tx=0x7fb55402e000 comp rx=0 tx=0).stop 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 msgr2=0x7fb56415ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 0x7fb56415ad10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c650 tx=0x7fb55c00cb10 comp rx=0 tx=0).stop 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 shutdown_connections 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb5440764d0 0x7fb544078990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb564163700 0x7fb56415ad10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb564163320 0x7fb5641eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 --2- 172.21.15.52:0/394032749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5640b5690 0x7fb5641573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 >> 172.21.15.52:0/394032749 conn(0x7fb5640b2b60 msgr2=0x7fb5640b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 shutdown_connections 2024-06-02T16:45:21.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.946+0000 7fb568e00640 1 -- 172.21.15.52:0/394032749 wait complete. 2024-06-02T16:45:21.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.954+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efdd4069520 con 0x7efdd40b7130 2024-06-02T16:45:21.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.954+0000 7efdcaa00640 1 -- 172.21.15.52:0/137740329 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdc00615e0 con 0x7efdd40b7130 2024-06-02T16:45:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:68719476743 2024-06-02T16:45:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.957+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 msgr2=0x7efdb4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.957+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 0x7efdb4078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efdd40cbf90 tx=0x7efdc4009190 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.957+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 msgr2=0x7efdd40cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.957+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c500 tx=0x7efdc000c9c0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.957+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 shutdown_connections 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efdb40763a0 0x7efdb4078860 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdd41631f0 0x7efdd40b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd40d5f10 0x7efdd40b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 --2- 172.21.15.52:0/137740329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efdd40b7130 0x7efdd40cb930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 >> 172.21.15.52:0/137740329 conn(0x7efdd408cf50 msgr2=0x7efdd41628b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 shutdown_connections 2024-06-02T16:45:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.958+0000 7efdbfe00640 1 -- 172.21.15.52:0/137740329 wait complete. 2024-06-02T16:45:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.959+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fca340507e0 con 0x7fca340ca1c0 2024-06-02T16:45:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.959+0000 7fca30c00640 1 -- 172.21.15.52:0/372961521 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca20061340 con 0x7fca340ca1c0 2024-06-02T16:45:21.959 INFO:teuthology.orchestra.run.smithi052.stdout:68719476744 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 msgr2=0x7fca14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 0x7fca14078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001c50 tx=0x7fca2c007cf0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 msgr2=0x7fca340ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca2000e930 tx=0x7fca2000edf0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 shutdown_connections 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fca140762d0 0x7fca14078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca340ca1c0 0x7fca340ccea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca3415f420 0x7fca340cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 --2- 172.21.15.52:0/372961521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca340d0660 0x7fca341569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 >> 172.21.15.52:0/372961521 conn(0x7fca340740e0 msgr2=0x7fca340b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 shutdown_connections 2024-06-02T16:45:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:21.962+0000 7fca3a400640 1 -- 172.21.15.52:0/372961521 wait complete. 2024-06-02T16:45:21.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.6 2024-06-02T16:45:21.964 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.4 2024-06-02T16:45:21.975 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.7 2024-06-02T16:45:21.979 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:21.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T16:45:21.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.221+0000 7fcf73200640 1 Processor -- start 2024-06-02T16:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.222+0000 7fcf73200640 1 -- start start 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf73200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf740b6c80 0x7fcf740b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf73200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf740ba430 0x7fcf740ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf73200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf741607c0 con 0x7fcf7415d060 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf73200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcf74163c50 con 0x7fcf740b6c80 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf73200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcf74163040 con 0x7fcf740ba430 2024-06-02T16:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf71400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf740b6c80 0x7fcf740b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf71400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf740b6c80 0x7fcf740b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53352/0 (socket says 172.21.15.52:53352) 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf71400640 1 -- 172.21.15.52:0/595743439 learned_addr learned my addr 172.21.15.52:0/595743439 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.223+0000 7fcf71e00640 1 --1- 172.21.15.52:0/595743439 >> v1:172.21.15.52:6789/0 conn(0x7fcf7415d060 0x7fcf740d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51946/0 (socket says 172.21.15.52:51946) 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.224+0000 7fcf71400640 1 -- 172.21.15.52:0/595743439 >> v2:172.21.15.114:3300/0 conn(0x7fcf740ba430 msgr2=0x7fcf740ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.224+0000 7fcf71400640 1 --2- 172.21.15.52:0/595743439 >> v2:172.21.15.114:3300/0 conn(0x7fcf740ba430 0x7fcf740ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.224+0000 7fcf71400640 1 -- 172.21.15.52:0/595743439 >> v1:172.21.15.52:6789/0 conn(0x7fcf7415d060 legacy=0x7fcf740d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.224+0000 7fcf71400640 1 -- 172.21.15.52:0/595743439 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf74163320 con 0x7fcf740b6c80 2024-06-02T16:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.225+0000 7fcf71400640 1 --2- 172.21.15.52:0/595743439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf740b6c80 0x7fcf740b7100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf740b4bf0 tx=0x7fcf6402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f69ef296a0c546 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.225+0000 7fcf70a00640 1 -- 172.21.15.52:0/595743439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64036070 con 0x7fcf740b6c80 2024-06-02T16:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.225+0000 7fcf70a00640 1 -- 172.21.15.52:0/595743439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf64031600 con 0x7fcf740b6c80 2024-06-02T16:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.225+0000 7fcf70a00640 1 -- 172.21.15.52:0/595743439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640319d0 con 0x7fcf740b6c80 2024-06-02T16:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 -- 172.21.15.52:0/595743439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf740b6c80 msgr2=0x7fcf740b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 --2- 172.21.15.52:0/595743439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf740b6c80 0x7fcf740b7100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf740b4bf0 tx=0x7fcf6402a730 comp rx=0 tx=0).stop 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 -- 172.21.15.52:0/595743439 shutdown_connections 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 --2- 172.21.15.52:0/595743439 >> v2:172.21.15.114:3300/0 conn(0x7fcf740ba430 0x7fcf740ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 --2- 172.21.15.52:0/595743439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf740b6c80 0x7fcf740b7100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 -- 172.21.15.52:0/595743439 >> 172.21.15.52:0/595743439 conn(0x7fcf740740e0 msgr2=0x7fcf740d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 -- 172.21.15.52:0/595743439 shutdown_connections 2024-06-02T16:45:22.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.226+0000 7fcf73200640 1 -- 172.21.15.52:0/595743439 wait complete. 2024-06-02T16:45:22.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.227+0000 7fcf73200640 1 Processor -- start 2024-06-02T16:45:22.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.228+0000 7fcf73200640 1 -- start start 2024-06-02T16:45:22.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.228+0000 7fcf73200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf740b6c80 0x7fcf741580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.228+0000 7fcf73200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf740ba430 0x7fcf74159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf73200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf73200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740d0880 con 0x7fcf7415d060 2024-06-02T16:45:22.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf73200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741638e0 con 0x7fcf740ba430 2024-06-02T16:45:22.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf73200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fcf740d0a00 con 0x7fcf740b6c80 2024-06-02T16:45:22.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53360/0 (socket says 172.21.15.52:53360) 2024-06-02T16:45:22.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 -- 172.21.15.52:0/3039906559 learned_addr learned my addr 172.21.15.52:0/3039906559 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 -- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf740b6c80 msgr2=0x7fcf741580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf71400640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf740ba430 0x7fcf74159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf71e00640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf740b6c80 0x7fcf741580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf740b6c80 0x7fcf741580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 -- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf740ba430 msgr2=0x7fcf74159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf740ba430 0x7fcf74159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.229+0000 7fcf72800640 1 -- 172.21.15.52:0/3039906559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7415b440 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf72800640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009fd0 tx=0x7fcf6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c011830 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c016070 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c011bf0 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7415a3a0 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.230+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7415a960 con 0x7fcf7415d060 2024-06-02T16:45:22.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.231+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf740507e0 con 0x7fcf7415d060 2024-06-02T16:45:22.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.232+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf6c01b460 con 0x7fcf7415d060 2024-06-02T16:45:22.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.234+0000 7fcf6a000640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 0x7fcf50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.234+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf6c097340 con 0x7fcf7415d060 2024-06-02T16:45:22.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.234+0000 7fcf71e00640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 0x7fcf50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.235+0000 7fcf71e00640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 0x7fcf50078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000f60 tx=0x7fcf5c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.239+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf7415b440 con 0x7fcf7415d060 2024-06-02T16:45:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.435+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf740d2ea0 con 0x7fcf500762d0 2024-06-02T16:45:22.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.456+0000 7fcf6a000640 1 -- 172.21.15.52:0/3039906559 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fcf740d2ea0 con 0x7fcf500762d0 2024-06-02T16:45:22.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:45:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 msgr2=0x7fcf50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 0x7fcf50078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000f60 tx=0x7fcf5c009040 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 msgr2=0x7fcf740ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009fd0 tx=0x7fcf6c00b8e0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 shutdown_connections 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcf500762d0 0x7fcf50078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf7415d060 0x7fcf740ccef0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf740ba430 0x7fcf74159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 --2- 172.21.15.52:0/3039906559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf740b6c80 0x7fcf741580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.462+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 >> 172.21.15.52:0/3039906559 conn(0x7fcf740740e0 msgr2=0x7fcf740d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.463+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 shutdown_connections 2024-06-02T16:45:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.463+0000 7fcf73200640 1 -- 172.21.15.52:0/3039906559 wait complete. 2024-06-02T16:45:22.479 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-06-02T16:45:21.995665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3088384,"data_stored":1824236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.730592"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996517+0000","last_change":"2024-06-02T16:45:12.306743+0000","last_active":"2024-06-02T16:45:13.996517+0000","last_peered":"2024-06-02T16:45:13.996517+0000","last_clean":"2024-06-02T16:45:13.996517+0000","last_became_active":"2024-06-02T16:45:12.306440+0000","last_became_peered":"2024-06-02T16:45:12.306440+0000","last_unstale":"2024-06-02T16:45:13.996517+0000","last_undegraded":"2024-06-02T16:45:13.996517+0000","last_fullsized":"2024-06-02T16:45:13.996517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.320144+0000","last_change":"2024-06-02T16:45:12.292683+0000","last_active":"2024-06-02T16:45:13.320144+0000","last_peered":"2024-06-02T16:45:13.320144+0000","last_clean":"2024-06-02T16:45:13.320144+0000","last_became_active":"2024-06-02T16:45:12.292372+0000","last_became_peered":"2024-06-02T16:45:12.292372+0000","last_unstale":"2024-06-02T16:45:13.320144+0000","last_undegraded":"2024-06-02T16:45:13.320144+0000","last_fullsized":"2024-06-02T16:45:13.320144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:59.218400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399312+0000","last_change":"2024-06-02T16:45:12.293718+0000","last_active":"2024-06-02T16:45:14.399312+0000","last_peered":"2024-06-02T16:45:14.399312+0000","last_clean":"2024-06-02T16:45:14.399312+0000","last_became_active":"2024-06-02T16:45:12.293430+0000","last_became_peered":"2024-06-02T16:45:12.293430+0000","last_unstale":"2024-06-02T16:45:14.399312+0000","last_undegraded":"2024-06-02T16:45:14.399312+0000","last_fullsized":"2024-06-02T16:45:14.399312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402594+0000","last_change":"2024-06-02T16:45:12.309651+0000","last_active":"2024-06-02T16:45:14.402594+0000","last_peered":"2024-06-02T16:45:14.402594+0000","last_clean":"2024-06-02T16:45:14.402594+0000","last_became_active":"2024-06-02T16:45:12.309314+0000","last_became_peered":"2024-06-02T16:45:12.309314+0000","last_unstale":"2024-06-02T16:45:14.402594+0000","last_undegraded":"2024-06-02T16:45:14.402594+0000","last_fullsized":"2024-06-02T16:45:14.402594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995876+0000","last_change":"2024-06-02T16:45:12.297519+0000","last_active":"2024-06-02T16:45:13.995876+0000","last_peered":"2024-06-02T16:45:13.995876+0000","last_clean":"2024-06-02T16:45:13.995876+0000","last_became_active":"2024-06-02T16:45:12.297239+0000","last_became_peered":"2024-06-02T16:45:12.297239+0000","last_unstale":"2024-06-02T16:45:13.995876+0000","last_undegraded":"2024-06-02T16:45:13.995876+0000","last_fullsized":"2024-06-02T16:45:13.995876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401349+0000","last_change":"2024-06-02T16:45:12.311245+0000","last_active":"2024-06-02T16:45:14.401349+0000","last_peered":"2024-06-02T16:45:14.401349+0000","last_clean":"2024-06-02T16:45:14.401349+0000","last_became_active":"2024-06-02T16:45:12.310210+0000","last_became_peered":"2024-06-02T16:45:12.310210+0000","last_unstale":"2024-06-02T16:45:14.401349+0000","last_undegraded":"2024-06-02T16:45:14.401349+0000","last_fullsized":"2024-06-02T16:45:14.401349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995424+0000","last_change":"2024-06-02T16:45:12.298527+0000","last_active":"2024-06-02T16:45:13.995424+0000","last_peered":"2024-06-02T16:45:13.995424+0000","last_clean":"2024-06-02T16:45:13.995424+0000","last_became_active":"2024-06-02T16:45:12.297923+0000","last_became_peered":"2024-06-02T16:45:12.297923+0000","last_unstale":"2024-06-02T16:45:13.995424+0000","last_undegraded":"2024-06-02T16:45:13.995424+0000","last_fullsized":"2024-06-02T16:45:13.995424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296562+0000","last_change":"2024-06-02T16:45:12.319083+0000","last_active":"2024-06-02T16:45:13.296562+0000","last_peered":"2024-06-02T16:45:13.296562+0000","last_clean":"2024-06-02T16:45:13.296562+0000","last_became_active":"2024-06-02T16:45:12.318762+0000","last_became_peered":"2024-06-02T16:45:12.318762+0000","last_unstale":"2024-06-02T16:45:13.296562+0000","last_undegraded":"2024-06-02T16:45:13.296562+0000","last_fullsized":"2024-06-02T16:45:13.296562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996683+0000","last_change":"2024-06-02T16:45:12.317753+0000","last_active":"2024-06-02T16:45:13.996683+0000","last_peered":"2024-06-02T16:45:13.996683+0000","last_clean":"2024-06-02T16:45:13.996683+0000","last_became_active":"2024-06-02T16:45:12.317416+0000","last_became_peered":"2024-06-02T16:45:12.317416+0000","last_unstale":"2024-06-02T16:45:13.996683+0000","last_undegraded":"2024-06-02T16:45:13.996683+0000","last_fullsized":"2024-06-02T16:45:13.996683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:31.192107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325971+0000","last_change":"2024-06-02T16:45:12.296816+0000","last_active":"2024-06-02T16:45:13.325971+0000","last_peered":"2024-06-02T16:45:13.325971+0000","last_clean":"2024-06-02T16:45:13.325971+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325971+0000","last_undegraded":"2024-06-02T16:45:13.325971+0000","last_fullsized":"2024-06-02T16:45:13.325971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325571+0000","last_change":"2024-06-02T16:45:12.304652+0000","last_active":"2024-06-02T16:45:13.325571+0000","last_peered":"2024-06-02T16:45:13.325571+0000","last_clean":"2024-06-02T16:45:13.325571+0000","last_became_active":"2024-06-02T16:45:12.304386+0000","last_became_peered":"2024-06-02T16:45:12.304386+0000","last_unstale":"2024-06-02T16:45:13.325571+0000","last_undegraded":"2024-06-02T16:45:13.325571+0000","last_fullsized":"2024-06-02T16:45:13.325571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402540+0000","last_change":"2024-06-02T16:45:12.305078+0000","last_active":"2024-06-02T16:45:14.402540+0000","last_peered":"2024-06-02T16:45:14.402540+0000","last_clean":"2024-06-02T16:45:14.402540+0000","last_became_active":"2024-06-02T16:45:12.304544+0000","last_became_peered":"2024-06-02T16:45:12.304544+0000","last_unstale":"2024-06-02T16:45:14.402540+0000","last_undegraded":"2024-06-02T16:45:14.402540+0000","last_fullsized":"2024-06-02T16:45:14.402540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297756+0000","last_change":"2024-06-02T16:45:12.308837+0000","last_active":"2024-06-02T16:45:13.297756+0000","last_peered":"2024-06-02T16:45:13.297756+0000","last_clean":"2024-06-02T16:45:13.297756+0000","last_became_active":"2024-06-02T16:45:12.307884+0000","last_became_peered":"2024-06-02T16:45:12.307884+0000","last_unstale":"2024-06-02T16:45:13.297756+0000","last_undegraded":"2024-06-02T16:45:13.297756+0000","last_fullsized":"2024-06-02T16:45:13.297756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399239+0000","last_change":"2024-06-02T16:45:12.302741+0000","last_active":"2024-06-02T16:45:14.399239+0000","last_peered":"2024-06-02T16:45:14.399239+0000","last_clean":"2024-06-02T16:45:14.399239+0000","last_became_active":"2024-06-02T16:45:12.302448+0000","last_became_peered":"2024-06-02T16:45:12.302448+0000","last_unstale":"2024-06-02T16:45:14.399239+0000","last_undegraded":"2024-06-02T16:45:14.399239+0000","last_fullsized":"2024-06-02T16:45:14.399239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319423+0000","last_change":"2024-06-02T16:45:12.298379+0000","last_active":"2024-06-02T16:45:13.319423+0000","last_peered":"2024-06-02T16:45:13.319423+0000","last_clean":"2024-06-02T16:45:13.319423+0000","last_became_active":"2024-06-02T16:45:12.297169+0000","last_became_peered":"2024-06-02T16:45:12.297169+0000","last_unstale":"2024-06-02T16:45:13.319423+0000","last_undegraded":"2024-06-02T16:45:13.319423+0000","last_fullsized":"2024-06-02T16:45:13.319423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:20.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400485+0000","last_change":"2024-06-02T16:45:12.313940+0000","last_active":"2024-06-02T16:45:14.400485+0000","last_peered":"2024-06-02T16:45:14.400485+0000","last_clean":"2024-06-02T16:45:14.400485+0000","last_became_active":"2024-06-02T16:45:12.313226+0000","last_became_peered":"2024-06-02T16:45:12.313226+0000","last_unstale":"2024-06-02T16:45:14.400485+0000","last_undegraded":"2024-06-02T16:45:14.400485+0000","last_fullsized":"2024-06-02T16:45:14.400485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403995+0000","last_change":"2024-06-02T16:45:12.312810+0000","last_active":"2024-06-02T16:45:14.403995+0000","last_peered":"2024-06-02T16:45:14.403995+0000","last_clean":"2024-06-02T16:45:14.403995+0000","last_became_active":"2024-06-02T16:45:12.312269+0000","last_became_peered":"2024-06-02T16:45:12.312269+0000","last_unstale":"2024-06-02T16:45:14.403995+0000","last_undegraded":"2024-06-02T16:45:14.403995+0000","last_fullsized":"2024-06-02T16:45:14.403995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297718+0000","last_change":"2024-06-02T16:45:12.304201+0000","last_active":"2024-06-02T16:45:13.297718+0000","last_peered":"2024-06-02T16:45:13.297718+0000","last_clean":"2024-06-02T16:45:13.297718+0000","last_became_active":"2024-06-02T16:45:12.303839+0000","last_became_peered":"2024-06-02T16:45:12.303839+0000","last_unstale":"2024-06-02T16:45:13.297718+0000","last_undegraded":"2024-06-02T16:45:13.297718+0000","last_fullsized":"2024-06-02T16:45:13.297718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996653+0000","last_change":"2024-06-02T16:45:12.300262+0000","last_active":"2024-06-02T16:45:13.996653+0000","last_peered":"2024-06-02T16:45:13.996653+0000","last_clean":"2024-06-02T16:45:13.996653+0000","last_became_active":"2024-06-02T16:45:12.299445+0000","last_became_peered":"2024-06-02T16:45:12.299445+0000","last_unstale":"2024-06-02T16:45:13.996653+0000","last_undegraded":"2024-06-02T16:45:13.996653+0000","last_fullsized":"2024-06-02T16:45:13.996653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:05.323209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325689+0000","last_change":"2024-06-02T16:45:12.303651+0000","last_active":"2024-06-02T16:45:13.325689+0000","last_peered":"2024-06-02T16:45:13.325689+0000","last_clean":"2024-06-02T16:45:13.325689+0000","last_became_active":"2024-06-02T16:45:12.301465+0000","last_became_peered":"2024-06-02T16:45:12.301465+0000","last_unstale":"2024-06-02T16:45:13.325689+0000","last_undegraded":"2024-06-02T16:45:13.325689+0000","last_fullsized":"2024-06-02T16:45:13.325689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399138+0000","last_change":"2024-06-02T16:45:12.301175+0000","last_active":"2024-06-02T16:45:14.399138+0000","last_peered":"2024-06-02T16:45:14.399138+0000","last_clean":"2024-06-02T16:45:14.399138+0000","last_became_active":"2024-06-02T16:45:12.300384+0000","last_became_peered":"2024-06-02T16:45:12.300384+0000","last_unstale":"2024-06-02T16:45:14.399138+0000","last_undegraded":"2024-06-02T16:45:14.399138+0000","last_fullsized":"2024-06-02T16:45:14.399138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:46.679838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402228+0000","last_change":"2024-06-02T16:45:12.311520+0000","last_active":"2024-06-02T16:45:14.402228+0000","last_peered":"2024-06-02T16:45:14.402228+0000","last_clean":"2024-06-02T16:45:14.402228+0000","last_became_active":"2024-06-02T16:45:12.310653+0000","last_became_peered":"2024-06-02T16:45:12.310653+0000","last_unstale":"2024-06-02T16:45:14.402228+0000","last_undegraded":"2024-06-02T16:45:14.402228+0000","last_fullsized":"2024-06-02T16:45:14.402228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297205+0000","last_change":"2024-06-02T16:45:12.304397+0000","last_active":"2024-06-02T16:45:13.297205+0000","last_peered":"2024-06-02T16:45:13.297205+0000","last_clean":"2024-06-02T16:45:13.297205+0000","last_became_active":"2024-06-02T16:45:12.304107+0000","last_became_peered":"2024-06-02T16:45:12.304107+0000","last_unstale":"2024-06-02T16:45:13.297205+0000","last_undegraded":"2024-06-02T16:45:13.297205+0000","last_fullsized":"2024-06-02T16:45:13.297205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400682+0000","last_change":"2024-06-02T16:45:12.314155+0000","last_active":"2024-06-02T16:45:14.400682+0000","last_peered":"2024-06-02T16:45:14.400682+0000","last_clean":"2024-06-02T16:45:14.400682+0000","last_became_active":"2024-06-02T16:45:12.313644+0000","last_became_peered":"2024-06-02T16:45:12.313644+0000","last_unstale":"2024-06-02T16:45:14.400682+0000","last_undegraded":"2024-06-02T16:45:14.400682+0000","last_fullsized":"2024-06-02T16:45:14.400682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298924+0000","last_change":"2024-06-02T16:45:12.306290+0000","last_active":"2024-06-02T16:45:13.298924+0000","last_peered":"2024-06-02T16:45:13.298924+0000","last_clean":"2024-06-02T16:45:13.298924+0000","last_became_active":"2024-06-02T16:45:12.306055+0000","last_became_peered":"2024-06-02T16:45:12.306055+0000","last_unstale":"2024-06-02T16:45:13.298924+0000","last_undegraded":"2024-06-02T16:45:13.298924+0000","last_fullsized":"2024-06-02T16:45:13.298924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.326006+0000","last_change":"2024-06-02T16:45:12.303636+0000","last_active":"2024-06-02T16:45:13.326006+0000","last_peered":"2024-06-02T16:45:13.326006+0000","last_clean":"2024-06-02T16:45:13.326006+0000","last_became_active":"2024-06-02T16:45:12.302670+0000","last_became_peered":"2024-06-02T16:45:12.302670+0000","last_unstale":"2024-06-02T16:45:13.326006+0000","last_undegraded":"2024-06-02T16:45:13.326006+0000","last_fullsized":"2024-06-02T16:45:13.326006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319893+0000","last_change":"2024-06-02T16:45:12.299670+0000","last_active":"2024-06-02T16:45:13.319893+0000","last_peered":"2024-06-02T16:45:13.319893+0000","last_clean":"2024-06-02T16:45:13.319893+0000","last_became_active":"2024-06-02T16:45:12.299052+0000","last_became_peered":"2024-06-02T16:45:12.299052+0000","last_unstale":"2024-06-02T16:45:13.319893+0000","last_undegraded":"2024-06-02T16:45:13.319893+0000","last_fullsized":"2024-06-02T16:45:13.319893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:04.607697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298514+0000","last_change":"2024-06-02T16:45:12.303422+0000","last_active":"2024-06-02T16:45:13.298514+0000","last_peered":"2024-06-02T16:45:13.298514+0000","last_clean":"2024-06-02T16:45:13.298514+0000","last_became_active":"2024-06-02T16:45:12.301580+0000","last_became_peered":"2024-06-02T16:45:12.301580+0000","last_unstale":"2024-06-02T16:45:13.298514+0000","last_undegraded":"2024-06-02T16:45:13.298514+0000","last_fullsized":"2024-06-02T16:45:13.298514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399235+0000","last_change":"2024-06-02T16:45:12.310664+0000","last_active":"2024-06-02T16:45:14.399235+0000","last_peered":"2024-06-02T16:45:14.399235+0000","last_clean":"2024-06-02T16:45:14.399235+0000","last_became_active":"2024-06-02T16:45:12.310369+0000","last_became_peered":"2024-06-02T16:45:12.310369+0000","last_unstale":"2024-06-02T16:45:14.399235+0000","last_undegraded":"2024-06-02T16:45:14.399235+0000","last_fullsized":"2024-06-02T16:45:14.399235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402532+0000","last_change":"2024-06-02T16:45:12.310972+0000","last_active":"2024-06-02T16:45:14.402532+0000","last_peered":"2024-06-02T16:45:14.402532+0000","last_clean":"2024-06-02T16:45:14.402532+0000","last_became_active":"2024-06-02T16:45:12.309072+0000","last_became_peered":"2024-06-02T16:45:12.309072+0000","last_unstale":"2024-06-02T16:45:14.402532+0000","last_undegraded":"2024-06-02T16:45:14.402532+0000","last_fullsized":"2024-06-02T16:45:14.402532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296413+0000","last_change":"2024-06-02T16:45:12.319222+0000","last_active":"2024-06-02T16:45:13.296413+0000","last_peered":"2024-06-02T16:45:13.296413+0000","last_clean":"2024-06-02T16:45:13.296413+0000","last_became_active":"2024-06-02T16:45:12.318902+0000","last_became_peered":"2024-06-02T16:45:12.318902+0000","last_unstale":"2024-06-02T16:45:13.296413+0000","last_undegraded":"2024-06-02T16:45:13.296413+0000","last_fullsized":"2024-06-02T16:45:13.296413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325172+0000","last_change":"2024-06-02T16:45:12.293440+0000","last_active":"2024-06-02T16:45:13.325172+0000","last_peered":"2024-06-02T16:45:13.325172+0000","last_clean":"2024-06-02T16:45:13.325172+0000","last_became_active":"2024-06-02T16:45:12.293145+0000","last_became_peered":"2024-06-02T16:45:12.293145+0000","last_unstale":"2024-06-02T16:45:13.325172+0000","last_undegraded":"2024-06-02T16:45:13.325172+0000","last_fullsized":"2024-06-02T16:45:13.325172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401279+0000","last_change":"2024-06-02T16:45:12.302510+0000","last_active":"2024-06-02T16:45:14.401279+0000","last_peered":"2024-06-02T16:45:14.401279+0000","last_clean":"2024-06-02T16:45:14.401279+0000","last_became_active":"2024-06-02T16:45:12.301477+0000","last_became_peered":"2024-06-02T16:45:12.301477+0000","last_unstale":"2024-06-02T16:45:14.401279+0000","last_undegraded":"2024-06-02T16:45:14.401279+0000","last_fullsized":"2024-06-02T16:45:14.401279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297991+0000","last_change":"2024-06-02T16:45:11.272839+0000","last_active":"2024-06-02T16:45:13.297991+0000","last_peered":"2024-06-02T16:45:13.297991+0000","last_clean":"2024-06-02T16:45:13.297991+0000","last_became_active":"2024-06-02T16:45:11.272540+0000","last_became_peered":"2024-06-02T16:45:11.272540+0000","last_unstale":"2024-06-02T16:45:13.297991+0000","last_undegraded":"2024-06-02T16:45:13.297991+0000","last_fullsized":"2024-06-02T16:45:13.297991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399356+0000","last_change":"2024-06-02T16:45:12.305267+0000","last_active":"2024-06-02T16:45:14.399356+0000","last_peered":"2024-06-02T16:45:14.399356+0000","last_clean":"2024-06-02T16:45:14.399356+0000","last_became_active":"2024-06-02T16:45:12.304804+0000","last_became_peered":"2024-06-02T16:45:12.304804+0000","last_unstale":"2024-06-02T16:45:14.399356+0000","last_undegraded":"2024-06-02T16:45:14.399356+0000","last_fullsized":"2024-06-02T16:45:14.399356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325127+0000","last_change":"2024-06-02T16:45:11.271730+0000","last_active":"2024-06-02T16:45:13.325127+0000","last_peered":"2024-06-02T16:45:13.325127+0000","last_clean":"2024-06-02T16:45:13.325127+0000","last_became_active":"2024-06-02T16:45:11.269255+0000","last_became_peered":"2024-06-02T16:45:11.269255+0000","last_unstale":"2024-06-02T16:45:13.325127+0000","last_undegraded":"2024-06-02T16:45:13.325127+0000","last_fullsized":"2024-06-02T16:45:13.325127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297433+0000","last_change":"2024-06-02T16:45:11.269405+0000","last_active":"2024-06-02T16:45:13.297433+0000","last_peered":"2024-06-02T16:45:13.297433+0000","last_clean":"2024-06-02T16:45:13.297433+0000","last_became_active":"2024-06-02T16:45:11.269072+0000","last_became_peered":"2024-06-02T16:45:11.269072+0000","last_unstale":"2024-06-02T16:45:13.297433+0000","last_undegraded":"2024-06-02T16:45:13.297433+0000","last_fullsized":"2024-06-02T16:45:13.297433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:39.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297102+0000","last_change":"2024-06-02T16:45:12.308910+0000","last_active":"2024-06-02T16:45:13.297102+0000","last_peered":"2024-06-02T16:45:13.297102+0000","last_clean":"2024-06-02T16:45:13.297102+0000","last_became_active":"2024-06-02T16:45:12.308375+0000","last_became_peered":"2024-06-02T16:45:12.308375+0000","last_unstale":"2024-06-02T16:45:13.297102+0000","last_undegraded":"2024-06-02T16:45:13.297102+0000","last_fullsized":"2024-06-02T16:45:13.297102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400758+0000","last_change":"2024-06-02T16:45:11.280551+0000","last_active":"2024-06-02T16:45:14.400758+0000","last_peered":"2024-06-02T16:45:14.400758+0000","last_clean":"2024-06-02T16:45:14.400758+0000","last_became_active":"2024-06-02T16:45:11.279982+0000","last_became_peered":"2024-06-02T16:45:11.279982+0000","last_unstale":"2024-06-02T16:45:14.400758+0000","last_undegraded":"2024-06-02T16:45:14.400758+0000","last_fullsized":"2024-06-02T16:45:14.400758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319501+0000","last_change":"2024-06-02T16:45:12.294403+0000","last_active":"2024-06-02T16:45:13.319501+0000","last_peered":"2024-06-02T16:45:13.319501+0000","last_clean":"2024-06-02T16:45:13.319501+0000","last_became_active":"2024-06-02T16:45:12.294104+0000","last_became_peered":"2024-06-02T16:45:12.294104+0000","last_unstale":"2024-06-02T16:45:13.319501+0000","last_undegraded":"2024-06-02T16:45:13.319501+0000","last_fullsized":"2024-06-02T16:45:13.319501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:49.129875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325481+0000","last_change":"2024-06-02T16:45:11.279215+0000","last_active":"2024-06-02T16:45:13.325481+0000","last_peered":"2024-06-02T16:45:13.325481+0000","last_clean":"2024-06-02T16:45:13.325481+0000","last_became_active":"2024-06-02T16:45:11.278900+0000","last_became_peered":"2024-06-02T16:45:11.278900+0000","last_unstale":"2024-06-02T16:45:13.325481+0000","last_undegraded":"2024-06-02T16:45:13.325481+0000","last_fullsized":"2024-06-02T16:45:13.325481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403606+0000","last_change":"2024-06-02T16:45:12.312906+0000","last_active":"2024-06-02T16:45:14.403606+0000","last_peered":"2024-06-02T16:45:14.403606+0000","last_clean":"2024-06-02T16:45:14.403606+0000","last_became_active":"2024-06-02T16:45:12.312594+0000","last_became_peered":"2024-06-02T16:45:12.312594+0000","last_unstale":"2024-06-02T16:45:14.403606+0000","last_undegraded":"2024-06-02T16:45:14.403606+0000","last_fullsized":"2024-06-02T16:45:14.403606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403585+0000","last_change":"2024-06-02T16:45:11.283234+0000","last_active":"2024-06-02T16:45:14.403585+0000","last_peered":"2024-06-02T16:45:14.403585+0000","last_clean":"2024-06-02T16:45:14.403585+0000","last_became_active":"2024-06-02T16:45:11.282949+0000","last_became_peered":"2024-06-02T16:45:11.282949+0000","last_unstale":"2024-06-02T16:45:14.403585+0000","last_undegraded":"2024-06-02T16:45:14.403585+0000","last_fullsized":"2024-06-02T16:45:14.403585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399516+0000","last_change":"2024-06-02T16:45:12.317022+0000","last_active":"2024-06-02T16:45:14.399516+0000","last_peered":"2024-06-02T16:45:14.399516+0000","last_clean":"2024-06-02T16:45:14.399516+0000","last_became_active":"2024-06-02T16:45:12.316687+0000","last_became_peered":"2024-06-02T16:45:12.316687+0000","last_unstale":"2024-06-02T16:45:14.399516+0000","last_undegraded":"2024-06-02T16:45:14.399516+0000","last_fullsized":"2024-06-02T16:45:14.399516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319666+0000","last_change":"2024-06-02T16:45:11.279941+0000","last_active":"2024-06-02T16:45:13.319666+0000","last_peered":"2024-06-02T16:45:13.319666+0000","last_clean":"2024-06-02T16:45:13.319666+0000","last_became_active":"2024-06-02T16:45:11.279600+0000","last_became_peered":"2024-06-02T16:45:11.279600+0000","last_unstale":"2024-06-02T16:45:13.319666+0000","last_undegraded":"2024-06-02T16:45:13.319666+0000","last_fullsized":"2024-06-02T16:45:13.319666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:05:50.798003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402942+0000","last_change":"2024-06-02T16:45:12.311936+0000","last_active":"2024-06-02T16:45:14.402942+0000","last_peered":"2024-06-02T16:45:14.402942+0000","last_clean":"2024-06-02T16:45:14.402942+0000","last_became_active":"2024-06-02T16:45:12.311644+0000","last_became_peered":"2024-06-02T16:45:12.311644+0000","last_unstale":"2024-06-02T16:45:14.402942+0000","last_undegraded":"2024-06-02T16:45:14.402942+0000","last_fullsized":"2024-06-02T16:45:14.402942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325811+0000","last_change":"2024-06-02T16:45:11.273910+0000","last_active":"2024-06-02T16:45:13.325811+0000","last_peered":"2024-06-02T16:45:13.325811+0000","last_clean":"2024-06-02T16:45:13.325811+0000","last_became_active":"2024-06-02T16:45:11.269349+0000","last_became_peered":"2024-06-02T16:45:11.269349+0000","last_unstale":"2024-06-02T16:45:13.325811+0000","last_undegraded":"2024-06-02T16:45:13.325811+0000","last_fullsized":"2024-06-02T16:45:13.325811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996048+0000","last_change":"2024-06-02T16:45:12.309869+0000","last_active":"2024-06-02T16:45:13.996048+0000","last_peered":"2024-06-02T16:45:13.996048+0000","last_clean":"2024-06-02T16:45:13.996048+0000","last_became_active":"2024-06-02T16:45:12.309531+0000","last_became_peered":"2024-06-02T16:45:12.309531+0000","last_unstale":"2024-06-02T16:45:13.996048+0000","last_undegraded":"2024-06-02T16:45:13.996048+0000","last_fullsized":"2024-06-02T16:45:13.996048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399453+0000","last_change":"2024-06-02T16:45:11.281999+0000","last_active":"2024-06-02T16:45:14.399453+0000","last_peered":"2024-06-02T16:45:14.399453+0000","last_clean":"2024-06-02T16:45:14.399453+0000","last_became_active":"2024-06-02T16:45:11.281659+0000","last_became_peered":"2024-06-02T16:45:11.281659+0000","last_unstale":"2024-06-02T16:45:14.399453+0000","last_undegraded":"2024-06-02T16:45:14.399453+0000","last_fullsized":"2024-06-02T16:45:14.399453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:42:40.894276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399729+0000","last_change":"2024-06-02T16:45:12.300160+0000","last_active":"2024-06-02T16:45:14.399729+0000","last_peered":"2024-06-02T16:45:14.399729+0000","last_clean":"2024-06-02T16:45:14.399729+0000","last_became_active":"2024-06-02T16:45:12.299866+0000","last_became_peered":"2024-06-02T16:45:12.299866+0000","last_unstale":"2024-06-02T16:45:14.399729+0000","last_undegraded":"2024-06-02T16:45:14.399729+0000","last_fullsized":"2024-06-02T16:45:14.399729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402682+0000","last_change":"2024-06-02T16:45:11.275912+0000","last_active":"2024-06-02T16:45:14.402682+0000","last_peered":"2024-06-02T16:45:14.402682+0000","last_clean":"2024-06-02T16:45:14.402682+0000","last_became_active":"2024-06-02T16:45:11.274344+0000","last_became_peered":"2024-06-02T16:45:11.274344+0000","last_unstale":"2024-06-02T16:45:14.402682+0000","last_undegraded":"2024-06-02T16:45:14.402682+0000","last_fullsized":"2024-06-02T16:45:14.402682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996045+0000","last_change":"2024-06-02T16:45:12.305113+0000","last_active":"2024-06-02T16:45:13.996045+0000","last_peered":"2024-06-02T16:45:13.996045+0000","last_clean":"2024-06-02T16:45:13.996045+0000","last_became_active":"2024-06-02T16:45:12.303754+0000","last_became_peered":"2024-06-02T16:45:12.303754+0000","last_unstale":"2024-06-02T16:45:13.996045+0000","last_undegraded":"2024-06-02T16:45:13.996045+0000","last_fullsized":"2024-06-02T16:45:13.996045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325343+0000","last_change":"2024-06-02T16:45:11.282207+0000","last_active":"2024-06-02T16:45:13.325343+0000","last_peered":"2024-06-02T16:45:13.325343+0000","last_clean":"2024-06-02T16:45:13.325343+0000","last_became_active":"2024-06-02T16:45:11.281896+0000","last_became_peered":"2024-06-02T16:45:11.281896+0000","last_unstale":"2024-06-02T16:45:13.325343+0000","last_undegraded":"2024-06-02T16:45:13.325343+0000","last_fullsized":"2024-06-02T16:45:13.325343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325428+0000","last_change":"2024-06-02T16:45:12.296800+0000","last_active":"2024-06-02T16:45:13.325428+0000","last_peered":"2024-06-02T16:45:13.325428+0000","last_clean":"2024-06-02T16:45:13.325428+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325428+0000","last_undegraded":"2024-06-02T16:45:13.325428+0000","last_fullsized":"2024-06-02T16:45:13.325428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296330+0000","last_change":"2024-06-02T16:45:11.266200+0000","last_active":"2024-06-02T16:45:13.296330+0000","last_peered":"2024-06-02T16:45:13.296330+0000","last_clean":"2024-06-02T16:45:13.296330+0000","last_became_active":"2024-06-02T16:45:11.265898+0000","last_became_peered":"2024-06-02T16:45:11.265898+0000","last_unstale":"2024-06-02T16:45:13.296330+0000","last_undegraded":"2024-06-02T16:45:13.296330+0000","last_fullsized":"2024-06-02T16:45:13.296330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995641+0000","last_change":"2024-06-02T16:45:12.306797+0000","last_active":"2024-06-02T16:45:13.995641+0000","last_peered":"2024-06-02T16:45:13.995641+0000","last_clean":"2024-06-02T16:45:13.995641+0000","last_became_active":"2024-06-02T16:45:12.306438+0000","last_became_peered":"2024-06-02T16:45:12.306438+0000","last_unstale":"2024-06-02T16:45:13.995641+0000","last_undegraded":"2024-06-02T16:45:13.995641+0000","last_fullsized":"2024-06-02T16:45:13.995641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402003+0000","last_change":"2024-06-02T16:45:11.281764+0000","last_active":"2024-06-02T16:45:14.402003+0000","last_peered":"2024-06-02T16:45:14.402003+0000","last_clean":"2024-06-02T16:45:14.402003+0000","last_became_active":"2024-06-02T16:45:11.281487+0000","last_became_peered":"2024-06-02T16:45:11.281487+0000","last_unstale":"2024-06-02T16:45:14.402003+0000","last_undegraded":"2024-06-02T16:45:14.402003+0000","last_fullsized":"2024-06-02T16:45:14.402003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:00.859465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996452+0000","last_change":"2024-06-02T16:45:12.303257+0000","last_active":"2024-06-02T16:45:13.996452+0000","last_peered":"2024-06-02T16:45:13.996452+0000","last_clean":"2024-06-02T16:45:13.996452+0000","last_became_active":"2024-06-02T16:45:12.302846+0000","last_became_peered":"2024-06-02T16:45:12.302846+0000","last_unstale":"2024-06-02T16:45:13.996452+0000","last_undegraded":"2024-06-02T16:45:13.996452+0000","last_fullsized":"2024-06-02T16:45:13.996452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297861+0000","last_change":"2024-06-02T16:45:11.265071+0000","last_active":"2024-06-02T16:45:13.297861+0000","last_peered":"2024-06-02T16:45:13.297861+0000","last_clean":"2024-06-02T16:45:13.297861+0000","last_became_active":"2024-06-02T16:45:11.264782+0000","last_became_peered":"2024-06-02T16:45:11.264782+0000","last_unstale":"2024-06-02T16:45:13.297861+0000","last_undegraded":"2024-06-02T16:45:13.297861+0000","last_fullsized":"2024-06-02T16:45:13.297861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996903+0000","last_change":"2024-06-02T16:45:12.308045+0000","last_active":"2024-06-02T16:45:13.996903+0000","last_peered":"2024-06-02T16:45:13.996903+0000","last_clean":"2024-06-02T16:45:13.996903+0000","last_became_active":"2024-06-02T16:45:12.307750+0000","last_became_peered":"2024-06-02T16:45:12.307750+0000","last_unstale":"2024-06-02T16:45:13.996903+0000","last_undegraded":"2024-06-02T16:45:13.996903+0000","last_fullsized":"2024-06-02T16:45:13.996903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:24.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319811+0000","last_change":"2024-06-02T16:45:11.279209+0000","last_active":"2024-06-02T16:45:13.319811+0000","last_peered":"2024-06-02T16:45:13.319811+0000","last_clean":"2024-06-02T16:45:13.319811+0000","last_became_active":"2024-06-02T16:45:11.278908+0000","last_became_peered":"2024-06-02T16:45:11.278908+0000","last_unstale":"2024-06-02T16:45:13.319811+0000","last_undegraded":"2024-06-02T16:45:13.319811+0000","last_fullsized":"2024-06-02T16:45:13.319811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:26:48.069333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403037+0000","last_change":"2024-06-02T16:45:12.309555+0000","last_active":"2024-06-02T16:45:14.403037+0000","last_peered":"2024-06-02T16:45:14.403037+0000","last_clean":"2024-06-02T16:45:14.403037+0000","last_became_active":"2024-06-02T16:45:12.309069+0000","last_became_peered":"2024-06-02T16:45:12.309069+0000","last_unstale":"2024-06-02T16:45:14.403037+0000","last_undegraded":"2024-06-02T16:45:14.403037+0000","last_fullsized":"2024-06-02T16:45:14.403037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297157+0000","last_change":"2024-06-02T16:45:11.275392+0000","last_active":"2024-06-02T16:45:13.297157+0000","last_peered":"2024-06-02T16:45:13.297157+0000","last_clean":"2024-06-02T16:45:13.297157+0000","last_became_active":"2024-06-02T16:45:11.274685+0000","last_became_peered":"2024-06-02T16:45:11.274685+0000","last_unstale":"2024-06-02T16:45:13.297157+0000","last_undegraded":"2024-06-02T16:45:13.297157+0000","last_fullsized":"2024-06-02T16:45:13.297157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996381+0000","last_change":"2024-06-02T16:45:12.317046+0000","last_active":"2024-06-02T16:45:13.996381+0000","last_peered":"2024-06-02T16:45:13.996381+0000","last_clean":"2024-06-02T16:45:13.996381+0000","last_became_active":"2024-06-02T16:45:12.316726+0000","last_became_peered":"2024-06-02T16:45:12.316726+0000","last_unstale":"2024-06-02T16:45:13.996381+0000","last_undegraded":"2024-06-02T16:45:13.996381+0000","last_fullsized":"2024-06-02T16:45:13.996381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995299+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:45:13.995299+0000","last_peered":"2024-06-02T16:45:13.995299+0000","last_clean":"2024-06-02T16:45:13.995299+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:45:13.995299+0000","last_undegraded":"2024-06-02T16:45:13.995299+0000","last_fullsized":"2024-06-02T16:45:13.995299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401851+0000","last_change":"2024-06-02T16:45:11.275427+0000","last_active":"2024-06-02T16:45:14.401851+0000","last_peered":"2024-06-02T16:45:14.401851+0000","last_clean":"2024-06-02T16:45:14.401851+0000","last_became_active":"2024-06-02T16:45:11.275105+0000","last_became_peered":"2024-06-02T16:45:11.275105+0000","last_unstale":"2024-06-02T16:45:14.401851+0000","last_undegraded":"2024-06-02T16:45:14.401851+0000","last_fullsized":"2024-06-02T16:45:14.401851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297782+0000","last_change":"2024-06-02T16:45:12.315916+0000","last_active":"2024-06-02T16:45:13.297782+0000","last_peered":"2024-06-02T16:45:13.297782+0000","last_clean":"2024-06-02T16:45:13.297782+0000","last_became_active":"2024-06-02T16:45:12.315576+0000","last_became_peered":"2024-06-02T16:45:12.315576+0000","last_unstale":"2024-06-02T16:45:13.297782+0000","last_undegraded":"2024-06-02T16:45:13.297782+0000","last_fullsized":"2024-06-02T16:45:13.297782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995143+0000","last_change":"2024-06-02T16:45:11.284136+0000","last_active":"2024-06-02T16:45:13.995143+0000","last_peered":"2024-06-02T16:45:13.995143+0000","last_clean":"2024-06-02T16:45:13.995143+0000","last_became_active":"2024-06-02T16:45:11.283636+0000","last_became_peered":"2024-06-02T16:45:11.283636+0000","last_unstale":"2024-06-02T16:45:13.995143+0000","last_undegraded":"2024-06-02T16:45:13.995143+0000","last_fullsized":"2024-06-02T16:45:13.995143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399151+0000","last_change":"2024-06-02T16:45:12.297552+0000","last_active":"2024-06-02T16:45:14.399151+0000","last_peered":"2024-06-02T16:45:14.399151+0000","last_clean":"2024-06-02T16:45:14.399151+0000","last_became_active":"2024-06-02T16:45:12.297284+0000","last_became_peered":"2024-06-02T16:45:12.297284+0000","last_unstale":"2024-06-02T16:45:14.399151+0000","last_undegraded":"2024-06-02T16:45:14.399151+0000","last_fullsized":"2024-06-02T16:45:14.399151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:30:49.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296544+0000","last_change":"2024-06-02T16:45:11.263835+0000","last_active":"2024-06-02T16:45:13.296544+0000","last_peered":"2024-06-02T16:45:13.296544+0000","last_clean":"2024-06-02T16:45:13.296544+0000","last_became_active":"2024-06-02T16:45:11.261012+0000","last_became_peered":"2024-06-02T16:45:11.261012+0000","last_unstale":"2024-06-02T16:45:13.296544+0000","last_undegraded":"2024-06-02T16:45:13.296544+0000","last_fullsized":"2024-06-02T16:45:13.296544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319885+0000","last_change":"2024-06-02T16:45:12.293349+0000","last_active":"2024-06-02T16:45:13.319885+0000","last_peered":"2024-06-02T16:45:13.319885+0000","last_clean":"2024-06-02T16:45:13.319885+0000","last_became_active":"2024-06-02T16:45:12.292988+0000","last_became_peered":"2024-06-02T16:45:12.292988+0000","last_unstale":"2024-06-02T16:45:13.319885+0000","last_undegraded":"2024-06-02T16:45:13.319885+0000","last_fullsized":"2024-06-02T16:45:13.319885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:54:02.019911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402866+0000","last_change":"2024-06-02T16:45:11.275239+0000","last_active":"2024-06-02T16:45:14.402866+0000","last_peered":"2024-06-02T16:45:14.402866+0000","last_clean":"2024-06-02T16:45:14.402866+0000","last_became_active":"2024-06-02T16:45:11.274878+0000","last_became_peered":"2024-06-02T16:45:11.274878+0000","last_unstale":"2024-06-02T16:45:14.402866+0000","last_undegraded":"2024-06-02T16:45:14.402866+0000","last_fullsized":"2024-06-02T16:45:14.402866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402084+0000","last_change":"2024-06-02T16:45:12.299815+0000","last_active":"2024-06-02T16:45:14.402084+0000","last_peered":"2024-06-02T16:45:14.402084+0000","last_clean":"2024-06-02T16:45:14.402084+0000","last_became_active":"2024-06-02T16:45:12.299416+0000","last_became_peered":"2024-06-02T16:45:12.299416+0000","last_unstale":"2024-06-02T16:45:14.402084+0000","last_undegraded":"2024-06-02T16:45:14.402084+0000","last_fullsized":"2024-06-02T16:45:14.402084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319419+0000","last_change":"2024-06-02T16:45:11.272338+0000","last_active":"2024-06-02T16:45:13.319419+0000","last_peered":"2024-06-02T16:45:13.319419+0000","last_clean":"2024-06-02T16:45:13.319419+0000","last_became_active":"2024-06-02T16:45:11.271994+0000","last_became_peered":"2024-06-02T16:45:11.271994+0000","last_unstale":"2024-06-02T16:45:13.319419+0000","last_undegraded":"2024-06-02T16:45:13.319419+0000","last_fullsized":"2024-06-02T16:45:13.319419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:01.110485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403530+0000","last_change":"2024-06-02T16:45:12.314530+0000","last_active":"2024-06-02T16:45:14.403530+0000","last_peered":"2024-06-02T16:45:14.403530+0000","last_clean":"2024-06-02T16:45:14.403530+0000","last_became_active":"2024-06-02T16:45:12.309275+0000","last_became_peered":"2024-06-02T16:45:12.309275+0000","last_unstale":"2024-06-02T16:45:14.403530+0000","last_undegraded":"2024-06-02T16:45:14.403530+0000","last_fullsized":"2024-06-02T16:45:14.403530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996654+0000","last_change":"2024-06-02T16:45:11.286614+0000","last_active":"2024-06-02T16:45:13.996654+0000","last_peered":"2024-06-02T16:45:13.996654+0000","last_clean":"2024-06-02T16:45:13.996654+0000","last_became_active":"2024-06-02T16:45:11.286270+0000","last_became_peered":"2024-06-02T16:45:11.286270+0000","last_unstale":"2024-06-02T16:45:13.996654+0000","last_undegraded":"2024-06-02T16:45:13.996654+0000","last_fullsized":"2024-06-02T16:45:13.996654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:34.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319488+0000","last_change":"2024-06-02T16:45:12.297417+0000","last_active":"2024-06-02T16:45:13.319488+0000","last_peered":"2024-06-02T16:45:13.319488+0000","last_clean":"2024-06-02T16:45:13.319488+0000","last_became_active":"2024-06-02T16:45:12.295971+0000","last_became_peered":"2024-06-02T16:45:12.295971+0000","last_unstale":"2024-06-02T16:45:13.319488+0000","last_undegraded":"2024-06-02T16:45:13.319488+0000","last_fullsized":"2024-06-02T16:45:13.319488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:28:51.999303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.320296+0000","last_change":"2024-06-02T16:45:11.276872+0000","last_active":"2024-06-02T16:45:13.320296+0000","last_peered":"2024-06-02T16:45:13.320296+0000","last_clean":"2024-06-02T16:45:13.320296+0000","last_became_active":"2024-06-02T16:45:11.276659+0000","last_became_peered":"2024-06-02T16:45:11.276659+0000","last_unstale":"2024-06-02T16:45:13.320296+0000","last_undegraded":"2024-06-02T16:45:13.320296+0000","last_fullsized":"2024-06-02T16:45:13.320296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:35.798870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.299014+0000","last_change":"2024-06-02T16:45:12.309798+0000","last_active":"2024-06-02T16:45:13.299014+0000","last_peered":"2024-06-02T16:45:13.299014+0000","last_clean":"2024-06-02T16:45:13.299014+0000","last_became_active":"2024-06-02T16:45:12.309229+0000","last_became_peered":"2024-06-02T16:45:12.309229+0000","last_unstale":"2024-06-02T16:45:13.299014+0000","last_undegraded":"2024-06-02T16:45:13.299014+0000","last_fullsized":"2024-06-02T16:45:13.299014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325726+0000","last_change":"2024-06-02T16:45:11.284796+0000","last_active":"2024-06-02T16:45:13.325726+0000","last_peered":"2024-06-02T16:45:13.325726+0000","last_clean":"2024-06-02T16:45:13.325726+0000","last_became_active":"2024-06-02T16:45:11.284453+0000","last_became_peered":"2024-06-02T16:45:11.284453+0000","last_unstale":"2024-06-02T16:45:13.325726+0000","last_undegraded":"2024-06-02T16:45:13.325726+0000","last_fullsized":"2024-06-02T16:45:13.325726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399192+0000","last_change":"2024-06-02T16:45:12.295217+0000","last_active":"2024-06-02T16:45:14.399192+0000","last_peered":"2024-06-02T16:45:14.399192+0000","last_clean":"2024-06-02T16:45:14.399192+0000","last_became_active":"2024-06-02T16:45:12.294918+0000","last_became_peered":"2024-06-02T16:45:12.294918+0000","last_unstale":"2024-06-02T16:45:14.399192+0000","last_undegraded":"2024-06-02T16:45:14.399192+0000","last_fullsized":"2024-06-02T16:45:14.399192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:50.689496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995110+0000","last_change":"2024-06-02T16:45:11.283792+0000","last_active":"2024-06-02T16:45:13.995110+0000","last_peered":"2024-06-02T16:45:13.995110+0000","last_clean":"2024-06-02T16:45:13.995110+0000","last_became_active":"2024-06-02T16:45:11.283275+0000","last_became_peered":"2024-06-02T16:45:11.283275+0000","last_unstale":"2024-06-02T16:45:13.995110+0000","last_undegraded":"2024-06-02T16:45:13.995110+0000","last_fullsized":"2024-06-02T16:45:13.995110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:37.892243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402663+0000","last_change":"2024-06-02T16:45:12.297797+0000","last_active":"2024-06-02T16:45:14.402663+0000","last_peered":"2024-06-02T16:45:14.402663+0000","last_clean":"2024-06-02T16:45:14.402663+0000","last_became_active":"2024-06-02T16:45:12.297359+0000","last_became_peered":"2024-06-02T16:45:12.297359+0000","last_unstale":"2024-06-02T16:45:14.402663+0000","last_undegraded":"2024-06-02T16:45:14.402663+0000","last_fullsized":"2024-06-02T16:45:14.402663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319725+0000","last_change":"2024-06-02T16:45:11.278360+0000","last_active":"2024-06-02T16:45:13.319725+0000","last_peered":"2024-06-02T16:45:13.319725+0000","last_clean":"2024-06-02T16:45:13.319725+0000","last_became_active":"2024-06-02T16:45:11.277862+0000","last_became_peered":"2024-06-02T16:45:11.277862+0000","last_unstale":"2024-06-02T16:45:13.319725+0000","last_undegraded":"2024-06-02T16:45:13.319725+0000","last_fullsized":"2024-06-02T16:45:13.319725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:41:22.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296880+0000","last_change":"2024-06-02T16:45:12.306004+0000","last_active":"2024-06-02T16:45:13.296880+0000","last_peered":"2024-06-02T16:45:13.296880+0000","last_clean":"2024-06-02T16:45:13.296880+0000","last_became_active":"2024-06-02T16:45:12.305698+0000","last_became_peered":"2024-06-02T16:45:12.305698+0000","last_unstale":"2024-06-02T16:45:13.296880+0000","last_undegraded":"2024-06-02T16:45:13.296880+0000","last_fullsized":"2024-06-02T16:45:13.296880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319570+0000","last_change":"2024-06-02T16:45:11.270577+0000","last_active":"2024-06-02T16:45:13.319570+0000","last_peered":"2024-06-02T16:45:13.319570+0000","last_clean":"2024-06-02T16:45:13.319570+0000","last_became_active":"2024-06-02T16:45:11.270316+0000","last_became_peered":"2024-06-02T16:45:11.270316+0000","last_unstale":"2024-06-02T16:45:13.319570+0000","last_undegraded":"2024-06-02T16:45:13.319570+0000","last_fullsized":"2024-06-02T16:45:13.319570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:49.398066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297767+0000","last_change":"2024-06-02T16:45:12.306883+0000","last_active":"2024-06-02T16:45:13.297767+0000","last_peered":"2024-06-02T16:45:13.297767+0000","last_clean":"2024-06-02T16:45:13.297767+0000","last_became_active":"2024-06-02T16:45:12.306582+0000","last_became_peered":"2024-06-02T16:45:12.306582+0000","last_unstale":"2024-06-02T16:45:13.297767+0000","last_undegraded":"2024-06-02T16:45:13.297767+0000","last_fullsized":"2024-06-02T16:45:13.297767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996343+0000","last_change":"2024-06-02T16:45:11.288038+0000","last_active":"2024-06-02T16:45:13.996343+0000","last_peered":"2024-06-02T16:45:13.996343+0000","last_clean":"2024-06-02T16:45:13.996343+0000","last_became_active":"2024-06-02T16:45:11.287757+0000","last_became_peered":"2024-06-02T16:45:11.287757+0000","last_unstale":"2024-06-02T16:45:13.996343+0000","last_undegraded":"2024-06-02T16:45:13.996343+0000","last_fullsized":"2024-06-02T16:45:13.996343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325212+0000","last_change":"2024-06-02T16:45:12.298140+0000","last_active":"2024-06-02T16:45:13.325212+0000","last_peered":"2024-06-02T16:45:13.325212+0000","last_clean":"2024-06-02T16:45:13.325212+0000","last_became_active":"2024-06-02T16:45:12.297832+0000","last_became_peered":"2024-06-02T16:45:12.297832+0000","last_unstale":"2024-06-02T16:45:13.325212+0000","last_undegraded":"2024-06-02T16:45:13.325212+0000","last_fullsized":"2024-06-02T16:45:13.325212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403511+0000","last_change":"2024-06-02T16:45:12.302894+0000","last_active":"2024-06-02T16:45:14.403511+0000","last_peered":"2024-06-02T16:45:14.403511+0000","last_clean":"2024-06-02T16:45:14.403511+0000","last_became_active":"2024-06-02T16:45:12.302609+0000","last_became_peered":"2024-06-02T16:45:12.302609+0000","last_unstale":"2024-06-02T16:45:14.403511+0000","last_undegraded":"2024-06-02T16:45:14.403511+0000","last_fullsized":"2024-06-02T16:45:14.403511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995933+0000","last_change":"2024-06-02T16:45:11.286611+0000","last_active":"2024-06-02T16:45:13.995933+0000","last_peered":"2024-06-02T16:45:13.995933+0000","last_clean":"2024-06-02T16:45:13.995933+0000","last_became_active":"2024-06-02T16:45:11.286294+0000","last_became_peered":"2024-06-02T16:45:11.286294+0000","last_unstale":"2024-06-02T16:45:13.995933+0000","last_undegraded":"2024-06-02T16:45:13.995933+0000","last_fullsized":"2024-06-02T16:45:13.995933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:07.092809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402591+0000","last_change":"2024-06-02T16:45:12.302182+0000","last_active":"2024-06-02T16:45:14.402591+0000","last_peered":"2024-06-02T16:45:14.402591+0000","last_clean":"2024-06-02T16:45:14.402591+0000","last_became_active":"2024-06-02T16:45:12.301903+0000","last_became_peered":"2024-06-02T16:45:12.301903+0000","last_unstale":"2024-06-02T16:45:14.402591+0000","last_undegraded":"2024-06-02T16:45:14.402591+0000","last_fullsized":"2024-06-02T16:45:14.402591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996321+0000","last_change":"2024-06-02T16:45:11.286446+0000","last_active":"2024-06-02T16:45:13.996321+0000","last_peered":"2024-06-02T16:45:13.996321+0000","last_clean":"2024-06-02T16:45:13.996321+0000","last_became_active":"2024-06-02T16:45:11.286095+0000","last_became_peered":"2024-06-02T16:45:11.286095+0000","last_unstale":"2024-06-02T16:45:13.996321+0000","last_undegraded":"2024-06-02T16:45:13.996321+0000","last_fullsized":"2024-06-02T16:45:13.996321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:28.668240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399348+0000","last_change":"2024-06-02T16:45:12.309888+0000","last_active":"2024-06-02T16:45:14.399348+0000","last_peered":"2024-06-02T16:45:14.399348+0000","last_clean":"2024-06-02T16:45:14.399348+0000","last_became_active":"2024-06-02T16:45:12.309638+0000","last_became_peered":"2024-06-02T16:45:12.309638+0000","last_unstale":"2024-06-02T16:45:14.399348+0000","last_undegraded":"2024-06-02T16:45:14.399348+0000","last_fullsized":"2024-06-02T16:45:14.399348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298853+0000","last_change":"2024-06-02T16:45:11.271444+0000","last_active":"2024-06-02T16:45:13.298853+0000","last_peered":"2024-06-02T16:45:13.298853+0000","last_clean":"2024-06-02T16:45:13.298853+0000","last_became_active":"2024-06-02T16:45:11.271168+0000","last_became_peered":"2024-06-02T16:45:11.271168+0000","last_unstale":"2024-06-02T16:45:13.298853+0000","last_undegraded":"2024-06-02T16:45:13.298853+0000","last_fullsized":"2024-06-02T16:45:13.298853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:40.375189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298807+0000","last_change":"2024-06-02T16:45:12.303300+0000","last_active":"2024-06-02T16:45:13.298807+0000","last_peered":"2024-06-02T16:45:13.298807+0000","last_clean":"2024-06-02T16:45:13.298807+0000","last_became_active":"2024-06-02T16:45:12.303009+0000","last_became_peered":"2024-06-02T16:45:12.303009+0000","last_unstale":"2024-06-02T16:45:13.298807+0000","last_undegraded":"2024-06-02T16:45:13.298807+0000","last_fullsized":"2024-06-02T16:45:13.298807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399543+0000","last_change":"2024-06-02T16:45:11.285228+0000","last_active":"2024-06-02T16:45:14.399543+0000","last_peered":"2024-06-02T16:45:14.399543+0000","last_clean":"2024-06-02T16:45:14.399543+0000","last_became_active":"2024-06-02T16:45:11.284770+0000","last_became_peered":"2024-06-02T16:45:11.284770+0000","last_unstale":"2024-06-02T16:45:14.399543+0000","last_undegraded":"2024-06-02T16:45:14.399543+0000","last_fullsized":"2024-06-02T16:45:14.399543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":670785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":79835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:45:22.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:45:22.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.720+0000 7f9bcd400640 1 Processor -- start 2024-06-02T16:45:22.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.721+0000 7f9bcd400640 1 -- start start 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bcd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc80b6c50 0x7f9bc80bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bcd400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc815f7a0 con 0x7f9bc80d4da0 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bcd400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc80d3d00 con 0x7f9bc80d3560 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bcd400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc80d3fe0 con 0x7f9bc80b6c50 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bc7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc80b6c50 0x7f9bc80bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bc7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc80b6c50 0x7f9bc80bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53364/0 (socket says 172.21.15.52:53364) 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.722+0000 7f9bc7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9bc80d4da0 0x7f9bc80b7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51948/0 (socket says 172.21.15.52:51948) 2024-06-02T16:45:22.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.723+0000 7f9bc7400640 1 -- 172.21.15.52:0/3127763477 learned_addr learned my addr 172.21.15.52:0/3127763477 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:22.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.723+0000 7f9bc7e00640 1 -- 172.21.15.52:0/3127763477 >> v1:172.21.15.114:6789/0 conn(0x7f9bc80d3560 legacy=0x7f9bc80b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:22.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.723+0000 7f9bc7e00640 1 -- 172.21.15.52:0/3127763477 >> v1:172.21.15.52:6789/0 conn(0x7f9bc80d4da0 legacy=0x7f9bc80b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.723+0000 7f9bc7e00640 1 -- 172.21.15.52:0/3127763477 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc80d42c0 con 0x7f9bc80b6c50 2024-06-02T16:45:22.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.724+0000 7f9bc7e00640 1 --2- 172.21.15.52:0/3127763477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80b6c50 0x7f9bc80bad90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097a0 tx=0x7f9bb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687edfc62130b4aa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.724+0000 7f9bc6a00640 1 -- 172.21.15.52:0/3127763477 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8037070 con 0x7f9bc80b6c50 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.724+0000 7f9bc6a00640 1 -- 172.21.15.52:0/3127763477 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8032440 con 0x7f9bc80b6c50 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.724+0000 7f9bc6a00640 1 -- 172.21.15.52:0/3127763477 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8032810 con 0x7f9bc80b6c50 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 -- 172.21.15.52:0/3127763477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80b6c50 msgr2=0x7f9bc80bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 --2- 172.21.15.52:0/3127763477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80b6c50 0x7f9bc80bad90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097a0 tx=0x7f9bb802a180 comp rx=0 tx=0).stop 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 -- 172.21.15.52:0/3127763477 shutdown_connections 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 --2- 172.21.15.52:0/3127763477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80b6c50 0x7f9bc80bad90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 -- 172.21.15.52:0/3127763477 >> 172.21.15.52:0/3127763477 conn(0x7f9bc80740e0 msgr2=0x7f9bc80d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 -- 172.21.15.52:0/3127763477 shutdown_connections 2024-06-02T16:45:22.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.725+0000 7f9bcd400640 1 -- 172.21.15.52:0/3127763477 wait complete. 2024-06-02T16:45:22.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.727+0000 7f9bcd400640 1 Processor -- start 2024-06-02T16:45:22.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.727+0000 7f9bcd400640 1 -- start start 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc80b6c50 0x7f9bc81603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bc80d4da0 0x7f9bc81532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80d3940 con 0x7f9bc80d3560 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80d4880 con 0x7f9bc80b6c50 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bcd400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc80d3ac0 con 0x7f9bc80d4da0 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bc7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bc7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53378/0 (socket says 172.21.15.52:53378) 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bc7400640 1 -- 172.21.15.52:0/547201311 learned_addr learned my addr 172.21.15.52:0/547201311 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:22.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.728+0000 7f9bc7e00640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc80b6c50 0x7f9bc81603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 -- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bc80d4da0 msgr2=0x7f9bc81532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bc80d4da0 0x7f9bc81532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 -- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc80b6c50 msgr2=0x7f9bc81603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc80b6c50 0x7f9bc81603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 -- 172.21.15.52:0/547201311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc8160ab0 con 0x7f9bc80d3560 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bc7400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400c3a0 tx=0x7f9bb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4017070 con 0x7f9bc80d3560 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb4005ce0 con 0x7f9bc80d3560 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4007310 con 0x7f9bc80d3560 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc8160d90 con 0x7f9bc80d3560 2024-06-02T16:45:22.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.729+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc8153830 con 0x7f9bc80d3560 2024-06-02T16:45:22.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.731+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc80507e0 con 0x7f9bc80d3560 2024-06-02T16:45:22.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.732+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9bb401a070 con 0x7f9bc80d3560 2024-06-02T16:45:22.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.732+0000 7f9bbfe00640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 0x7f9ba8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:22.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.733+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9bb4096970 con 0x7f9bc80d3560 2024-06-02T16:45:22.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.733+0000 7f9bc7e00640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 0x7f9ba8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:22.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.734+0000 7f9bc7e00640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 0x7f9ba8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8034000 tx=0x7f9bb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:22.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.739+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9bb40602c0 con 0x7f9bc80d3560 2024-06-02T16:45:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.944+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bc80b4910 con 0x7f9ba80762d0 2024-06-02T16:45:22.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.964+0000 7f9bbfe00640 1 -- 172.21.15.52:0/547201311 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f9bc80b4910 con 0x7f9ba80762d0 2024-06-02T16:45:22.967 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:22.968 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 msgr2=0x7f9ba8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 0x7f9ba8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8034000 tx=0x7f9bb802e000 comp rx=0 tx=0).stop 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 msgr2=0x7f9bc8162780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400c3a0 tx=0x7f9bb400c860 comp rx=0 tx=0).stop 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 shutdown_connections 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9ba80762d0 0x7f9ba8078790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bc80d4da0 0x7f9bc81532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc80d3560 0x7f9bc8162780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 --2- 172.21.15.52:0/547201311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc80b6c50 0x7f9bc81603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:22.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 >> 172.21.15.52:0/547201311 conn(0x7f9bc80740e0 msgr2=0x7f9bc806d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:22.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 shutdown_connections 2024-06-02T16:45:22.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:22.970+0000 7f9bcd400640 1 -- 172.21.15.52:0/547201311 wait complete. 2024-06-02T16:45:22.989 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-06-02T16:45:21.995665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3088384,"data_stored":1824236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.730592"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996517+0000","last_change":"2024-06-02T16:45:12.306743+0000","last_active":"2024-06-02T16:45:13.996517+0000","last_peered":"2024-06-02T16:45:13.996517+0000","last_clean":"2024-06-02T16:45:13.996517+0000","last_became_active":"2024-06-02T16:45:12.306440+0000","last_became_peered":"2024-06-02T16:45:12.306440+0000","last_unstale":"2024-06-02T16:45:13.996517+0000","last_undegraded":"2024-06-02T16:45:13.996517+0000","last_fullsized":"2024-06-02T16:45:13.996517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.320144+0000","last_change":"2024-06-02T16:45:12.292683+0000","last_active":"2024-06-02T16:45:13.320144+0000","last_peered":"2024-06-02T16:45:13.320144+0000","last_clean":"2024-06-02T16:45:13.320144+0000","last_became_active":"2024-06-02T16:45:12.292372+0000","last_became_peered":"2024-06-02T16:45:12.292372+0000","last_unstale":"2024-06-02T16:45:13.320144+0000","last_undegraded":"2024-06-02T16:45:13.320144+0000","last_fullsized":"2024-06-02T16:45:13.320144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:59.218400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399312+0000","last_change":"2024-06-02T16:45:12.293718+0000","last_active":"2024-06-02T16:45:14.399312+0000","last_peered":"2024-06-02T16:45:14.399312+0000","last_clean":"2024-06-02T16:45:14.399312+0000","last_became_active":"2024-06-02T16:45:12.293430+0000","last_became_peered":"2024-06-02T16:45:12.293430+0000","last_unstale":"2024-06-02T16:45:14.399312+0000","last_undegraded":"2024-06-02T16:45:14.399312+0000","last_fullsized":"2024-06-02T16:45:14.399312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402594+0000","last_change":"2024-06-02T16:45:12.309651+0000","last_active":"2024-06-02T16:45:14.402594+0000","last_peered":"2024-06-02T16:45:14.402594+0000","last_clean":"2024-06-02T16:45:14.402594+0000","last_became_active":"2024-06-02T16:45:12.309314+0000","last_became_peered":"2024-06-02T16:45:12.309314+0000","last_unstale":"2024-06-02T16:45:14.402594+0000","last_undegraded":"2024-06-02T16:45:14.402594+0000","last_fullsized":"2024-06-02T16:45:14.402594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995876+0000","last_change":"2024-06-02T16:45:12.297519+0000","last_active":"2024-06-02T16:45:13.995876+0000","last_peered":"2024-06-02T16:45:13.995876+0000","last_clean":"2024-06-02T16:45:13.995876+0000","last_became_active":"2024-06-02T16:45:12.297239+0000","last_became_peered":"2024-06-02T16:45:12.297239+0000","last_unstale":"2024-06-02T16:45:13.995876+0000","last_undegraded":"2024-06-02T16:45:13.995876+0000","last_fullsized":"2024-06-02T16:45:13.995876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401349+0000","last_change":"2024-06-02T16:45:12.311245+0000","last_active":"2024-06-02T16:45:14.401349+0000","last_peered":"2024-06-02T16:45:14.401349+0000","last_clean":"2024-06-02T16:45:14.401349+0000","last_became_active":"2024-06-02T16:45:12.310210+0000","last_became_peered":"2024-06-02T16:45:12.310210+0000","last_unstale":"2024-06-02T16:45:14.401349+0000","last_undegraded":"2024-06-02T16:45:14.401349+0000","last_fullsized":"2024-06-02T16:45:14.401349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995424+0000","last_change":"2024-06-02T16:45:12.298527+0000","last_active":"2024-06-02T16:45:13.995424+0000","last_peered":"2024-06-02T16:45:13.995424+0000","last_clean":"2024-06-02T16:45:13.995424+0000","last_became_active":"2024-06-02T16:45:12.297923+0000","last_became_peered":"2024-06-02T16:45:12.297923+0000","last_unstale":"2024-06-02T16:45:13.995424+0000","last_undegraded":"2024-06-02T16:45:13.995424+0000","last_fullsized":"2024-06-02T16:45:13.995424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296562+0000","last_change":"2024-06-02T16:45:12.319083+0000","last_active":"2024-06-02T16:45:13.296562+0000","last_peered":"2024-06-02T16:45:13.296562+0000","last_clean":"2024-06-02T16:45:13.296562+0000","last_became_active":"2024-06-02T16:45:12.318762+0000","last_became_peered":"2024-06-02T16:45:12.318762+0000","last_unstale":"2024-06-02T16:45:13.296562+0000","last_undegraded":"2024-06-02T16:45:13.296562+0000","last_fullsized":"2024-06-02T16:45:13.296562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996683+0000","last_change":"2024-06-02T16:45:12.317753+0000","last_active":"2024-06-02T16:45:13.996683+0000","last_peered":"2024-06-02T16:45:13.996683+0000","last_clean":"2024-06-02T16:45:13.996683+0000","last_became_active":"2024-06-02T16:45:12.317416+0000","last_became_peered":"2024-06-02T16:45:12.317416+0000","last_unstale":"2024-06-02T16:45:13.996683+0000","last_undegraded":"2024-06-02T16:45:13.996683+0000","last_fullsized":"2024-06-02T16:45:13.996683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:31.192107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325971+0000","last_change":"2024-06-02T16:45:12.296816+0000","last_active":"2024-06-02T16:45:13.325971+0000","last_peered":"2024-06-02T16:45:13.325971+0000","last_clean":"2024-06-02T16:45:13.325971+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325971+0000","last_undegraded":"2024-06-02T16:45:13.325971+0000","last_fullsized":"2024-06-02T16:45:13.325971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325571+0000","last_change":"2024-06-02T16:45:12.304652+0000","last_active":"2024-06-02T16:45:13.325571+0000","last_peered":"2024-06-02T16:45:13.325571+0000","last_clean":"2024-06-02T16:45:13.325571+0000","last_became_active":"2024-06-02T16:45:12.304386+0000","last_became_peered":"2024-06-02T16:45:12.304386+0000","last_unstale":"2024-06-02T16:45:13.325571+0000","last_undegraded":"2024-06-02T16:45:13.325571+0000","last_fullsized":"2024-06-02T16:45:13.325571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402540+0000","last_change":"2024-06-02T16:45:12.305078+0000","last_active":"2024-06-02T16:45:14.402540+0000","last_peered":"2024-06-02T16:45:14.402540+0000","last_clean":"2024-06-02T16:45:14.402540+0000","last_became_active":"2024-06-02T16:45:12.304544+0000","last_became_peered":"2024-06-02T16:45:12.304544+0000","last_unstale":"2024-06-02T16:45:14.402540+0000","last_undegraded":"2024-06-02T16:45:14.402540+0000","last_fullsized":"2024-06-02T16:45:14.402540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:43.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297756+0000","last_change":"2024-06-02T16:45:12.308837+0000","last_active":"2024-06-02T16:45:13.297756+0000","last_peered":"2024-06-02T16:45:13.297756+0000","last_clean":"2024-06-02T16:45:13.297756+0000","last_became_active":"2024-06-02T16:45:12.307884+0000","last_became_peered":"2024-06-02T16:45:12.307884+0000","last_unstale":"2024-06-02T16:45:13.297756+0000","last_undegraded":"2024-06-02T16:45:13.297756+0000","last_fullsized":"2024-06-02T16:45:13.297756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399239+0000","last_change":"2024-06-02T16:45:12.302741+0000","last_active":"2024-06-02T16:45:14.399239+0000","last_peered":"2024-06-02T16:45:14.399239+0000","last_clean":"2024-06-02T16:45:14.399239+0000","last_became_active":"2024-06-02T16:45:12.302448+0000","last_became_peered":"2024-06-02T16:45:12.302448+0000","last_unstale":"2024-06-02T16:45:14.399239+0000","last_undegraded":"2024-06-02T16:45:14.399239+0000","last_fullsized":"2024-06-02T16:45:14.399239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319423+0000","last_change":"2024-06-02T16:45:12.298379+0000","last_active":"2024-06-02T16:45:13.319423+0000","last_peered":"2024-06-02T16:45:13.319423+0000","last_clean":"2024-06-02T16:45:13.319423+0000","last_became_active":"2024-06-02T16:45:12.297169+0000","last_became_peered":"2024-06-02T16:45:12.297169+0000","last_unstale":"2024-06-02T16:45:13.319423+0000","last_undegraded":"2024-06-02T16:45:13.319423+0000","last_fullsized":"2024-06-02T16:45:13.319423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:20.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400485+0000","last_change":"2024-06-02T16:45:12.313940+0000","last_active":"2024-06-02T16:45:14.400485+0000","last_peered":"2024-06-02T16:45:14.400485+0000","last_clean":"2024-06-02T16:45:14.400485+0000","last_became_active":"2024-06-02T16:45:12.313226+0000","last_became_peered":"2024-06-02T16:45:12.313226+0000","last_unstale":"2024-06-02T16:45:14.400485+0000","last_undegraded":"2024-06-02T16:45:14.400485+0000","last_fullsized":"2024-06-02T16:45:14.400485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403995+0000","last_change":"2024-06-02T16:45:12.312810+0000","last_active":"2024-06-02T16:45:14.403995+0000","last_peered":"2024-06-02T16:45:14.403995+0000","last_clean":"2024-06-02T16:45:14.403995+0000","last_became_active":"2024-06-02T16:45:12.312269+0000","last_became_peered":"2024-06-02T16:45:12.312269+0000","last_unstale":"2024-06-02T16:45:14.403995+0000","last_undegraded":"2024-06-02T16:45:14.403995+0000","last_fullsized":"2024-06-02T16:45:14.403995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:11:21.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297718+0000","last_change":"2024-06-02T16:45:12.304201+0000","last_active":"2024-06-02T16:45:13.297718+0000","last_peered":"2024-06-02T16:45:13.297718+0000","last_clean":"2024-06-02T16:45:13.297718+0000","last_became_active":"2024-06-02T16:45:12.303839+0000","last_became_peered":"2024-06-02T16:45:12.303839+0000","last_unstale":"2024-06-02T16:45:13.297718+0000","last_undegraded":"2024-06-02T16:45:13.297718+0000","last_fullsized":"2024-06-02T16:45:13.297718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:35.402248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996653+0000","last_change":"2024-06-02T16:45:12.300262+0000","last_active":"2024-06-02T16:45:13.996653+0000","last_peered":"2024-06-02T16:45:13.996653+0000","last_clean":"2024-06-02T16:45:13.996653+0000","last_became_active":"2024-06-02T16:45:12.299445+0000","last_became_peered":"2024-06-02T16:45:12.299445+0000","last_unstale":"2024-06-02T16:45:13.996653+0000","last_undegraded":"2024-06-02T16:45:13.996653+0000","last_fullsized":"2024-06-02T16:45:13.996653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:05.323209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325689+0000","last_change":"2024-06-02T16:45:12.303651+0000","last_active":"2024-06-02T16:45:13.325689+0000","last_peered":"2024-06-02T16:45:13.325689+0000","last_clean":"2024-06-02T16:45:13.325689+0000","last_became_active":"2024-06-02T16:45:12.301465+0000","last_became_peered":"2024-06-02T16:45:12.301465+0000","last_unstale":"2024-06-02T16:45:13.325689+0000","last_undegraded":"2024-06-02T16:45:13.325689+0000","last_fullsized":"2024-06-02T16:45:13.325689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399138+0000","last_change":"2024-06-02T16:45:12.301175+0000","last_active":"2024-06-02T16:45:14.399138+0000","last_peered":"2024-06-02T16:45:14.399138+0000","last_clean":"2024-06-02T16:45:14.399138+0000","last_became_active":"2024-06-02T16:45:12.300384+0000","last_became_peered":"2024-06-02T16:45:12.300384+0000","last_unstale":"2024-06-02T16:45:14.399138+0000","last_undegraded":"2024-06-02T16:45:14.399138+0000","last_fullsized":"2024-06-02T16:45:14.399138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:46.679838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402228+0000","last_change":"2024-06-02T16:45:12.311520+0000","last_active":"2024-06-02T16:45:14.402228+0000","last_peered":"2024-06-02T16:45:14.402228+0000","last_clean":"2024-06-02T16:45:14.402228+0000","last_became_active":"2024-06-02T16:45:12.310653+0000","last_became_peered":"2024-06-02T16:45:12.310653+0000","last_unstale":"2024-06-02T16:45:14.402228+0000","last_undegraded":"2024-06-02T16:45:14.402228+0000","last_fullsized":"2024-06-02T16:45:14.402228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297205+0000","last_change":"2024-06-02T16:45:12.304397+0000","last_active":"2024-06-02T16:45:13.297205+0000","last_peered":"2024-06-02T16:45:13.297205+0000","last_clean":"2024-06-02T16:45:13.297205+0000","last_became_active":"2024-06-02T16:45:12.304107+0000","last_became_peered":"2024-06-02T16:45:12.304107+0000","last_unstale":"2024-06-02T16:45:13.297205+0000","last_undegraded":"2024-06-02T16:45:13.297205+0000","last_fullsized":"2024-06-02T16:45:13.297205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400682+0000","last_change":"2024-06-02T16:45:12.314155+0000","last_active":"2024-06-02T16:45:14.400682+0000","last_peered":"2024-06-02T16:45:14.400682+0000","last_clean":"2024-06-02T16:45:14.400682+0000","last_became_active":"2024-06-02T16:45:12.313644+0000","last_became_peered":"2024-06-02T16:45:12.313644+0000","last_unstale":"2024-06-02T16:45:14.400682+0000","last_undegraded":"2024-06-02T16:45:14.400682+0000","last_fullsized":"2024-06-02T16:45:14.400682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298924+0000","last_change":"2024-06-02T16:45:12.306290+0000","last_active":"2024-06-02T16:45:13.298924+0000","last_peered":"2024-06-02T16:45:13.298924+0000","last_clean":"2024-06-02T16:45:13.298924+0000","last_became_active":"2024-06-02T16:45:12.306055+0000","last_became_peered":"2024-06-02T16:45:12.306055+0000","last_unstale":"2024-06-02T16:45:13.298924+0000","last_undegraded":"2024-06-02T16:45:13.298924+0000","last_fullsized":"2024-06-02T16:45:13.298924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.326006+0000","last_change":"2024-06-02T16:45:12.303636+0000","last_active":"2024-06-02T16:45:13.326006+0000","last_peered":"2024-06-02T16:45:13.326006+0000","last_clean":"2024-06-02T16:45:13.326006+0000","last_became_active":"2024-06-02T16:45:12.302670+0000","last_became_peered":"2024-06-02T16:45:12.302670+0000","last_unstale":"2024-06-02T16:45:13.326006+0000","last_undegraded":"2024-06-02T16:45:13.326006+0000","last_fullsized":"2024-06-02T16:45:13.326006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319893+0000","last_change":"2024-06-02T16:45:12.299670+0000","last_active":"2024-06-02T16:45:13.319893+0000","last_peered":"2024-06-02T16:45:13.319893+0000","last_clean":"2024-06-02T16:45:13.319893+0000","last_became_active":"2024-06-02T16:45:12.299052+0000","last_became_peered":"2024-06-02T16:45:12.299052+0000","last_unstale":"2024-06-02T16:45:13.319893+0000","last_undegraded":"2024-06-02T16:45:13.319893+0000","last_fullsized":"2024-06-02T16:45:13.319893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:04.607697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298514+0000","last_change":"2024-06-02T16:45:12.303422+0000","last_active":"2024-06-02T16:45:13.298514+0000","last_peered":"2024-06-02T16:45:13.298514+0000","last_clean":"2024-06-02T16:45:13.298514+0000","last_became_active":"2024-06-02T16:45:12.301580+0000","last_became_peered":"2024-06-02T16:45:12.301580+0000","last_unstale":"2024-06-02T16:45:13.298514+0000","last_undegraded":"2024-06-02T16:45:13.298514+0000","last_fullsized":"2024-06-02T16:45:13.298514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:12.018196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399235+0000","last_change":"2024-06-02T16:45:12.310664+0000","last_active":"2024-06-02T16:45:14.399235+0000","last_peered":"2024-06-02T16:45:14.399235+0000","last_clean":"2024-06-02T16:45:14.399235+0000","last_became_active":"2024-06-02T16:45:12.310369+0000","last_became_peered":"2024-06-02T16:45:12.310369+0000","last_unstale":"2024-06-02T16:45:14.399235+0000","last_undegraded":"2024-06-02T16:45:14.399235+0000","last_fullsized":"2024-06-02T16:45:14.399235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402532+0000","last_change":"2024-06-02T16:45:12.310972+0000","last_active":"2024-06-02T16:45:14.402532+0000","last_peered":"2024-06-02T16:45:14.402532+0000","last_clean":"2024-06-02T16:45:14.402532+0000","last_became_active":"2024-06-02T16:45:12.309072+0000","last_became_peered":"2024-06-02T16:45:12.309072+0000","last_unstale":"2024-06-02T16:45:14.402532+0000","last_undegraded":"2024-06-02T16:45:14.402532+0000","last_fullsized":"2024-06-02T16:45:14.402532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296413+0000","last_change":"2024-06-02T16:45:12.319222+0000","last_active":"2024-06-02T16:45:13.296413+0000","last_peered":"2024-06-02T16:45:13.296413+0000","last_clean":"2024-06-02T16:45:13.296413+0000","last_became_active":"2024-06-02T16:45:12.318902+0000","last_became_peered":"2024-06-02T16:45:12.318902+0000","last_unstale":"2024-06-02T16:45:13.296413+0000","last_undegraded":"2024-06-02T16:45:13.296413+0000","last_fullsized":"2024-06-02T16:45:13.296413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325172+0000","last_change":"2024-06-02T16:45:12.293440+0000","last_active":"2024-06-02T16:45:13.325172+0000","last_peered":"2024-06-02T16:45:13.325172+0000","last_clean":"2024-06-02T16:45:13.325172+0000","last_became_active":"2024-06-02T16:45:12.293145+0000","last_became_peered":"2024-06-02T16:45:12.293145+0000","last_unstale":"2024-06-02T16:45:13.325172+0000","last_undegraded":"2024-06-02T16:45:13.325172+0000","last_fullsized":"2024-06-02T16:45:13.325172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:39:58.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401279+0000","last_change":"2024-06-02T16:45:12.302510+0000","last_active":"2024-06-02T16:45:14.401279+0000","last_peered":"2024-06-02T16:45:14.401279+0000","last_clean":"2024-06-02T16:45:14.401279+0000","last_became_active":"2024-06-02T16:45:12.301477+0000","last_became_peered":"2024-06-02T16:45:12.301477+0000","last_unstale":"2024-06-02T16:45:14.401279+0000","last_undegraded":"2024-06-02T16:45:14.401279+0000","last_fullsized":"2024-06-02T16:45:14.401279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:30.978103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297991+0000","last_change":"2024-06-02T16:45:11.272839+0000","last_active":"2024-06-02T16:45:13.297991+0000","last_peered":"2024-06-02T16:45:13.297991+0000","last_clean":"2024-06-02T16:45:13.297991+0000","last_became_active":"2024-06-02T16:45:11.272540+0000","last_became_peered":"2024-06-02T16:45:11.272540+0000","last_unstale":"2024-06-02T16:45:13.297991+0000","last_undegraded":"2024-06-02T16:45:13.297991+0000","last_fullsized":"2024-06-02T16:45:13.297991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399356+0000","last_change":"2024-06-02T16:45:12.305267+0000","last_active":"2024-06-02T16:45:14.399356+0000","last_peered":"2024-06-02T16:45:14.399356+0000","last_clean":"2024-06-02T16:45:14.399356+0000","last_became_active":"2024-06-02T16:45:12.304804+0000","last_became_peered":"2024-06-02T16:45:12.304804+0000","last_unstale":"2024-06-02T16:45:14.399356+0000","last_undegraded":"2024-06-02T16:45:14.399356+0000","last_fullsized":"2024-06-02T16:45:14.399356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325127+0000","last_change":"2024-06-02T16:45:11.271730+0000","last_active":"2024-06-02T16:45:13.325127+0000","last_peered":"2024-06-02T16:45:13.325127+0000","last_clean":"2024-06-02T16:45:13.325127+0000","last_became_active":"2024-06-02T16:45:11.269255+0000","last_became_peered":"2024-06-02T16:45:11.269255+0000","last_unstale":"2024-06-02T16:45:13.325127+0000","last_undegraded":"2024-06-02T16:45:13.325127+0000","last_fullsized":"2024-06-02T16:45:13.325127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297433+0000","last_change":"2024-06-02T16:45:11.269405+0000","last_active":"2024-06-02T16:45:13.297433+0000","last_peered":"2024-06-02T16:45:13.297433+0000","last_clean":"2024-06-02T16:45:13.297433+0000","last_became_active":"2024-06-02T16:45:11.269072+0000","last_became_peered":"2024-06-02T16:45:11.269072+0000","last_unstale":"2024-06-02T16:45:13.297433+0000","last_undegraded":"2024-06-02T16:45:13.297433+0000","last_fullsized":"2024-06-02T16:45:13.297433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:22:39.392040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297102+0000","last_change":"2024-06-02T16:45:12.308910+0000","last_active":"2024-06-02T16:45:13.297102+0000","last_peered":"2024-06-02T16:45:13.297102+0000","last_clean":"2024-06-02T16:45:13.297102+0000","last_became_active":"2024-06-02T16:45:12.308375+0000","last_became_peered":"2024-06-02T16:45:12.308375+0000","last_unstale":"2024-06-02T16:45:13.297102+0000","last_undegraded":"2024-06-02T16:45:13.297102+0000","last_fullsized":"2024-06-02T16:45:13.297102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:09.448653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.400758+0000","last_change":"2024-06-02T16:45:11.280551+0000","last_active":"2024-06-02T16:45:14.400758+0000","last_peered":"2024-06-02T16:45:14.400758+0000","last_clean":"2024-06-02T16:45:14.400758+0000","last_became_active":"2024-06-02T16:45:11.279982+0000","last_became_peered":"2024-06-02T16:45:11.279982+0000","last_unstale":"2024-06-02T16:45:14.400758+0000","last_undegraded":"2024-06-02T16:45:14.400758+0000","last_fullsized":"2024-06-02T16:45:14.400758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319501+0000","last_change":"2024-06-02T16:45:12.294403+0000","last_active":"2024-06-02T16:45:13.319501+0000","last_peered":"2024-06-02T16:45:13.319501+0000","last_clean":"2024-06-02T16:45:13.319501+0000","last_became_active":"2024-06-02T16:45:12.294104+0000","last_became_peered":"2024-06-02T16:45:12.294104+0000","last_unstale":"2024-06-02T16:45:13.319501+0000","last_undegraded":"2024-06-02T16:45:13.319501+0000","last_fullsized":"2024-06-02T16:45:13.319501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:49.129875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325481+0000","last_change":"2024-06-02T16:45:11.279215+0000","last_active":"2024-06-02T16:45:13.325481+0000","last_peered":"2024-06-02T16:45:13.325481+0000","last_clean":"2024-06-02T16:45:13.325481+0000","last_became_active":"2024-06-02T16:45:11.278900+0000","last_became_peered":"2024-06-02T16:45:11.278900+0000","last_unstale":"2024-06-02T16:45:13.325481+0000","last_undegraded":"2024-06-02T16:45:13.325481+0000","last_fullsized":"2024-06-02T16:45:13.325481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403606+0000","last_change":"2024-06-02T16:45:12.312906+0000","last_active":"2024-06-02T16:45:14.403606+0000","last_peered":"2024-06-02T16:45:14.403606+0000","last_clean":"2024-06-02T16:45:14.403606+0000","last_became_active":"2024-06-02T16:45:12.312594+0000","last_became_peered":"2024-06-02T16:45:12.312594+0000","last_unstale":"2024-06-02T16:45:14.403606+0000","last_undegraded":"2024-06-02T16:45:14.403606+0000","last_fullsized":"2024-06-02T16:45:14.403606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403585+0000","last_change":"2024-06-02T16:45:11.283234+0000","last_active":"2024-06-02T16:45:14.403585+0000","last_peered":"2024-06-02T16:45:14.403585+0000","last_clean":"2024-06-02T16:45:14.403585+0000","last_became_active":"2024-06-02T16:45:11.282949+0000","last_became_peered":"2024-06-02T16:45:11.282949+0000","last_unstale":"2024-06-02T16:45:14.403585+0000","last_undegraded":"2024-06-02T16:45:14.403585+0000","last_fullsized":"2024-06-02T16:45:14.403585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399516+0000","last_change":"2024-06-02T16:45:12.317022+0000","last_active":"2024-06-02T16:45:14.399516+0000","last_peered":"2024-06-02T16:45:14.399516+0000","last_clean":"2024-06-02T16:45:14.399516+0000","last_became_active":"2024-06-02T16:45:12.316687+0000","last_became_peered":"2024-06-02T16:45:12.316687+0000","last_unstale":"2024-06-02T16:45:14.399516+0000","last_undegraded":"2024-06-02T16:45:14.399516+0000","last_fullsized":"2024-06-02T16:45:14.399516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.105718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319666+0000","last_change":"2024-06-02T16:45:11.279941+0000","last_active":"2024-06-02T16:45:13.319666+0000","last_peered":"2024-06-02T16:45:13.319666+0000","last_clean":"2024-06-02T16:45:13.319666+0000","last_became_active":"2024-06-02T16:45:11.279600+0000","last_became_peered":"2024-06-02T16:45:11.279600+0000","last_unstale":"2024-06-02T16:45:13.319666+0000","last_undegraded":"2024-06-02T16:45:13.319666+0000","last_fullsized":"2024-06-02T16:45:13.319666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:05:50.798003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402942+0000","last_change":"2024-06-02T16:45:12.311936+0000","last_active":"2024-06-02T16:45:14.402942+0000","last_peered":"2024-06-02T16:45:14.402942+0000","last_clean":"2024-06-02T16:45:14.402942+0000","last_became_active":"2024-06-02T16:45:12.311644+0000","last_became_peered":"2024-06-02T16:45:12.311644+0000","last_unstale":"2024-06-02T16:45:14.402942+0000","last_undegraded":"2024-06-02T16:45:14.402942+0000","last_fullsized":"2024-06-02T16:45:14.402942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:29.680123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325811+0000","last_change":"2024-06-02T16:45:11.273910+0000","last_active":"2024-06-02T16:45:13.325811+0000","last_peered":"2024-06-02T16:45:13.325811+0000","last_clean":"2024-06-02T16:45:13.325811+0000","last_became_active":"2024-06-02T16:45:11.269349+0000","last_became_peered":"2024-06-02T16:45:11.269349+0000","last_unstale":"2024-06-02T16:45:13.325811+0000","last_undegraded":"2024-06-02T16:45:13.325811+0000","last_fullsized":"2024-06-02T16:45:13.325811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996048+0000","last_change":"2024-06-02T16:45:12.309869+0000","last_active":"2024-06-02T16:45:13.996048+0000","last_peered":"2024-06-02T16:45:13.996048+0000","last_clean":"2024-06-02T16:45:13.996048+0000","last_became_active":"2024-06-02T16:45:12.309531+0000","last_became_peered":"2024-06-02T16:45:12.309531+0000","last_unstale":"2024-06-02T16:45:13.996048+0000","last_undegraded":"2024-06-02T16:45:13.996048+0000","last_fullsized":"2024-06-02T16:45:13.996048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399453+0000","last_change":"2024-06-02T16:45:11.281999+0000","last_active":"2024-06-02T16:45:14.399453+0000","last_peered":"2024-06-02T16:45:14.399453+0000","last_clean":"2024-06-02T16:45:14.399453+0000","last_became_active":"2024-06-02T16:45:11.281659+0000","last_became_peered":"2024-06-02T16:45:11.281659+0000","last_unstale":"2024-06-02T16:45:14.399453+0000","last_undegraded":"2024-06-02T16:45:14.399453+0000","last_fullsized":"2024-06-02T16:45:14.399453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:42:40.894276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399729+0000","last_change":"2024-06-02T16:45:12.300160+0000","last_active":"2024-06-02T16:45:14.399729+0000","last_peered":"2024-06-02T16:45:14.399729+0000","last_clean":"2024-06-02T16:45:14.399729+0000","last_became_active":"2024-06-02T16:45:12.299866+0000","last_became_peered":"2024-06-02T16:45:12.299866+0000","last_unstale":"2024-06-02T16:45:14.399729+0000","last_undegraded":"2024-06-02T16:45:14.399729+0000","last_fullsized":"2024-06-02T16:45:14.399729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402682+0000","last_change":"2024-06-02T16:45:11.275912+0000","last_active":"2024-06-02T16:45:14.402682+0000","last_peered":"2024-06-02T16:45:14.402682+0000","last_clean":"2024-06-02T16:45:14.402682+0000","last_became_active":"2024-06-02T16:45:11.274344+0000","last_became_peered":"2024-06-02T16:45:11.274344+0000","last_unstale":"2024-06-02T16:45:14.402682+0000","last_undegraded":"2024-06-02T16:45:14.402682+0000","last_fullsized":"2024-06-02T16:45:14.402682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996045+0000","last_change":"2024-06-02T16:45:12.305113+0000","last_active":"2024-06-02T16:45:13.996045+0000","last_peered":"2024-06-02T16:45:13.996045+0000","last_clean":"2024-06-02T16:45:13.996045+0000","last_became_active":"2024-06-02T16:45:12.303754+0000","last_became_peered":"2024-06-02T16:45:12.303754+0000","last_unstale":"2024-06-02T16:45:13.996045+0000","last_undegraded":"2024-06-02T16:45:13.996045+0000","last_fullsized":"2024-06-02T16:45:13.996045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325343+0000","last_change":"2024-06-02T16:45:11.282207+0000","last_active":"2024-06-02T16:45:13.325343+0000","last_peered":"2024-06-02T16:45:13.325343+0000","last_clean":"2024-06-02T16:45:13.325343+0000","last_became_active":"2024-06-02T16:45:11.281896+0000","last_became_peered":"2024-06-02T16:45:11.281896+0000","last_unstale":"2024-06-02T16:45:13.325343+0000","last_undegraded":"2024-06-02T16:45:13.325343+0000","last_fullsized":"2024-06-02T16:45:13.325343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325428+0000","last_change":"2024-06-02T16:45:12.296800+0000","last_active":"2024-06-02T16:45:13.325428+0000","last_peered":"2024-06-02T16:45:13.325428+0000","last_clean":"2024-06-02T16:45:13.325428+0000","last_became_active":"2024-06-02T16:45:12.296464+0000","last_became_peered":"2024-06-02T16:45:12.296464+0000","last_unstale":"2024-06-02T16:45:13.325428+0000","last_undegraded":"2024-06-02T16:45:13.325428+0000","last_fullsized":"2024-06-02T16:45:13.325428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296330+0000","last_change":"2024-06-02T16:45:11.266200+0000","last_active":"2024-06-02T16:45:13.296330+0000","last_peered":"2024-06-02T16:45:13.296330+0000","last_clean":"2024-06-02T16:45:13.296330+0000","last_became_active":"2024-06-02T16:45:11.265898+0000","last_became_peered":"2024-06-02T16:45:11.265898+0000","last_unstale":"2024-06-02T16:45:13.296330+0000","last_undegraded":"2024-06-02T16:45:13.296330+0000","last_fullsized":"2024-06-02T16:45:13.296330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:01:13.412602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995641+0000","last_change":"2024-06-02T16:45:12.306797+0000","last_active":"2024-06-02T16:45:13.995641+0000","last_peered":"2024-06-02T16:45:13.995641+0000","last_clean":"2024-06-02T16:45:13.995641+0000","last_became_active":"2024-06-02T16:45:12.306438+0000","last_became_peered":"2024-06-02T16:45:12.306438+0000","last_unstale":"2024-06-02T16:45:13.995641+0000","last_undegraded":"2024-06-02T16:45:13.995641+0000","last_fullsized":"2024-06-02T16:45:13.995641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:41:27.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402003+0000","last_change":"2024-06-02T16:45:11.281764+0000","last_active":"2024-06-02T16:45:14.402003+0000","last_peered":"2024-06-02T16:45:14.402003+0000","last_clean":"2024-06-02T16:45:14.402003+0000","last_became_active":"2024-06-02T16:45:11.281487+0000","last_became_peered":"2024-06-02T16:45:11.281487+0000","last_unstale":"2024-06-02T16:45:14.402003+0000","last_undegraded":"2024-06-02T16:45:14.402003+0000","last_fullsized":"2024-06-02T16:45:14.402003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:00.859465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996452+0000","last_change":"2024-06-02T16:45:12.303257+0000","last_active":"2024-06-02T16:45:13.996452+0000","last_peered":"2024-06-02T16:45:13.996452+0000","last_clean":"2024-06-02T16:45:13.996452+0000","last_became_active":"2024-06-02T16:45:12.302846+0000","last_became_peered":"2024-06-02T16:45:12.302846+0000","last_unstale":"2024-06-02T16:45:13.996452+0000","last_undegraded":"2024-06-02T16:45:13.996452+0000","last_fullsized":"2024-06-02T16:45:13.996452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:02.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297861+0000","last_change":"2024-06-02T16:45:11.265071+0000","last_active":"2024-06-02T16:45:13.297861+0000","last_peered":"2024-06-02T16:45:13.297861+0000","last_clean":"2024-06-02T16:45:13.297861+0000","last_became_active":"2024-06-02T16:45:11.264782+0000","last_became_peered":"2024-06-02T16:45:11.264782+0000","last_unstale":"2024-06-02T16:45:13.297861+0000","last_undegraded":"2024-06-02T16:45:13.297861+0000","last_fullsized":"2024-06-02T16:45:13.297861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996903+0000","last_change":"2024-06-02T16:45:12.308045+0000","last_active":"2024-06-02T16:45:13.996903+0000","last_peered":"2024-06-02T16:45:13.996903+0000","last_clean":"2024-06-02T16:45:13.996903+0000","last_became_active":"2024-06-02T16:45:12.307750+0000","last_became_peered":"2024-06-02T16:45:12.307750+0000","last_unstale":"2024-06-02T16:45:13.996903+0000","last_undegraded":"2024-06-02T16:45:13.996903+0000","last_fullsized":"2024-06-02T16:45:13.996903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:24.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319811+0000","last_change":"2024-06-02T16:45:11.279209+0000","last_active":"2024-06-02T16:45:13.319811+0000","last_peered":"2024-06-02T16:45:13.319811+0000","last_clean":"2024-06-02T16:45:13.319811+0000","last_became_active":"2024-06-02T16:45:11.278908+0000","last_became_peered":"2024-06-02T16:45:11.278908+0000","last_unstale":"2024-06-02T16:45:13.319811+0000","last_undegraded":"2024-06-02T16:45:13.319811+0000","last_fullsized":"2024-06-02T16:45:13.319811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:26:48.069333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403037+0000","last_change":"2024-06-02T16:45:12.309555+0000","last_active":"2024-06-02T16:45:14.403037+0000","last_peered":"2024-06-02T16:45:14.403037+0000","last_clean":"2024-06-02T16:45:14.403037+0000","last_became_active":"2024-06-02T16:45:12.309069+0000","last_became_peered":"2024-06-02T16:45:12.309069+0000","last_unstale":"2024-06-02T16:45:14.403037+0000","last_undegraded":"2024-06-02T16:45:14.403037+0000","last_fullsized":"2024-06-02T16:45:14.403037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:11.376257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297157+0000","last_change":"2024-06-02T16:45:11.275392+0000","last_active":"2024-06-02T16:45:13.297157+0000","last_peered":"2024-06-02T16:45:13.297157+0000","last_clean":"2024-06-02T16:45:13.297157+0000","last_became_active":"2024-06-02T16:45:11.274685+0000","last_became_peered":"2024-06-02T16:45:11.274685+0000","last_unstale":"2024-06-02T16:45:13.297157+0000","last_undegraded":"2024-06-02T16:45:13.297157+0000","last_fullsized":"2024-06-02T16:45:13.297157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:50:29.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996381+0000","last_change":"2024-06-02T16:45:12.317046+0000","last_active":"2024-06-02T16:45:13.996381+0000","last_peered":"2024-06-02T16:45:13.996381+0000","last_clean":"2024-06-02T16:45:13.996381+0000","last_became_active":"2024-06-02T16:45:12.316726+0000","last_became_peered":"2024-06-02T16:45:12.316726+0000","last_unstale":"2024-06-02T16:45:13.996381+0000","last_undegraded":"2024-06-02T16:45:13.996381+0000","last_fullsized":"2024-06-02T16:45:13.996381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995299+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:45:13.995299+0000","last_peered":"2024-06-02T16:45:13.995299+0000","last_clean":"2024-06-02T16:45:13.995299+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:45:13.995299+0000","last_undegraded":"2024-06-02T16:45:13.995299+0000","last_fullsized":"2024-06-02T16:45:13.995299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.401851+0000","last_change":"2024-06-02T16:45:11.275427+0000","last_active":"2024-06-02T16:45:14.401851+0000","last_peered":"2024-06-02T16:45:14.401851+0000","last_clean":"2024-06-02T16:45:14.401851+0000","last_became_active":"2024-06-02T16:45:11.275105+0000","last_became_peered":"2024-06-02T16:45:11.275105+0000","last_unstale":"2024-06-02T16:45:14.401851+0000","last_undegraded":"2024-06-02T16:45:14.401851+0000","last_fullsized":"2024-06-02T16:45:14.401851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297782+0000","last_change":"2024-06-02T16:45:12.315916+0000","last_active":"2024-06-02T16:45:13.297782+0000","last_peered":"2024-06-02T16:45:13.297782+0000","last_clean":"2024-06-02T16:45:13.297782+0000","last_became_active":"2024-06-02T16:45:12.315576+0000","last_became_peered":"2024-06-02T16:45:12.315576+0000","last_unstale":"2024-06-02T16:45:13.297782+0000","last_undegraded":"2024-06-02T16:45:13.297782+0000","last_fullsized":"2024-06-02T16:45:13.297782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:55.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995143+0000","last_change":"2024-06-02T16:45:11.284136+0000","last_active":"2024-06-02T16:45:13.995143+0000","last_peered":"2024-06-02T16:45:13.995143+0000","last_clean":"2024-06-02T16:45:13.995143+0000","last_became_active":"2024-06-02T16:45:11.283636+0000","last_became_peered":"2024-06-02T16:45:11.283636+0000","last_unstale":"2024-06-02T16:45:13.995143+0000","last_undegraded":"2024-06-02T16:45:13.995143+0000","last_fullsized":"2024-06-02T16:45:13.995143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:57.096574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399151+0000","last_change":"2024-06-02T16:45:12.297552+0000","last_active":"2024-06-02T16:45:14.399151+0000","last_peered":"2024-06-02T16:45:14.399151+0000","last_clean":"2024-06-02T16:45:14.399151+0000","last_became_active":"2024-06-02T16:45:12.297284+0000","last_became_peered":"2024-06-02T16:45:12.297284+0000","last_unstale":"2024-06-02T16:45:14.399151+0000","last_undegraded":"2024-06-02T16:45:14.399151+0000","last_fullsized":"2024-06-02T16:45:14.399151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:30:49.165413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296544+0000","last_change":"2024-06-02T16:45:11.263835+0000","last_active":"2024-06-02T16:45:13.296544+0000","last_peered":"2024-06-02T16:45:13.296544+0000","last_clean":"2024-06-02T16:45:13.296544+0000","last_became_active":"2024-06-02T16:45:11.261012+0000","last_became_peered":"2024-06-02T16:45:11.261012+0000","last_unstale":"2024-06-02T16:45:13.296544+0000","last_undegraded":"2024-06-02T16:45:13.296544+0000","last_fullsized":"2024-06-02T16:45:13.296544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319885+0000","last_change":"2024-06-02T16:45:12.293349+0000","last_active":"2024-06-02T16:45:13.319885+0000","last_peered":"2024-06-02T16:45:13.319885+0000","last_clean":"2024-06-02T16:45:13.319885+0000","last_became_active":"2024-06-02T16:45:12.292988+0000","last_became_peered":"2024-06-02T16:45:12.292988+0000","last_unstale":"2024-06-02T16:45:13.319885+0000","last_undegraded":"2024-06-02T16:45:13.319885+0000","last_fullsized":"2024-06-02T16:45:13.319885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:54:02.019911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402866+0000","last_change":"2024-06-02T16:45:11.275239+0000","last_active":"2024-06-02T16:45:14.402866+0000","last_peered":"2024-06-02T16:45:14.402866+0000","last_clean":"2024-06-02T16:45:14.402866+0000","last_became_active":"2024-06-02T16:45:11.274878+0000","last_became_peered":"2024-06-02T16:45:11.274878+0000","last_unstale":"2024-06-02T16:45:14.402866+0000","last_undegraded":"2024-06-02T16:45:14.402866+0000","last_fullsized":"2024-06-02T16:45:14.402866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402084+0000","last_change":"2024-06-02T16:45:12.299815+0000","last_active":"2024-06-02T16:45:14.402084+0000","last_peered":"2024-06-02T16:45:14.402084+0000","last_clean":"2024-06-02T16:45:14.402084+0000","last_became_active":"2024-06-02T16:45:12.299416+0000","last_became_peered":"2024-06-02T16:45:12.299416+0000","last_unstale":"2024-06-02T16:45:14.402084+0000","last_undegraded":"2024-06-02T16:45:14.402084+0000","last_fullsized":"2024-06-02T16:45:14.402084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:58.108458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319419+0000","last_change":"2024-06-02T16:45:11.272338+0000","last_active":"2024-06-02T16:45:13.319419+0000","last_peered":"2024-06-02T16:45:13.319419+0000","last_clean":"2024-06-02T16:45:13.319419+0000","last_became_active":"2024-06-02T16:45:11.271994+0000","last_became_peered":"2024-06-02T16:45:11.271994+0000","last_unstale":"2024-06-02T16:45:13.319419+0000","last_undegraded":"2024-06-02T16:45:13.319419+0000","last_fullsized":"2024-06-02T16:45:13.319419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:01.110485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403530+0000","last_change":"2024-06-02T16:45:12.314530+0000","last_active":"2024-06-02T16:45:14.403530+0000","last_peered":"2024-06-02T16:45:14.403530+0000","last_clean":"2024-06-02T16:45:14.403530+0000","last_became_active":"2024-06-02T16:45:12.309275+0000","last_became_peered":"2024-06-02T16:45:12.309275+0000","last_unstale":"2024-06-02T16:45:14.403530+0000","last_undegraded":"2024-06-02T16:45:14.403530+0000","last_fullsized":"2024-06-02T16:45:14.403530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:35.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996654+0000","last_change":"2024-06-02T16:45:11.286614+0000","last_active":"2024-06-02T16:45:13.996654+0000","last_peered":"2024-06-02T16:45:13.996654+0000","last_clean":"2024-06-02T16:45:13.996654+0000","last_became_active":"2024-06-02T16:45:11.286270+0000","last_became_peered":"2024-06-02T16:45:11.286270+0000","last_unstale":"2024-06-02T16:45:13.996654+0000","last_undegraded":"2024-06-02T16:45:13.996654+0000","last_fullsized":"2024-06-02T16:45:13.996654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:47:34.390364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319488+0000","last_change":"2024-06-02T16:45:12.297417+0000","last_active":"2024-06-02T16:45:13.319488+0000","last_peered":"2024-06-02T16:45:13.319488+0000","last_clean":"2024-06-02T16:45:13.319488+0000","last_became_active":"2024-06-02T16:45:12.295971+0000","last_became_peered":"2024-06-02T16:45:12.295971+0000","last_unstale":"2024-06-02T16:45:13.319488+0000","last_undegraded":"2024-06-02T16:45:13.319488+0000","last_fullsized":"2024-06-02T16:45:13.319488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:28:51.999303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.320296+0000","last_change":"2024-06-02T16:45:11.276872+0000","last_active":"2024-06-02T16:45:13.320296+0000","last_peered":"2024-06-02T16:45:13.320296+0000","last_clean":"2024-06-02T16:45:13.320296+0000","last_became_active":"2024-06-02T16:45:11.276659+0000","last_became_peered":"2024-06-02T16:45:11.276659+0000","last_unstale":"2024-06-02T16:45:13.320296+0000","last_undegraded":"2024-06-02T16:45:13.320296+0000","last_fullsized":"2024-06-02T16:45:13.320296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:35.798870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.299014+0000","last_change":"2024-06-02T16:45:12.309798+0000","last_active":"2024-06-02T16:45:13.299014+0000","last_peered":"2024-06-02T16:45:13.299014+0000","last_clean":"2024-06-02T16:45:13.299014+0000","last_became_active":"2024-06-02T16:45:12.309229+0000","last_became_peered":"2024-06-02T16:45:12.309229+0000","last_unstale":"2024-06-02T16:45:13.299014+0000","last_undegraded":"2024-06-02T16:45:13.299014+0000","last_fullsized":"2024-06-02T16:45:13.299014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325726+0000","last_change":"2024-06-02T16:45:11.284796+0000","last_active":"2024-06-02T16:45:13.325726+0000","last_peered":"2024-06-02T16:45:13.325726+0000","last_clean":"2024-06-02T16:45:13.325726+0000","last_became_active":"2024-06-02T16:45:11.284453+0000","last_became_peered":"2024-06-02T16:45:11.284453+0000","last_unstale":"2024-06-02T16:45:13.325726+0000","last_undegraded":"2024-06-02T16:45:13.325726+0000","last_fullsized":"2024-06-02T16:45:13.325726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399192+0000","last_change":"2024-06-02T16:45:12.295217+0000","last_active":"2024-06-02T16:45:14.399192+0000","last_peered":"2024-06-02T16:45:14.399192+0000","last_clean":"2024-06-02T16:45:14.399192+0000","last_became_active":"2024-06-02T16:45:12.294918+0000","last_became_peered":"2024-06-02T16:45:12.294918+0000","last_unstale":"2024-06-02T16:45:14.399192+0000","last_undegraded":"2024-06-02T16:45:14.399192+0000","last_fullsized":"2024-06-02T16:45:14.399192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:50.689496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995110+0000","last_change":"2024-06-02T16:45:11.283792+0000","last_active":"2024-06-02T16:45:13.995110+0000","last_peered":"2024-06-02T16:45:13.995110+0000","last_clean":"2024-06-02T16:45:13.995110+0000","last_became_active":"2024-06-02T16:45:11.283275+0000","last_became_peered":"2024-06-02T16:45:11.283275+0000","last_unstale":"2024-06-02T16:45:13.995110+0000","last_undegraded":"2024-06-02T16:45:13.995110+0000","last_fullsized":"2024-06-02T16:45:13.995110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:54:37.892243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402663+0000","last_change":"2024-06-02T16:45:12.297797+0000","last_active":"2024-06-02T16:45:14.402663+0000","last_peered":"2024-06-02T16:45:14.402663+0000","last_clean":"2024-06-02T16:45:14.402663+0000","last_became_active":"2024-06-02T16:45:12.297359+0000","last_became_peered":"2024-06-02T16:45:12.297359+0000","last_unstale":"2024-06-02T16:45:14.402663+0000","last_undegraded":"2024-06-02T16:45:14.402663+0000","last_fullsized":"2024-06-02T16:45:14.402663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:08.104692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319725+0000","last_change":"2024-06-02T16:45:11.278360+0000","last_active":"2024-06-02T16:45:13.319725+0000","last_peered":"2024-06-02T16:45:13.319725+0000","last_clean":"2024-06-02T16:45:13.319725+0000","last_became_active":"2024-06-02T16:45:11.277862+0000","last_became_peered":"2024-06-02T16:45:11.277862+0000","last_unstale":"2024-06-02T16:45:13.319725+0000","last_undegraded":"2024-06-02T16:45:13.319725+0000","last_fullsized":"2024-06-02T16:45:13.319725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:41:22.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.296880+0000","last_change":"2024-06-02T16:45:12.306004+0000","last_active":"2024-06-02T16:45:13.296880+0000","last_peered":"2024-06-02T16:45:13.296880+0000","last_clean":"2024-06-02T16:45:13.296880+0000","last_became_active":"2024-06-02T16:45:12.305698+0000","last_became_peered":"2024-06-02T16:45:12.305698+0000","last_unstale":"2024-06-02T16:45:13.296880+0000","last_undegraded":"2024-06-02T16:45:13.296880+0000","last_fullsized":"2024-06-02T16:45:13.296880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:30:32.831538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.319570+0000","last_change":"2024-06-02T16:45:11.270577+0000","last_active":"2024-06-02T16:45:13.319570+0000","last_peered":"2024-06-02T16:45:13.319570+0000","last_clean":"2024-06-02T16:45:13.319570+0000","last_became_active":"2024-06-02T16:45:11.270316+0000","last_became_peered":"2024-06-02T16:45:11.270316+0000","last_unstale":"2024-06-02T16:45:13.319570+0000","last_undegraded":"2024-06-02T16:45:13.319570+0000","last_fullsized":"2024-06-02T16:45:13.319570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:49.398066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.297767+0000","last_change":"2024-06-02T16:45:12.306883+0000","last_active":"2024-06-02T16:45:13.297767+0000","last_peered":"2024-06-02T16:45:13.297767+0000","last_clean":"2024-06-02T16:45:13.297767+0000","last_became_active":"2024-06-02T16:45:12.306582+0000","last_became_peered":"2024-06-02T16:45:12.306582+0000","last_unstale":"2024-06-02T16:45:13.297767+0000","last_undegraded":"2024-06-02T16:45:13.297767+0000","last_fullsized":"2024-06-02T16:45:13.297767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:40.290169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996343+0000","last_change":"2024-06-02T16:45:11.288038+0000","last_active":"2024-06-02T16:45:13.996343+0000","last_peered":"2024-06-02T16:45:13.996343+0000","last_clean":"2024-06-02T16:45:13.996343+0000","last_became_active":"2024-06-02T16:45:11.287757+0000","last_became_peered":"2024-06-02T16:45:11.287757+0000","last_unstale":"2024-06-02T16:45:13.996343+0000","last_undegraded":"2024-06-02T16:45:13.996343+0000","last_fullsized":"2024-06-02T16:45:13.996343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:26:42.479138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.325212+0000","last_change":"2024-06-02T16:45:12.298140+0000","last_active":"2024-06-02T16:45:13.325212+0000","last_peered":"2024-06-02T16:45:13.325212+0000","last_clean":"2024-06-02T16:45:13.325212+0000","last_became_active":"2024-06-02T16:45:12.297832+0000","last_became_peered":"2024-06-02T16:45:12.297832+0000","last_unstale":"2024-06-02T16:45:13.325212+0000","last_undegraded":"2024-06-02T16:45:13.325212+0000","last_fullsized":"2024-06-02T16:45:13.325212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:30:20.709404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.403511+0000","last_change":"2024-06-02T16:45:12.302894+0000","last_active":"2024-06-02T16:45:14.403511+0000","last_peered":"2024-06-02T16:45:14.403511+0000","last_clean":"2024-06-02T16:45:14.403511+0000","last_became_active":"2024-06-02T16:45:12.302609+0000","last_became_peered":"2024-06-02T16:45:12.302609+0000","last_unstale":"2024-06-02T16:45:14.403511+0000","last_undegraded":"2024-06-02T16:45:14.403511+0000","last_fullsized":"2024-06-02T16:45:14.403511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:50.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.995933+0000","last_change":"2024-06-02T16:45:11.286611+0000","last_active":"2024-06-02T16:45:13.995933+0000","last_peered":"2024-06-02T16:45:13.995933+0000","last_clean":"2024-06-02T16:45:13.995933+0000","last_became_active":"2024-06-02T16:45:11.286294+0000","last_became_peered":"2024-06-02T16:45:11.286294+0000","last_unstale":"2024-06-02T16:45:13.995933+0000","last_undegraded":"2024-06-02T16:45:13.995933+0000","last_fullsized":"2024-06-02T16:45:13.995933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:07.092809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.402591+0000","last_change":"2024-06-02T16:45:12.302182+0000","last_active":"2024-06-02T16:45:14.402591+0000","last_peered":"2024-06-02T16:45:14.402591+0000","last_clean":"2024-06-02T16:45:14.402591+0000","last_became_active":"2024-06-02T16:45:12.301903+0000","last_became_peered":"2024-06-02T16:45:12.301903+0000","last_unstale":"2024-06-02T16:45:14.402591+0000","last_undegraded":"2024-06-02T16:45:14.402591+0000","last_fullsized":"2024-06-02T16:45:14.402591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:42.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.996321+0000","last_change":"2024-06-02T16:45:11.286446+0000","last_active":"2024-06-02T16:45:13.996321+0000","last_peered":"2024-06-02T16:45:13.996321+0000","last_clean":"2024-06-02T16:45:13.996321+0000","last_became_active":"2024-06-02T16:45:11.286095+0000","last_became_peered":"2024-06-02T16:45:11.286095+0000","last_unstale":"2024-06-02T16:45:13.996321+0000","last_undegraded":"2024-06-02T16:45:13.996321+0000","last_fullsized":"2024-06-02T16:45:13.996321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:28.668240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399348+0000","last_change":"2024-06-02T16:45:12.309888+0000","last_active":"2024-06-02T16:45:14.399348+0000","last_peered":"2024-06-02T16:45:14.399348+0000","last_clean":"2024-06-02T16:45:14.399348+0000","last_became_active":"2024-06-02T16:45:12.309638+0000","last_became_peered":"2024-06-02T16:45:12.309638+0000","last_unstale":"2024-06-02T16:45:14.399348+0000","last_undegraded":"2024-06-02T16:45:14.399348+0000","last_fullsized":"2024-06-02T16:45:14.399348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.089986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298853+0000","last_change":"2024-06-02T16:45:11.271444+0000","last_active":"2024-06-02T16:45:13.298853+0000","last_peered":"2024-06-02T16:45:13.298853+0000","last_clean":"2024-06-02T16:45:13.298853+0000","last_became_active":"2024-06-02T16:45:11.271168+0000","last_became_peered":"2024-06-02T16:45:11.271168+0000","last_unstale":"2024-06-02T16:45:13.298853+0000","last_undegraded":"2024-06-02T16:45:13.298853+0000","last_fullsized":"2024-06-02T16:45:13.298853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:40.375189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:13.298807+0000","last_change":"2024-06-02T16:45:12.303300+0000","last_active":"2024-06-02T16:45:13.298807+0000","last_peered":"2024-06-02T16:45:13.298807+0000","last_clean":"2024-06-02T16:45:13.298807+0000","last_became_active":"2024-06-02T16:45:12.303009+0000","last_became_peered":"2024-06-02T16:45:12.303009+0000","last_unstale":"2024-06-02T16:45:13.298807+0000","last_undegraded":"2024-06-02T16:45:13.298807+0000","last_fullsized":"2024-06-02T16:45:13.298807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:11.229701+0000","last_clean_scrub_stamp":"2024-06-02T16:45:11.229701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:40:19.238041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-06-02T16:45:14.399543+0000","last_change":"2024-06-02T16:45:11.285228+0000","last_active":"2024-06-02T16:45:14.399543+0000","last_peered":"2024-06-02T16:45:14.399543+0000","last_clean":"2024-06-02T16:45:14.399543+0000","last_became_active":"2024-06-02T16:45:11.284770+0000","last_became_peered":"2024-06-02T16:45:11.284770+0000","last_unstale":"2024-06-02T16:45:14.399543+0000","last_undegraded":"2024-06-02T16:45:14.399543+0000","last_fullsized":"2024-06-02T16:45:14.399543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:10.217818+0000","last_clean_scrub_stamp":"2024-06-02T16:45:10.217818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:31.263104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":670785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":79835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:45:22.993 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T16:45:22.993 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T16:45:22.993 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-02T16:45:22.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-02T16:45:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.243+0000 7f582be00640 1 Processor -- start 2024-06-02T16:45:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.244+0000 7f582be00640 1 -- start start 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.245+0000 7f582be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f582c06e840 0x7f582c162e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.245+0000 7f582be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582c15fa10 con 0x7f582c15cce0 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.245+0000 7f582be00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582c163ab0 con 0x7f582c1604d0 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.245+0000 7f582be00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f582c15fcd0 con 0x7f582c06e840 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f582c06e840 0x7f582c162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f582c06e840 0x7f582c162e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50624/0 (socket says 172.21.15.52:50624) 2024-06-02T16:45:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 -- 172.21.15.52:0/1199793237 learned_addr learned my addr 172.21.15.52:0/1199793237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 -- 172.21.15.52:0/1199793237 >> v1:172.21.15.114:6789/0 conn(0x7f582c1604d0 legacy=0x7f582c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 -- 172.21.15.52:0/1199793237 >> v1:172.21.15.52:6789/0 conn(0x7f582c15cce0 legacy=0x7f582c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.246+0000 7f5823e00640 1 -- 172.21.15.52:0/1199793237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c15ffb0 con 0x7f582c06e840 2024-06-02T16:45:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.247+0000 7f5823e00640 1 --2- 172.21.15.52:0/1199793237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c06e840 0x7f582c162e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5814009870 tx=0x7f581402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adce3afdc5cf853f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.247+0000 7f582a000640 1 -- 172.21.15.52:0/1199793237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814037070 con 0x7f582c06e840 2024-06-02T16:45:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582a000640 1 -- 172.21.15.52:0/1199793237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5814032440 con 0x7f582c06e840 2024-06-02T16:45:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582a000640 1 -- 172.21.15.52:0/1199793237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814032810 con 0x7f582c06e840 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582be00640 1 -- 172.21.15.52:0/1199793237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c06e840 msgr2=0x7f582c162e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582be00640 1 --2- 172.21.15.52:0/1199793237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c06e840 0x7f582c162e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5814009870 tx=0x7f581402a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582be00640 1 -- 172.21.15.52:0/1199793237 shutdown_connections 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582be00640 1 --2- 172.21.15.52:0/1199793237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c06e840 0x7f582c162e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.248+0000 7f582be00640 1 -- 172.21.15.52:0/1199793237 >> 172.21.15.52:0/1199793237 conn(0x7f582c06c380 msgr2=0x7f582c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.249+0000 7f582be00640 1 -- 172.21.15.52:0/1199793237 shutdown_connections 2024-06-02T16:45:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.249+0000 7f582be00640 1 -- 172.21.15.52:0/1199793237 wait complete. 2024-06-02T16:45:23.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.250+0000 7f582be00640 1 Processor -- start 2024-06-02T16:45:23.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.250+0000 7f582be00640 1 -- start start 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f582c06e840 0x7f582c1e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f582c1604d0 0x7f582c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1634d0 con 0x7f582c15cce0 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f582c163350 con 0x7f582c1604d0 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.251+0000 7f582be00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f582c163650 con 0x7f582c06e840 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50640/0 (socket says 172.21.15.52:50640) 2024-06-02T16:45:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 -- 172.21.15.52:0/1883718824 learned_addr learned my addr 172.21.15.52:0/1883718824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f582b400640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f582c1604d0 0x7f582c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f582aa00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f582c06e840 0x7f582c1e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 -- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f582c06e840 msgr2=0x7f582c1e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f582c06e840 0x7f582c1e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 -- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f582c1604d0 msgr2=0x7f582c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f582c1604d0 0x7f582c15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.252+0000 7f5823e00640 1 -- 172.21.15.52:0/1883718824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c1e9b80 con 0x7f582c15cce0 2024-06-02T16:45:23.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f5823e00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f58140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814041070 con 0x7f582c15cce0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581403c870 con 0x7f582c15cce0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814037040 con 0x7f582c15cce0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582c0ceba0 con 0x7f582c15cce0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.253+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582c0cf530 con 0x7f582c15cce0 2024-06-02T16:45:23.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.254+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582c075ea0 con 0x7f582c15cce0 2024-06-02T16:45:23.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.255+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5814044070 con 0x7f582c15cce0 2024-06-02T16:45:23.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.256+0000 7f5822a00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 0x7f5808078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.256+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f58140b81a0 con 0x7f582c15cce0 2024-06-02T16:45:23.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.257+0000 7f582aa00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 0x7f5808078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.258+0000 7f582aa00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 0x7f5808078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ce600 tx=0x7f581c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.261+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5814081a60 con 0x7f582c15cce0 2024-06-02T16:45:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.514+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f582c0af840 con 0x7f582c15cce0 2024-06-02T16:45:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.515+0000 7f5822a00640 1 -- 172.21.15.52:0/1883718824 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5814081360 con 0x7f582c15cce0 2024-06-02T16:45:23.514 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:23.515 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 msgr2=0x7f5808078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 0x7f5808078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ce600 tx=0x7f581c009040 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 msgr2=0x7f582c145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f58140046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 shutdown_connections 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f58080762d0 0x7f5808078790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f582c1604d0 0x7f582c15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c15cce0 0x7f582c145d60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 --2- 172.21.15.52:0/1883718824 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f582c06e840 0x7f582c1e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 >> 172.21.15.52:0/1883718824 conn(0x7f582c06c380 msgr2=0x7f582c15d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 shutdown_connections 2024-06-02T16:45:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.518+0000 7f582be00640 1 -- 172.21.15.52:0/1883718824 wait complete. 2024-06-02T16:45:23.535 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-02T16:45:23.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.741+0000 7fd553a00640 1 Processor -- start 2024-06-02T16:45:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.741+0000 7fd553a00640 1 -- start start 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.742+0000 7fd553a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd54c06de20 0x7fd54c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.742+0000 7fd553a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd54c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.742+0000 7fd553a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c15fc90 con 0x7fd54c15f8b0 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.742+0000 7fd553a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c06e7f0 con 0x7fd54c06de20 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.742+0000 7fd553a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c09c460 con 0x7fd54c0ce470 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd551000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd54c15f8b0 0x7fd54c09b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57216/0 (socket says 172.21.15.52:57216) 2024-06-02T16:45:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd551000640 1 -- 172.21.15.52:0/1794470151 learned_addr learned my addr 172.21.15.52:0/1794470151 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454799138 0 0) 0x7fd54c15fc90 con 0x7fd54c15f8b0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd530003520 con 0x7fd54c15f8b0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd551a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd54c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54be00640 1 --2- 172.21.15.52:0/1794470151 >> v2:172.21.15.114:3300/0 conn(0x7fd54c06de20 0x7fd54c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217596997 0 0) 0x7fd530003520 con 0x7fd54c15f8b0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 msgr2=0x7fd54c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd54c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 >> v2:172.21.15.114:3300/0 conn(0x7fd54c06de20 msgr2=0x7fd54c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 --2- 172.21.15.52:0/1794470151 >> v2:172.21.15.114:3300/0 conn(0x7fd54c06de20 0x7fd54c06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0cd990 con 0x7fd54c15f8b0 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54be00640 1 --2- 172.21.15.52:0/1794470151 >> v2:172.21.15.114:3300/0 conn(0x7fd54c06de20 0x7fd54c06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.743+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fd53c001a70 con 0x7fd54c15f8b0 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 >> v1:172.21.15.52:6789/0 conn(0x7fd54c15f8b0 legacy=0x7fd54c09b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd530003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530004020 0x7fd530004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd530004d40 0x7fd5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c06e7f0 con 0x7fd530004d40 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c09c460 con 0x7fd530004020 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd53000bb20 con 0x7fd54c0ce470 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd530004d40 0x7fd5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd54be00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530004020 0x7fd530004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551000640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd530003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 -- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 msgr2=0x7fd530003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd54c0ce470 0x7fd530003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 -- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530004020 msgr2=0x7fd530004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530004020 0x7fd530004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.744+0000 7fd551a00640 1 -- 172.21.15.52:0/1794470151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd530003520 con 0x7fd530004d40 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.745+0000 7fd551a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd530004d40 0x7fd5300051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd544009ac0 tx=0x7fd530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8779d0d27f15718 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544036070 con 0x7fd530004d40 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544031400 con 0x7fd530004d40 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd54b400640 1 -- 172.21.15.52:0/1794470151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544009690 con 0x7fd530004d40 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd553a00640 1 -- 172.21.15.52:0/1794470151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd530004d40 msgr2=0x7fd5300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd553a00640 1 --2- 172.21.15.52:0/1794470151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd530004d40 0x7fd5300051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd544009ac0 tx=0x7fd530005830 comp rx=0 tx=0).stop 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd551a00640 1 -- 172.21.15.52:0/1794470151 reap_dead start 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd553a00640 1 -- 172.21.15.52:0/1794470151 shutdown_connections 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.746+0000 7fd553a00640 1 -- 172.21.15.52:0/1794470151 >> 172.21.15.52:0/1794470151 conn(0x7fd54c0b4cb0 msgr2=0x7fd54c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.747+0000 7fd553a00640 1 -- 172.21.15.52:0/1794470151 shutdown_connections 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.747+0000 7fd553a00640 1 -- 172.21.15.52:0/1794470151 wait complete. 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.748+0000 7fd553a00640 1 Processor -- start 2024-06-02T16:45:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 -- start start 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 0x7fd54c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 0x7fd54c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b5a40 con 0x7fd54c0d2590 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0cdf50 con 0x7fd54c0d2a10 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.749+0000 7fd553a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c09c0d0 con 0x7fd530004d40 2024-06-02T16:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50658/0 (socket says 172.21.15.52:50658) 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 -- 172.21.15.52:0/1935599340 learned_addr learned my addr 172.21.15.52:0/1935599340 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd551a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 0x7fd54c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 -- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 msgr2=0x7fd54c153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd551000640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 0x7fd54c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 0x7fd54c153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 -- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 msgr2=0x7fd54c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 0x7fd54c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd54be00640 1 -- 172.21.15.52:0/1935599340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0d14f0 con 0x7fd54c0d2590 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd551000640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 0x7fd54c153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.750+0000 7fd551a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 0x7fd54c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd54be00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd534010860 tx=0x7fd534010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53401a070 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53400cb40 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53400f040 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c0d17d0 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.751+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c0d1d90 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.752+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c069520 con 0x7fd54c0d2590 2024-06-02T16:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.753+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd534015470 con 0x7fd54c0d2590 2024-06-02T16:45:23.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.754+0000 7fd548c00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 0x7fd528078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:23.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.754+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd534097c50 con 0x7fd54c0d2590 2024-06-02T16:45:23.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.755+0000 7fd551000640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 0x7fd528078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.756+0000 7fd551000640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 0x7fd528078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd53c001be0 tx=0x7fd53c0012d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:23.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:23.759+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5340615a0 con 0x7fd54c0d2590 2024-06-02T16:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.010+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd54c1542c0 con 0x7fd54c0d2590 2024-06-02T16:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.011+0000 7fd548c00640 1 -- 172.21.15.52:0/1935599340 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fd534060ea0 con 0x7fd54c0d2590 2024-06-02T16:45:24.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:24.010 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:24.011 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.013+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 msgr2=0x7fd528078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.013+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 0x7fd528078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd53c001be0 tx=0x7fd53c0012d0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.013+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 msgr2=0x7fd54c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.013+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd534010860 tx=0x7fd534010d20 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 shutdown_connections 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5280762d0 0x7fd528078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c0d2a10 0x7fd54c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd54c0d2590 0x7fd54c15a320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 --2- 172.21.15.52:0/1935599340 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd530004d40 0x7fd54c153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 >> 172.21.15.52:0/1935599340 conn(0x7fd54c0b4cb0 msgr2=0x7fd54c0707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 shutdown_connections 2024-06-02T16:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.014+0000 7fd553a00640 1 -- 172.21.15.52:0/1935599340 wait complete. 2024-06-02T16:45:24.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:24.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.239+0000 7f7a66400640 1 Processor -- start 2024-06-02T16:45:24.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.239+0000 7f7a66400640 1 -- start start 2024-06-02T16:45:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a66400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a66400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a601416c0 con 0x7f7a60160350 2024-06-02T16:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a66400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a60160970 con 0x7f7a6013f140 2024-06-02T16:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a66400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7a60141960 con 0x7f7a6013ed60 2024-06-02T16:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a65a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7a60160350 0x7f7a600cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57232/0 (socket says 172.21.15.52:57232) 2024-06-02T16:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a65a00640 1 -- 172.21.15.52:0/956035420 learned_addr learned my addr 172.21.15.52:0/956035420 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.241+0000 7f7a65000640 1 --2- 172.21.15.52:0/956035420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377069434 0 0) 0x7f7a601416c0 con 0x7f7a60160350 2024-06-02T16:45:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a48003520 con 0x7f7a60160350 2024-06-02T16:45:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a65000640 1 -- 172.21.15.52:0/956035420 >> v1:172.21.15.114:6789/0 conn(0x7f7a6013f140 legacy=0x7f7a6015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3939485814 0 0) 0x7f7a48003520 con 0x7f7a60160350 2024-06-02T16:45:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a65000640 1 -- 172.21.15.52:0/956035420 >> v1:172.21.15.52:6789/0 conn(0x7f7a60160350 legacy=0x7f7a600cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.242+0000 7f7a65000640 1 -- 172.21.15.52:0/956035420 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a60141c40 con 0x7f7a6013ed60 2024-06-02T16:45:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.243+0000 7f7a65000640 1 --2- 172.21.15.52:0/956035420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6006e130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a540097d0 tx=0x7f7a5402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d73a464508eab11 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.244+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54037070 con 0x7f7a6013ed60 2024-06-02T16:45:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.244+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5402ab90 con 0x7f7a6013ed60 2024-06-02T16:45:24.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.244+0000 7f7a5f400640 1 -- 172.21.15.52:0/956035420 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58001a70 con 0x7f7a6013ed60 2024-06-02T16:45:24.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 -- 172.21.15.52:0/956035420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 msgr2=0x7f7a6006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 --2- 172.21.15.52:0/956035420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6006e130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a540097d0 tx=0x7f7a5402a100 comp rx=0 tx=0).stop 2024-06-02T16:45:24.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 -- 172.21.15.52:0/956035420 shutdown_connections 2024-06-02T16:45:24.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 --2- 172.21.15.52:0/956035420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6006e130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 -- 172.21.15.52:0/956035420 >> 172.21.15.52:0/956035420 conn(0x7f7a6006c380 msgr2=0x7f7a6006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:24.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 -- 172.21.15.52:0/956035420 shutdown_connections 2024-06-02T16:45:24.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.245+0000 7f7a66400640 1 -- 172.21.15.52:0/956035420 wait complete. 2024-06-02T16:45:24.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.247+0000 7f7a66400640 1 Processor -- start 2024-06-02T16:45:24.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.247+0000 7f7a66400640 1 -- start start 2024-06-02T16:45:24.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6013b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 0x7f7a600733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a601425c0 con 0x7f7a6013de90 2024-06-02T16:45:24.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60142440 con 0x7f7a60160350 2024-06-02T16:45:24.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a66400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6006e670 con 0x7f7a6013ed60 2024-06-02T16:45:24.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a65a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a65a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50662/0 (socket says 172.21.15.52:50662) 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.249+0000 7f7a65a00640 1 -- 172.21.15.52:0/2153734319 learned_addr learned my addr 172.21.15.52:0/2153734319 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65000640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6013b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a5fe00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 0x7f7a600733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 -- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 msgr2=0x7f7a6013b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6013b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 -- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 msgr2=0x7f7a600733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 0x7f7a600733a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 -- 172.21.15.52:0/2153734319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6013f830 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a5fe00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 0x7f7a600733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a65a00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800cbb0 tx=0x7f7a5800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.250+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5800ace0 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.251+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6013fb10 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.251+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58012400 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.251+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580127f0 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.251+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a601400d0 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.252+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a60075ea0 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.254+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a58012990 con 0x7f7a6013de90 2024-06-02T16:45:24.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.255+0000 7f7a5cc00640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 0x7f7a40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.255+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7a58097d10 con 0x7f7a6013de90 2024-06-02T16:45:24.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.255+0000 7f7a65000640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 0x7f7a40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.256+0000 7f7a65000640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 0x7f7a40078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a54034000 tx=0x7f7a5402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.259+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a5809d020 con 0x7f7a6013de90 2024-06-02T16:45:24.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.512+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a601402d0 con 0x7f7a6013de90 2024-06-02T16:45:24.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.513+0000 7f7a5cc00640 1 -- 172.21.15.52:0/2153734319 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f7a601402d0 con 0x7f7a6013de90 2024-06-02T16:45:24.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:24.513 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 msgr2=0x7f7a40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 0x7f7a40078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a54034000 tx=0x7f7a5402e000 comp rx=0 tx=0).stop 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 msgr2=0x7f7a600738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800cbb0 tx=0x7f7a5800a430 comp rx=0 tx=0).stop 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 shutdown_connections 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7a400762d0 0x7f7a40078790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a6013de90 0x7f7a600738e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a60160350 0x7f7a600733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 --2- 172.21.15.52:0/2153734319 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a6013ed60 0x7f7a6013b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 >> 172.21.15.52:0/2153734319 conn(0x7f7a6006c380 msgr2=0x7f7a600b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 shutdown_connections 2024-06-02T16:45:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.516+0000 7f7a66400640 1 -- 172.21.15.52:0/2153734319 wait complete. 2024-06-02T16:45:24.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:24.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.737+0000 7fd5f6c00640 1 Processor -- start 2024-06-02T16:45:24.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.737+0000 7fd5f6c00640 1 -- start start 2024-06-02T16:45:24.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.739+0000 7fd5f6c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5f006e5b0 0x7fd5f0072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.739+0000 7fd5f6c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f006ea40 con 0x7fd5f006e130 2024-06-02T16:45:24.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.739+0000 7fd5f6c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f0160c80 con 0x7fd5f01577f0 2024-06-02T16:45:24.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.739+0000 7fd5f6c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f0160f60 con 0x7fd5f006e5b0 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5f4e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd5f006e130 0x7fd5f0072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57244/0 (socket says 172.21.15.52:57244) 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5f4e00640 1 -- 172.21.15.52:0/3230489463 learned_addr learned my addr 172.21.15.52:0/3230489463 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5f6200640 1 --2- 172.21.15.52:0/3230489463 >> v2:172.21.15.114:3300/0 conn(0x7fd5f006e5b0 0x7fd5f0072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549415710 0 0) 0x7fd5f006ea40 con 0x7fd5f006e130 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d8003520 con 0x7fd5f006e130 2024-06-02T16:45:24.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.740+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178330892 0 0) 0x7fd5d8003520 con 0x7fd5f006e130 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 >> v2:172.21.15.114:3300/0 conn(0x7fd5f006e5b0 msgr2=0x7fd5f0072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 --2- 172.21.15.52:0/3230489463 >> v2:172.21.15.114:3300/0 conn(0x7fd5f006e5b0 0x7fd5f0072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 >> v1:172.21.15.114:6789/0 conn(0x7fd5f01577f0 legacy=0x7fd5f0073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f0161240 con 0x7fd5f006e130 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fd5dc0016f0 con 0x7fd5f006e130 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 >> v1:172.21.15.52:6789/0 conn(0x7fd5f006e130 legacy=0x7fd5f0072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d8003a50 0x7fd5d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 0x7fd5d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0160f60 con 0x7fd5d80051c0 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d800c160 con 0x7fd5d8003a50 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d800c360 con 0x7fd5d8004800 2024-06-02T16:45:24.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f6200640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 0x7fd5d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f5800640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d8003a50 0x7fd5d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f4e00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f6200640 1 -- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5d8004800 msgr2=0x7fd5d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f6200640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f6200640 1 -- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d8003a50 msgr2=0x7fd5d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.741+0000 7fd5f6200640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d8003a50 0x7fd5d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.742+0000 7fd5f6200640 1 -- 172.21.15.52:0/3230489463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d8003520 con 0x7fd5d80051c0 2024-06-02T16:45:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.742+0000 7fd5f6200640 1 -- 172.21.15.52:0/3230489463 reap_dead start 2024-06-02T16:45:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6200640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 0x7fd5d800b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fc0 tx=0x7fd5d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1970d20096135164 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8035020 con 0x7fd5d80051c0 2024-06-02T16:45:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8003bd0 con 0x7fd5d80051c0 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5efe00640 1 -- 172.21.15.52:0/3230489463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8009c10 con 0x7fd5d80051c0 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6c00640 1 -- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 msgr2=0x7fd5d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 0x7fd5d800b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009fc0 tx=0x7fd5d8005830 comp rx=0 tx=0).stop 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6c00640 1 -- 172.21.15.52:0/3230489463 shutdown_connections 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/3230489463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d80051c0 0x7fd5d800b9c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.743+0000 7fd5f6c00640 1 -- 172.21.15.52:0/3230489463 >> 172.21.15.52:0/3230489463 conn(0x7fd5f006c380 msgr2=0x7fd5f006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.744+0000 7fd5f6c00640 1 -- 172.21.15.52:0/3230489463 shutdown_connections 2024-06-02T16:45:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.744+0000 7fd5f6c00640 1 -- 172.21.15.52:0/3230489463 wait complete. 2024-06-02T16:45:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.745+0000 7fd5f6c00640 1 Processor -- start 2024-06-02T16:45:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.745+0000 7fd5f6c00640 1 -- start start 2024-06-02T16:45:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d80051c0 0x7fd5f0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5f01f3260 0x7fd5f01f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0161a40 con 0x7fd5f0153c40 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f015e510 con 0x7fd5d80051c0 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.746+0000 7fd5f6c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f0074580 con 0x7fd5f01f3260 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50680/0 (socket says 172.21.15.52:50680) 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 -- 172.21.15.52:0/2729363472 learned_addr learned my addr 172.21.15.52:0/2729363472 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f5800640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d80051c0 0x7fd5f0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f6200640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5f01f3260 0x7fd5f01f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 -- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5f01f3260 msgr2=0x7fd5f01f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5f01f3260 0x7fd5f01f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 -- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d80051c0 msgr2=0x7fd5f0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d80051c0 0x7fd5f0155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 -- 172.21.15.52:0/2729363472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f01e79c0 con 0x7fd5f0153c40 2024-06-02T16:45:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.747+0000 7fd5f4e00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e6c0 tx=0x7fd5dc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.748+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00c6c0 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.748+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc018070 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.748+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00ca80 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.748+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f0156380 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.748+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f0156940 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.749+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f0075ea0 con 0x7fd5f0153c40 2024-06-02T16:45:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.750+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5dc00cc20 con 0x7fd5f0153c40 2024-06-02T16:45:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.751+0000 7fd5ed600640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 0x7fd5d00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.751+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc097350 con 0x7fd5f0153c40 2024-06-02T16:45:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.752+0000 7fd5f5800640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 0x7fd5d00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.753+0000 7fd5f5800640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 0x7fd5d00787c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.755+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5dc060cb0 con 0x7fd5f0153c40 2024-06-02T16:45:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.956+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5f006ea40 con 0x7fd5f0153c40 2024-06-02T16:45:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.959+0000 7fd5ed600640 1 -- 172.21.15.52:0/2729363472 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7fd5dc0605b0 con 0x7fd5f0153c40 2024-06-02T16:45:24.959 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:24.959 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 msgr2=0x7fd5d00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 0x7fd5d00787c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2024-06-02T16:45:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 msgr2=0x7fd5f01540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e6c0 tx=0x7fd5dc00eb80 comp rx=0 tx=0).stop 2024-06-02T16:45:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 shutdown_connections 2024-06-02T16:45:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5d0076300 0x7fd5d00787c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5f01f3260 0x7fd5f01f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0153c40 0x7fd5f01540c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 --2- 172.21.15.52:0/2729363472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5d80051c0 0x7fd5f0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.961+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 >> 172.21.15.52:0/2729363472 conn(0x7fd5f006c380 msgr2=0x7fd5f015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.962+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 shutdown_connections 2024-06-02T16:45:24.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:24.962+0000 7fd5f6c00640 1 -- 172.21.15.52:0/2729363472 wait complete. 2024-06-02T16:45:24.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.180+0000 7f2c66800640 1 Processor -- start 2024-06-02T16:45:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.180+0000 7f2c66800640 1 -- start start 2024-06-02T16:45:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.181+0000 7f2c66800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c6006e130 0x7f2c6006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.181+0000 7f2c66800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c600727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.181+0000 7f2c66800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c60160c80 con 0x7f2c601577f0 2024-06-02T16:45:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.181+0000 7f2c66800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2c60160f60 con 0x7f2c6006e130 2024-06-02T16:45:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.181+0000 7f2c66800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2c60161240 con 0x7f2c60072340 2024-06-02T16:45:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c6006e130 0x7f2c6006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c6006e130 0x7f2c6006e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50690/0 (socket says 172.21.15.52:50690) 2024-06-02T16:45:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 -- 172.21.15.52:0/1879565198 learned_addr learned my addr 172.21.15.52:0/1879565198 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c65e00640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c600727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 -- 172.21.15.52:0/1879565198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 msgr2=0x7f2c600727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c600727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 -- 172.21.15.52:0/1879565198 >> v1:172.21.15.114:6789/0 conn(0x7f2c601577f0 legacy=0x7f2c60073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.182+0000 7f2c64a00640 1 -- 172.21.15.52:0/1879565198 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c60161520 con 0x7f2c6006e130 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.183+0000 7f2c64a00640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6006e130 0x7f2c6006e5b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009870 tx=0x7f2c4c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7485bd299e76aa43 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c5fe00640 1 -- 172.21.15.52:0/1879565198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c037070 con 0x7f2c6006e130 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c5fe00640 1 -- 172.21.15.52:0/1879565198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c032440 con 0x7f2c6006e130 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c5fe00640 1 -- 172.21.15.52:0/1879565198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c032810 con 0x7f2c6006e130 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 -- 172.21.15.52:0/1879565198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6006e130 msgr2=0x7f2c6006e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6006e130 0x7f2c6006e5b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009870 tx=0x7f2c4c02a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 -- 172.21.15.52:0/1879565198 shutdown_connections 2024-06-02T16:45:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c600727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 --2- 172.21.15.52:0/1879565198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c6006e130 0x7f2c6006e5b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 -- 172.21.15.52:0/1879565198 >> 172.21.15.52:0/1879565198 conn(0x7f2c6006c380 msgr2=0x7f2c6006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 -- 172.21.15.52:0/1879565198 shutdown_connections 2024-06-02T16:45:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.184+0000 7f2c66800640 1 -- 172.21.15.52:0/1879565198 wait complete. 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.186+0000 7f2c66800640 1 Processor -- start 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.186+0000 7f2c66800640 1 -- start start 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c6006e130 0x7f2c60140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c60143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60074580 con 0x7f2c601577f0 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60161a40 con 0x7f2c6006e130 2024-06-02T16:45:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c66800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2c60074180 con 0x7f2c60072340 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c65e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c65e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50694/0 (socket says 172.21.15.52:50694) 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.187+0000 7f2c65e00640 1 -- 172.21.15.52:0/3194874761 learned_addr learned my addr 172.21.15.52:0/3194874761 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 -- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 msgr2=0x7f2c60143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c60143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 -- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c6006e130 msgr2=0x7f2c60140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c6006e130 0x7f2c60140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 -- 172.21.15.52:0/3194874761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c60159bb0 con 0x7f2c601577f0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c65e00640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007e40 tx=0x7f2c5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58014620 con 0x7f2c601577f0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c58019070 con 0x7f2c601577f0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58014a20 con 0x7f2c601577f0 2024-06-02T16:45:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6015b210 con 0x7f2c601577f0 2024-06-02T16:45:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.188+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6015b7d0 con 0x7f2c601577f0 2024-06-02T16:45:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.189+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c600507e0 con 0x7f2c601577f0 2024-06-02T16:45:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.191+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c58014bc0 con 0x7f2c601577f0 2024-06-02T16:45:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.192+0000 7f2c5d600640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 0x7f2c40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.192+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c58097f50 con 0x7f2c601577f0 2024-06-02T16:45:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.193+0000 7f2c65400640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 0x7f2c40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.194+0000 7f2c65400640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 0x7f2c40078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c54006fd0 tx=0x7f2c54006bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.197+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c580618a0 con 0x7f2c601577f0 2024-06-02T16:45:25.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.436+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c60155fa0 con 0x7f2c601577f0 2024-06-02T16:45:25.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.437+0000 7f2c5d600640 1 -- 172.21.15.52:0/3194874761 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f2c580611a0 con 0x7f2c601577f0 2024-06-02T16:45:25.437 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:25.437 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:25.437 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 msgr2=0x7f2c40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 0x7f2c40078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c54006fd0 tx=0x7f2c54006bc0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 msgr2=0x7f2c60157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007e40 tx=0x7f2c5800e4b0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 shutdown_connections 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c400762d0 0x7f2c40078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c601577f0 0x7f2c60157bd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c60072340 0x7f2c60143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 --2- 172.21.15.52:0/3194874761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c6006e130 0x7f2c60140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:25.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 >> 172.21.15.52:0/3194874761 conn(0x7f2c6006c380 msgr2=0x7f2c601552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:25.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 shutdown_connections 2024-06-02T16:45:25.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:25.440+0000 7f2c66800640 1 -- 172.21.15.52:0/3194874761 wait complete. 2024-06-02T16:45:25.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T16:45:11.730081+0000', 'modified': '2024-06-02T16:45:14.803414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/1104742771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6836', 'nonce': 1104742771}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 1104742771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4264, 'qdb_cluster': [4264]} 2024-06-02T16:45:25.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T16:45:25.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T16:45:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.090+0000 7f1521000640 1 Processor -- start 2024-06-02T16:45:26.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.090+0000 7f1521000640 1 -- start start 2024-06-02T16:45:26.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f151c15d4c0 0x7f151c0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f151c0cdd50 0x7f151c161a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c09b9c0 0x7f151c09be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f151c09c350 con 0x7f151c15d4c0 2024-06-02T16:45:26.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f151c161f40 con 0x7f151c0cdd50 2024-06-02T16:45:26.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1521000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f151c0ce230 con 0x7f151c09b9c0 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.092+0000 7f1519e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f151c15d4c0 0x7f151c0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f151c15d4c0 0x7f151c0cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50706/0 (socket says 172.21.15.52:50706) 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 -- 172.21.15.52:0/1481395347 learned_addr learned my addr 172.21.15.52:0/1481395347 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519400640 1 --2- 172.21.15.52:0/1481395347 >> v2:172.21.15.114:3300/0 conn(0x7f151c0cdd50 0x7f151c161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f151a800640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c09b9c0 0x7f151c09be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 -- 172.21.15.52:0/1481395347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c09b9c0 msgr2=0x7f151c09be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c09b9c0 0x7f151c09be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 -- 172.21.15.52:0/1481395347 >> v2:172.21.15.114:3300/0 conn(0x7f151c0cdd50 msgr2=0x7f151c161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 --2- 172.21.15.52:0/1481395347 >> v2:172.21.15.114:3300/0 conn(0x7f151c0cdd50 0x7f151c161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.093+0000 7f1519e00640 1 -- 172.21.15.52:0/1481395347 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c0ce510 con 0x7f151c15d4c0 2024-06-02T16:45:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.095+0000 7f1519e00640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c15d4c0 0x7f151c0cf2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f151c160f60 tx=0x7f150c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfc52cc49510236 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.095+0000 7f1518a00640 1 -- 172.21.15.52:0/1481395347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037070 con 0x7f151c15d4c0 2024-06-02T16:45:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.095+0000 7f1518a00640 1 -- 172.21.15.52:0/1481395347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c032440 con 0x7f151c15d4c0 2024-06-02T16:45:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.095+0000 7f1518a00640 1 -- 172.21.15.52:0/1481395347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c032810 con 0x7f151c15d4c0 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 -- 172.21.15.52:0/1481395347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c15d4c0 msgr2=0x7f151c0cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c15d4c0 0x7f151c0cf2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f151c160f60 tx=0x7f150c02a1e0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 -- 172.21.15.52:0/1481395347 shutdown_connections 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c09b9c0 0x7f151c09be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 --2- 172.21.15.52:0/1481395347 >> v2:172.21.15.114:3300/0 conn(0x7f151c0cdd50 0x7f151c161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 --2- 172.21.15.52:0/1481395347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c15d4c0 0x7f151c0cf2d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 -- 172.21.15.52:0/1481395347 >> 172.21.15.52:0/1481395347 conn(0x7f151c0d3240 msgr2=0x7f151c0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 -- 172.21.15.52:0/1481395347 shutdown_connections 2024-06-02T16:45:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.096+0000 7f1521000640 1 -- 172.21.15.52:0/1481395347 wait complete. 2024-06-02T16:45:26.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.098+0000 7f1521000640 1 Processor -- start 2024-06-02T16:45:26.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.098+0000 7f1521000640 1 -- start start 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c0cdd50 0x7f151c15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 0x7f151c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0cedb0 con 0x7f151c09b9c0 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0cead0 con 0x7f151c15d4c0 2024-06-02T16:45:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1521000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f151c15d8a0 con 0x7f151c0cdd50 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50714/0 (socket says 172.21.15.52:50714) 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 -- 172.21.15.52:0/3677678992 learned_addr learned my addr 172.21.15.52:0/3677678992 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f151a800640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 0x7f151c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 -- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c0cdd50 msgr2=0x7f151c15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519400640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c0cdd50 0x7f151c15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c0cdd50 0x7f151c15bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 -- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 msgr2=0x7f151c0b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 0x7f151c0b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f1519e00640 1 -- 172.21.15.52:0/3677678992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c151e10 con 0x7f151c09b9c0 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.099+0000 7f151a800640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 0x7f151c0b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1519e00640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f150c009960 tx=0x7f150c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1512000640 1 -- 172.21.15.52:0/3677678992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037040 con 0x7f151c09b9c0 2024-06-02T16:45:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1512000640 1 -- 172.21.15.52:0/3677678992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c042070 con 0x7f151c09b9c0 2024-06-02T16:45:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1512000640 1 -- 172.21.15.52:0/3677678992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c030940 con 0x7f151c09b9c0 2024-06-02T16:45:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c1520f0 con 0x7f151c09b9c0 2024-06-02T16:45:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.100+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c1526b0 con 0x7f151c09b9c0 2024-06-02T16:45:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.103+0000 7f1512000640 1 -- 172.21.15.52:0/3677678992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f150c030ae0 con 0x7f151c09b9c0 2024-06-02T16:45:26.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.104+0000 7f1512000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 0x7f14fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.104+0000 7f1512000640 1 -- 172.21.15.52:0/3677678992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f150c0b7ec0 con 0x7f151c09b9c0 2024-06-02T16:45:26.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.104+0000 7f1519400640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 0x7f14fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.104+0000 7f1523f67740 1 Processor -- start 2024-06-02T16:45:26.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.104+0000 7f1523f67740 1 -- start start 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1519400640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 0x7f14fc078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f151c160bf0 tx=0x7f1508008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 0x560fff1f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560fff164df0 con 0x560fff2395b0 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fff154990 con 0x560fff1edb40 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.105+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fff1589d0 con 0x560fff21d650 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50722/0 (socket says 172.21.15.52:50722) 2024-06-02T16:45:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 -- 172.21.15.52:0/3579325492 learned_addr learned my addr 172.21.15.52:0/3579325492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f1519400640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 0x560fff1f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f1519e00640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 -- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 msgr2=0x560fff21da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 -- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 msgr2=0x560fff1f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 0x560fff1f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 -- 172.21.15.52:0/3579325492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fff0f59b0 con 0x560fff2395b0 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f1519400640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 0x560fff1f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.106+0000 7f151a800640 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1514007360 tx=0x7f1514007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e20ef1a0fe9077 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1506a00640 1 -- 172.21.15.52:0/3579325492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514003b90 con 0x560fff2395b0 2024-06-02T16:45:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1506a00640 1 -- 172.21.15.52:0/3579325492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514003d30 con 0x560fff2395b0 2024-06-02T16:45:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1506a00640 1 -- 172.21.15.52:0/3579325492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514004250 con 0x560fff2395b0 2024-06-02T16:45:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 -- 172.21.15.52:0/3579325492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 msgr2=0x560fff239a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1514007360 tx=0x7f1514007820 comp rx=0 tx=0).stop 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 -- 172.21.15.52:0/3579325492 shutdown_connections 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff239a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff1edb40 0x560fff1f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 --2- 172.21.15.52:0/3579325492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.107+0000 7f1523f67740 1 -- 172.21.15.52:0/3579325492 >> 172.21.15.52:0/3579325492 conn(0x560fff1efdb0 msgr2=0x560fff238460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.108+0000 7f1523f67740 1 -- 172.21.15.52:0/3579325492 shutdown_connections 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.108+0000 7f1523f67740 1 -- 172.21.15.52:0/3579325492 wait complete. 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.108+0000 7f1523f67740 1 -- start start 2024-06-02T16:45:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.108+0000 7f1523f67740 1 Processor -- start 2024-06-02T16:45:26.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 0x560fff21fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff2150d0 0x560fff21c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ffee3a850 con 0x560fff2395b0 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fff0fcf20 con 0x560fff21d650 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.109+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fff1f3e20 con 0x560fff2150d0 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1523f67740 10 client.0 _ll_register_callbacks cb 0x560fff14eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50734/0 (socket says 172.21.15.52:50734) 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 -- 172.21.15.52:0/3438410251 learned_addr learned my addr 172.21.15.52:0/3438410251 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f151a800640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff2150d0 0x560fff21c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519e00640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 0x560fff21fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 -- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff2150d0 msgr2=0x560fff21c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff2150d0 0x560fff21c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 -- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 msgr2=0x560fff21fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 0x560fff21fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519400640 1 -- 172.21.15.52:0/3438410251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fff0edd00 con 0x560fff2395b0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.110+0000 7f1519e00640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 0x560fff21fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f1519400640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15080156f0 tx=0x7f1508004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589957b01436de3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f14fb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150800f040 con 0x560fff2395b0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f15080168f0 con 0x560fff2395b0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1514003d30 con 0x560fff2395b0 2024-06-02T16:45:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f150802f050 con 0x560fff2395b0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f1523f67740 10 client.4557 fetch_fsmap learned FSMap version 8 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560ffee692d0 con 0x560fff2395b0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.111+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514003d30 con 0x560fff2395b0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f1508032020 con 0x560fff2395b0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 10 client.4557 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 10 client.4557 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 20 client.4557 populate_metadata read hostname 'smithi052' 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff218bc0 0x560fff218fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 4 client.4557 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 --> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fff166d40 con 0x560fff218bc0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.112+0000 7f1519e00640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff218bc0 0x560fff218fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.113+0000 7f1519e00640 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff218bc0 0x560fff218fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=471b2e24f679953b server_cookie=e1cd7f4c6d8e69b8 in_seq=0 out_seq=0 2024-06-02T16:45:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.113+0000 7f14fb400640 10 client.4557 ms_handle_connect on v2:172.21.15.114:6836/1104742771 2024-06-02T16:45:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.115+0000 7f14fb400640 1 -- 172.21.15.52:0/3438410251 <== mds.0 v2:172.21.15.114:6836/1104742771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560fff166d40 con 0x560fff218bc0 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.115+0000 7f14fb400640 10 client.4557 handle_command_reply: tid=0 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.115+0000 7f1523f67740 1 client.4557 shutdown 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 msgr2=0x560fff21bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15080156f0 tx=0x7f1508004730 comp rx=0 tx=0).stop 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 shutdown_connections 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff218bc0 0x560fff218fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff2150d0 0x560fff21c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 --2- 172.21.15.52:0/3438410251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff21d650 0x560fff21fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f14fb400640 0 client.4557 ms_handle_reset on v2:172.21.15.114:6836/1104742771 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 >> 172.21.15.52:0/3438410251 conn(0x560fff1edb40 msgr2=0x560fff1ed180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 shutdown_connections 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 1 -- 172.21.15.52:0/3438410251 wait complete. 2024-06-02T16:45:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.116+0000 7f1523f67740 20 client.4557 trim_cache size 0 max 16384 2024-06-02T16:45:26.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.137+0000 7f1523f67740 1 Processor -- start 2024-06-02T16:45:26.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.137+0000 7f1523f67740 1 -- start start 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff21a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff1f4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0cb5d0 con 0x560fff2395b0 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f151c160760 con 0x560fff2150d0 2024-06-02T16:45:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.138+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f151c0caf80 con 0x560fff21d650 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50738/0 (socket says 172.21.15.52:50738) 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 -- 172.21.15.52:0/3126467579 learned_addr learned my addr 172.21.15.52:0/3126467579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f1519e00640 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff21a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f1519400640 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff1f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 -- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 msgr2=0x560fff1f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff1f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 -- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 msgr2=0x560fff21a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff21a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.139+0000 7f151a800640 1 -- 172.21.15.52:0/3126467579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ffef336b0 con 0x560fff2395b0 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.140+0000 7f151a800640 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1514007330 tx=0x7f1514013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c150a90ba7d5169b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.140+0000 7f1506000640 1 -- 172.21.15.52:0/3126467579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514003b90 con 0x560fff2395b0 2024-06-02T16:45:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.140+0000 7f1506000640 1 -- 172.21.15.52:0/3126467579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514024070 con 0x560fff2395b0 2024-06-02T16:45:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.140+0000 7f1506000640 1 -- 172.21.15.52:0/3126467579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514009ba0 con 0x560fff2395b0 2024-06-02T16:45:26.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 -- 172.21.15.52:0/3126467579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 msgr2=0x560fff21bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1514007330 tx=0x7f1514013000 comp rx=0 tx=0).stop 2024-06-02T16:45:26.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 -- 172.21.15.52:0/3126467579 shutdown_connections 2024-06-02T16:45:26.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff21bc60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff1f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 --2- 172.21.15.52:0/3126467579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff21a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 -- 172.21.15.52:0/3126467579 >> 172.21.15.52:0/3126467579 conn(0x560fff1edb40 msgr2=0x560fff24c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 -- 172.21.15.52:0/3126467579 shutdown_connections 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.141+0000 7f1523f67740 1 -- 172.21.15.52:0/3126467579 wait complete. 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.142+0000 7f1523f67740 1 -- start start 2024-06-02T16:45:26.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.142+0000 7f1523f67740 1 Processor -- start 2024-06-02T16:45:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff1f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560fff21abe0 con 0x560fff2395b0 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fff21ee40 con 0x560fff2150d0 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fff21f4e0 con 0x560fff21d650 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f1523f67740 10 client.0 _ll_register_callbacks cb 0x7f1508009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:45:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f151a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50752/0 (socket says 172.21.15.52:50752) 2024-06-02T16:45:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.143+0000 7f151a800640 1 -- 172.21.15.52:0/2114695129 learned_addr learned my addr 172.21.15.52:0/2114695129 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f1519400640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f1519e00640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff1f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 -- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 msgr2=0x560fff21bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 -- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 msgr2=0x560fff1f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff1f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 -- 172.21.15.52:0/2114695129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fff20b4d0 con 0x560fff2395b0 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f1519400640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f151a800640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1514004000 tx=0x7f1514004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df7edd9a862c66a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f14fb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514004240 con 0x560fff2395b0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f15140043e0 con 0x560fff2395b0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.144+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1514024070 con 0x560fff2395b0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f151403c050 con 0x560fff2395b0 2024-06-02T16:45:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 10 client.4563 fetch_fsmap learned FSMap version 8 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560fff1f1ca0 con 0x560fff2395b0 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514024070 con 0x560fff2395b0 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f151403f020 con 0x560fff2395b0 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 10 client.4563 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 10 client.4563 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T16:45:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 20 client.4563 populate_metadata read hostname 'smithi052' 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff2194e0 0x560fff1ec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 4 client.4563 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.145+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 --> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] -- command(tid 0: {"prefix": "status"}) -- 0x560fff2215a0 con 0x560fff2194e0 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.146+0000 7f1519e00640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff2194e0 0x560fff1ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1519e00640 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff2194e0 0x560fff1ec860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b05055b6133c981 server_cookie=369c5249474c2110 in_seq=0 out_seq=0 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f14fb400640 10 client.4563 ms_handle_connect on v2:172.21.15.114:6836/1104742771 2024-06-02T16:45:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f14fb400640 1 -- 172.21.15.52:0/2114695129 <== mds.0 v2:172.21.15.114:6836/1104742771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x560fff2215a0 con 0x560fff2194e0 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f14fb400640 10 client.4563 handle_command_reply: tid=0 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1523f67740 1 client.4563 shutdown 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 msgr2=0x560fff218fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1514004000 tx=0x7f1514004ab0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 shutdown_connections 2024-06-02T16:45:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.147+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:6836/1104742771,v1:172.21.15.114:6837/1104742771] conn(0x560fff2194e0 0x560fff1ec860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fff2395b0 0x560fff218fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fff21d650 0x560fff21bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 --2- 172.21.15.52:0/2114695129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fff2150d0 0x560fff1f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 >> 172.21.15.52:0/2114695129 conn(0x560fff1edb40 msgr2=0x560fff23ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f14fb400640 0 client.4563 ms_handle_reset on v2:172.21.15.114:6836/1104742771 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 shutdown_connections 2024-06-02T16:45:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 1 -- 172.21.15.52:0/2114695129 wait complete. 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1523f67740 20 client.4563 trim_cache size 0 max 16384 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "39df44fa-6b94-46ae-87c4-569eff4461cc", 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4264, 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-06-02T16:45:26.159 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 13.854209832, 2024-06-02T16:45:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 8, 2024-06-02T16:45:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 23, 2024-06-02T16:45:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 23, 2024-06-02T16:45:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 20.149673841999999 2024-06-02T16:45:26.160 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 msgr2=0x7f14fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 0x7f14fc078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f151c160bf0 tx=0x7f1508008040 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 msgr2=0x7f151c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.148+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f150c009960 tx=0x7f150c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 shutdown_connections 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f14fc0762d0 0x7f14fc078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f151c15d4c0 0x7f151c0b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f151c0cdd50 0x7f151c15bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 --2- 172.21.15.52:0/3677678992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c09b9c0 0x7f151c0ccb90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 >> 172.21.15.52:0/3677678992 conn(0x7f151c0d3240 msgr2=0x7f151c0c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 shutdown_connections 2024-06-02T16:45:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:26.149+0000 7f1521000640 1 -- 172.21.15.52:0/3677678992 wait complete. 2024-06-02T16:45:26.167 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T16:45:26.176 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T16:45:26.176 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T16:45:26.177 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T16:45:26.177 INFO:teuthology.run_tasks:Running task kclient... 2024-06-02T16:45:26.257 INFO:tasks.kclient:Mounting kernel clients... 2024-06-02T16:45:26.257 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-06-02T16:45:26.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.258 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:45:26.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-06-02T16:45:26.415 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-06-02T16:45:26.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:45:26.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.420 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:45:26.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-06-02T16:45:26.569 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-06-02T16:45:26.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:45:26.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.575 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:45:26.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-06-02T16:45:26.723 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-06-02T16:45:26.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:45:26.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.727 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:45:26.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:26.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-06-02T16:45:26.864 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-06-02T16:45:26.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:45:26.869 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-06-02T16:45:26.869 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T16:45:26.869 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T16:45:26.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:45:27.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.084+0000 7f05ff200640 1 Processor -- start 2024-06-02T16:45:27.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.084+0000 7f05ff200640 1 -- start start 2024-06-02T16:45:27.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05ff200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f06000b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05ff200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06001607c0 con 0x7f06000ba430 2024-06-02T16:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05ff200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0600163040 con 0x7f060015d060 2024-06-02T16:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05ff200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0600163c50 con 0x7f06000b6c80 2024-06-02T16:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05fe800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06000ba430 0x7f06000ba890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57248/0 (socket says 172.21.15.52:57248) 2024-06-02T16:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05fe800640 1 -- 172.21.15.52:0/769132380 learned_addr learned my addr 172.21.15.52:0/769132380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.086+0000 7f05fd400640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f06000b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960629247 0 0) 0x7f06001607c0 con 0x7f06000ba430 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e4003520 con 0x7f06000ba430 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2522181843 0 0) 0x7f05e4003520 con 0x7f06000ba430 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 msgr2=0x7f06000b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f06000b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 >> v1:172.21.15.114:6789/0 conn(0x7f060015d060 legacy=0x7f06000d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0600163320 con 0x7f06000ba430 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f05f80016f0 con 0x7f06000ba430 2024-06-02T16:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 >> v1:172.21.15.52:6789/0 conn(0x7f06000ba430 legacy=0x7f06000ba890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f05e4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e4004000 0x7f05e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4004d40 0x7f05e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0600163c50 con 0x7f05e4004000 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05e400bb50 con 0x7f05e4004d40 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f05e400bd50 con 0x7f06000b6c80 2024-06-02T16:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.087+0000 7f05fd400640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e4004000 0x7f05e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fde00640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f05e4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fd400640 1 -- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 msgr2=0x7f05e4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fd400640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06000b6c80 0x7f05e4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fd400640 1 -- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4004d40 msgr2=0x7f05e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fd400640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4004d40 0x7f05e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.088+0000 7f05fd400640 1 -- 172.21.15.52:0/769132380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4003520 con 0x7f05e4004000 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.089+0000 7f05fd400640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e4004000 0x7f05e4004800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009fc0 tx=0x7f05e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463ca7acd7570c01 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.089+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8009c10 con 0x7f05e4004000 2024-06-02T16:45:27.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.089+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8036070 con 0x7f05e4004000 2024-06-02T16:45:27.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.089+0000 7f05fca00640 1 -- 172.21.15.52:0/769132380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8031880 con 0x7f05e4004000 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 -- 172.21.15.52:0/769132380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e4004000 msgr2=0x7f05e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 --2- 172.21.15.52:0/769132380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e4004000 0x7f05e4004800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009fc0 tx=0x7f05e4005830 comp rx=0 tx=0).stop 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05fe800640 1 -- 172.21.15.52:0/769132380 reap_dead start 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 -- 172.21.15.52:0/769132380 shutdown_connections 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 -- 172.21.15.52:0/769132380 >> 172.21.15.52:0/769132380 conn(0x7f06000740e0 msgr2=0x7f06000d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 -- 172.21.15.52:0/769132380 shutdown_connections 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.090+0000 7f05ff200640 1 -- 172.21.15.52:0/769132380 wait complete. 2024-06-02T16:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.092+0000 7f05ff200640 1 Processor -- start 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.092+0000 7f05ff200640 1 -- start start 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05e4004000 0x7f06000ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0600154bb0 0x7f06000ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06000d0880 con 0x7f06000cec10 2024-06-02T16:45:27.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06001638e0 con 0x7f0600154bb0 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05ff200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f06000d0a00 con 0x7f05e4004000 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05fe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05fe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50780/0 (socket says 172.21.15.52:50780) 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05fe800640 1 -- 172.21.15.52:0/621314461 learned_addr learned my addr 172.21.15.52:0/621314461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.093+0000 7f05fde00640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05e4004000 0x7f06000ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fd400640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0600154bb0 0x7f06000ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 -- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05e4004000 msgr2=0x7f06000ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05e4004000 0x7f06000ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 -- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0600154bb0 msgr2=0x7f06000ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0600154bb0 0x7f06000ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 -- 172.21.15.52:0/621314461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06001f9170 con 0x7f06000cec10 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05fe800640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f06000d2a90 tx=0x7f05f800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8007440 con 0x7f06000cec10 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f80075e0 con 0x7f06000cec10 2024-06-02T16:45:27.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8004a00 con 0x7f06000cec10 2024-06-02T16:45:27.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.094+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06001f9450 con 0x7f06000cec10 2024-06-02T16:45:27.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.095+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001f9a10 con 0x7f06000cec10 2024-06-02T16:45:27.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.096+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06000d0c10 con 0x7f06000cec10 2024-06-02T16:45:27.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.097+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05f8004ba0 con 0x7f06000cec10 2024-06-02T16:45:27.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.098+0000 7f05f6000640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 0x7f05dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:27.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.098+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f05f8096870 con 0x7f06000cec10 2024-06-02T16:45:27.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.098+0000 7f05fde00640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 0x7f05dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:27.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.100+0000 7f05fde00640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 0x7f05dc078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05f00054d0 tx=0x7f05f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:27.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.103+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06000d0c10 con 0x7f06000cec10 2024-06-02T16:45:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.362+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06000507e0 con 0x7f06000cec10 2024-06-02T16:45:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.363+0000 7f05f6000640 1 -- 172.21.15.52:0/621314461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f05f801a030 con 0x7f06000cec10 2024-06-02T16:45:27.363 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:45:27.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 msgr2=0x7f05dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 0x7f05dc078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05f00054d0 tx=0x7f05f0009040 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 msgr2=0x7f0600150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f06000d2a90 tx=0x7f05f800c9e0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 shutdown_connections 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f05dc0762d0 0x7f05dc078790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06000cec10 0x7f0600150d70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0600154bb0 0x7f06000ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 --2- 172.21.15.52:0/621314461 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05e4004000 0x7f06000ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:27.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 >> 172.21.15.52:0/621314461 conn(0x7f06000740e0 msgr2=0x7f06000b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 shutdown_connections 2024-06-02T16:45:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27.366+0000 7f05ff200640 1 -- 172.21.15.52:0/621314461 wait complete. 2024-06-02T16:45:27.387 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T16:45:27.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:45:27.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-06-02T16:45:27.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T16:45:27.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T16:45:27.388 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T16:45:27.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T16:45:27.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:45:27.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:45:27.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:27.388 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-06-02T16:45:27.445 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:27.446 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:27.447 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-06-02T16:45:27.448 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T16:45:27.448 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:27.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:27.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:27.950 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:45:28.015 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-06-02T16:45:28.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:28.019 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-06-02T16:45:28.081 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-06-02T16:45:28.081 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:45:28.081 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T16:45:28.082 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T16:45:28.082 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T16:45:28.082 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:28.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:28.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:28.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:28.797 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:45:28.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:28.843 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-06-02T16:45:28.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:28.930 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:28.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T16:45:28.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-02T16:45:28.931 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:29.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:29.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:29.160 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-02T16:45:29.160 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:29.160 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:29.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-02T16:45:29.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T16:45:29.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-02T16:45:29.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-02T16:45:29.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-02T16:45:29.161 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:29.456 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:29.456 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:29.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-06-02T16:45:29.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T16:45:29.457 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:29.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:29.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:29.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:29.657 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T16:45:29.695 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:45:29.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:29.696 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:45:29.785 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:45:29.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:29.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:45:29.957 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:45:29.957 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:45:29.957 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:30.663 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:45:30.663 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:45:30.663 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:30.663 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:30.663 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:30.699 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:45:30.699 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:45:30.699 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:30.700 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:30.700 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:30.700 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:45:30.700 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:45:30.700 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:45:30.703 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-02T16:45:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:45:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:45:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:45:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:45:30.709 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:45:30.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:30.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:45:30.800 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:30.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:30.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:30.954 INFO:teuthology.orchestra.run.smithi052.stdout:client4492 2024-06-02T16:45:30.954 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:30.954 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:31.012 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:31.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:31.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:31.139 INFO:teuthology.orchestra.run.smithi052.stdout:client4492 2024-06-02T16:45:31.140 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:31.260 INFO:teuthology.orchestra.run.smithi052.stdout:client4492 2024-06-02T16:45:31.261 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39df44fa-6b94-46ae-87c4-569eff4461cc.client4492/status') 2024-06-02T16:45:31.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:31.401 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.4492 (3)172.21.15.52:0/2249267732 2024-06-02T16:45:31.401 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-06-02T16:45:31.401 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-06-02T16:45:31.402 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-06-02T16:45:31.402 INFO:teuthology.orchestra.run.smithi052.stderr:70 bytes copied, 0.00011166 s, 627 kB/s 2024-06-02T16:45:31.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:31.415 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-06-02T16:45:31.415 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T16:45:31.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T16:45:31.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:45:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.619+0000 7f449be00640 1 Processor -- start 2024-06-02T16:45:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.619+0000 7f449be00640 1 -- start start 2024-06-02T16:45:31.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f449c1577f0 0x7f449c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 0x7f449c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f449c06e670 0x7f449c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f449c06ead0 con 0x7f449c06e670 2024-06-02T16:45:31.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f449c160c80 con 0x7f449c1577f0 2024-06-02T16:45:31.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449be00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f449c160f60 con 0x7f449c073fb0 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.621+0000 7f449b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f449c06e670 0x7f449c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f4493e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 0x7f449c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f4493e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 0x7f449c06e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:46792/0 (socket says 172.21.15.52:46792) 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f449c1577f0 0x7f449c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f4493e00640 1 -- 172.21.15.52:0/2486505138 learned_addr learned my addr 172.21.15.52:0/2486505138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449b400640 1 -- 172.21.15.52:0/2486505138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 msgr2=0x7f449c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449b400640 1 --2- 172.21.15.52:0/2486505138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 0x7f449c06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449b400640 1 -- 172.21.15.52:0/2486505138 >> v2:172.21.15.114:3300/0 conn(0x7f449c1577f0 msgr2=0x7f449c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449b400640 1 --2- 172.21.15.52:0/2486505138 >> v2:172.21.15.114:3300/0 conn(0x7f449c1577f0 0x7f449c073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.622+0000 7f449b400640 1 -- 172.21.15.52:0/2486505138 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c161240 con 0x7f449c06e670 2024-06-02T16:45:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.623+0000 7f449b400640 1 --2- 172.21.15.52:0/2486505138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c06e670 0x7f449c0ce510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f449c06cf90 tx=0x7f449402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e4d6c4e210417a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449a000640 1 -- 172.21.15.52:0/2486505138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494031600 con 0x7f449c06e670 2024-06-02T16:45:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449a000640 1 -- 172.21.15.52:0/2486505138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44940317a0 con 0x7f449c06e670 2024-06-02T16:45:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449a000640 1 -- 172.21.15.52:0/2486505138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494031b70 con 0x7f449c06e670 2024-06-02T16:45:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 -- 172.21.15.52:0/2486505138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c06e670 msgr2=0x7f449c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 --2- 172.21.15.52:0/2486505138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c06e670 0x7f449c0ce510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f449c06cf90 tx=0x7f449402a5d0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 -- 172.21.15.52:0/2486505138 shutdown_connections 2024-06-02T16:45:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 --2- 172.21.15.52:0/2486505138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c073fb0 0x7f449c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 --2- 172.21.15.52:0/2486505138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c06e670 0x7f449c0ce510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 --2- 172.21.15.52:0/2486505138 >> v2:172.21.15.114:3300/0 conn(0x7f449c1577f0 0x7f449c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.624+0000 7f449be00640 1 -- 172.21.15.52:0/2486505138 >> 172.21.15.52:0/2486505138 conn(0x7f449c06c380 msgr2=0x7f449c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.625+0000 7f449be00640 1 -- 172.21.15.52:0/2486505138 shutdown_connections 2024-06-02T16:45:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.625+0000 7f449be00640 1 -- 172.21.15.52:0/2486505138 wait complete. 2024-06-02T16:45:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.626+0000 7f449be00640 1 Processor -- start 2024-06-02T16:45:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.627+0000 7f449be00640 1 -- start start 2024-06-02T16:45:31.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.627+0000 7f449be00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c06e670 0x7f449c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.627+0000 7f449be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.627+0000 7f449be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c1577f0 0x7f449c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f449be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f449c161a40 con 0x7f449c073fb0 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f449be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f449c15e510 con 0x7f449c1577f0 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f449be00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f449c074580 con 0x7f449c06e670 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50806/0 (socket says 172.21.15.52:50806) 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 -- 172.21.15.52:0/3064212023 learned_addr learned my addr 172.21.15.52:0/3064212023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f449aa00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c06e670 0x7f449c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f449b400640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c1577f0 0x7f449c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 -- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c06e670 msgr2=0x7f449c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c06e670 0x7f449c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 -- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c1577f0 msgr2=0x7f449c152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c1577f0 0x7f449c152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.628+0000 7f4493e00640 1 -- 172.21.15.52:0/3064212023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c149d90 con 0x7f449c073fb0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f4493e00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f448400e8d0 tx=0x7f448400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484017070 con 0x7f449c073fb0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448400c940 con 0x7f449c073fb0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c15a590 con 0x7f449c073fb0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448400ccf0 con 0x7f449c073fb0 2024-06-02T16:45:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.629+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c15ab50 con 0x7f449c073fb0 2024-06-02T16:45:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.631+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c0507e0 con 0x7f449c073fb0 2024-06-02T16:45:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.632+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f448401a070 con 0x7f449c073fb0 2024-06-02T16:45:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.633+0000 7f4492a00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 0x7f4478078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.633+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f44840978c0 con 0x7f449c073fb0 2024-06-02T16:45:31.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.633+0000 7f449aa00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 0x7f4478078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:31.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.635+0000 7f449aa00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 0x7f4478078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f448c009a30 tx=0x7f448c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:31.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.638+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f449c149d90 con 0x7f449c073fb0 2024-06-02T16:45:31.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.897+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f449c06f070 con 0x7f449c073fb0 2024-06-02T16:45:31.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.898+0000 7f4492a00640 1 -- 172.21.15.52:0/3064212023 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4484061290 con 0x7f449c073fb0 2024-06-02T16:45:31.897 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:45:31.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 msgr2=0x7f4478078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:31.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 0x7f4478078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f448c009a30 tx=0x7f448c008040 comp rx=0 tx=0).stop 2024-06-02T16:45:31.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 msgr2=0x7f449c159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:31.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f448400e8d0 tx=0x7f448400ed90 comp rx=0 tx=0).stop 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 shutdown_connections 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4478076350 0x7f4478078810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c1577f0 0x7f449c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c073fb0 0x7f449c159c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 --2- 172.21.15.52:0/3064212023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f449c06e670 0x7f449c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 >> 172.21.15.52:0/3064212023 conn(0x7f449c06c380 msgr2=0x7f449c15f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 shutdown_connections 2024-06-02T16:45:31.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:31.901+0000 7f449be00640 1 -- 172.21.15.52:0/3064212023 wait complete. 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T16:45:31.921 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T16:45:31.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T16:45:31.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:45:31.922 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-06-02T16:45:31.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:31.922 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-06-02T16:45:31.976 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:31.976 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:31.976 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:31.977 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:31.978 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 86:1a:53:a2:08:58 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::bcb9:74ff:fea9:58a3/64 scope link 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 86:1a:53:a2:08:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::841a:53ff:fea2:858/64 scope link 2024-06-02T16:45:31.979 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:31.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:31.980 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:45:32.063 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-06-02T16:45:32.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:32.068 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-06-02T16:45:32.128 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-06-02T16:45:32.128 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:45:32.128 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T16:45:32.128 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T16:45:32.128 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:45:32.128 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:32.129 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:32.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T16:45:32.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T16:45:32.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T16:45:32.129 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:32.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:32.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:32.358 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:45:32.409 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T16:45:32.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:32.411 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-06-02T16:45:32.464 INFO:teuthology.orchestra.run.smithi052.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-06-02T16:45:32.466 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:32.466 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:32.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T16:45:32.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-06-02T16:45:32.466 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:32.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:32.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:32.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:32.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T16:45:32.746 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:32.746 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:32.746 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:32.746 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether c2:7e:f3:7b:d1:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T16:45:32.747 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.748 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c07e:f3ff:fe7b:d1be/64 scope link 2024-06-02T16:45:32.748 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:32.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T16:45:32.842 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether c2:7e:f3:7b:d1:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c07e:f3ff:fe7b:d1be/64 scope link 2024-06-02T16:45:32.843 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:32.847 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-06-02T16:45:32.847 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:32.847 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:32.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-06-02T16:45:32.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T16:45:32.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-06-02T16:45:32.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-06-02T16:45:32.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-06-02T16:45:32.848 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:32.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:33.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:33.144 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:33.144 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:45:33.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.1 up 2024-06-02T16:45:33.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T16:45:33.144 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:45:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:33.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:33.368 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-06-02T16:45:33.418 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-06-02T16:45:33.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:33.418 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-06-02T16:45:33.468 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:45:33.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:33.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-06-02T16:45:33.600 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-06-02T16:45:33.600 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-06-02T16:45:33.600 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:33.622 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-06-02T16:45:33.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-06-02T16:45:33.622 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:33.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:33.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:33.651 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-06-02T16:45:33.651 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-06-02T16:45:33.651 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:45:33.651 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:33.651 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:33.652 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:45:33.652 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:45:33.652 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:45:33.655 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-06-02T16:45:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:45:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:45:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:45:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:45:33.661 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:45:33.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:33.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-06-02T16:45:33.747 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:33.872 INFO:teuthology.orchestra.run.smithi052.stdout:client4439 2024-06-02T16:45:33.872 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:33.872 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:33.927 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:34.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:34.054 INFO:teuthology.orchestra.run.smithi052.stdout:client4439 2024-06-02T16:45:34.054 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:34.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:34.177 INFO:teuthology.orchestra.run.smithi052.stdout:client4439 2024-06-02T16:45:34.178 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39df44fa-6b94-46ae-87c4-569eff4461cc.client4439/status') 2024-06-02T16:45:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:34.319 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.4439 (3)172.21.15.52:0/816299085 2024-06-02T16:45:34.320 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-06-02T16:45:34.320 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-06-02T16:45:34.320 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-06-02T16:45:34.320 INFO:teuthology.orchestra.run.smithi052.stderr:69 bytes copied, 0.000309358 s, 223 kB/s 2024-06-02T16:45:34.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:34.334 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-06-02T16:45:34.334 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T16:45:34.334 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T16:45:34.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:45:34.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.538+0000 7fad87200640 1 Processor -- start 2024-06-02T16:45:34.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.538+0000 7fad87200640 1 -- start start 2024-06-02T16:45:34.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.539+0000 7fad87200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad8806e840 0x7fad88162e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad87200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad88163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad87200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8815fa10 con 0x7fad8815cce0 2024-06-02T16:45:34.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad87200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fad88163890 con 0x7fad8806e840 2024-06-02T16:45:34.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad87200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fad88163ab0 con 0x7fad881604d0 2024-06-02T16:45:34.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad85e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad8815cce0 0x7fad8806e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57938/0 (socket says 172.21.15.52:57938) 2024-06-02T16:45:34.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad85e00640 1 -- 172.21.15.52:0/2759811144 learned_addr learned my addr 172.21.15.52:0/2759811144 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad85400640 1 --2- 172.21.15.52:0/2759811144 >> v2:172.21.15.114:3300/0 conn(0x7fad8806e840 0x7fad88162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.540+0000 7fad86800640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad88163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142315514 0 0) 0x7fad8815fa10 con 0x7fad8815cce0 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad6c003520 con 0x7fad8815cce0 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2021043233 0 0) 0x7fad6c003520 con 0x7fad8815cce0 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 msgr2=0x7fad88163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad88163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 >> v2:172.21.15.114:3300/0 conn(0x7fad8806e840 msgr2=0x7fad88162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 --2- 172.21.15.52:0/2759811144 >> v2:172.21.15.114:3300/0 conn(0x7fad8806e840 0x7fad88162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8815fcd0 con 0x7fad8815cce0 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fad700016f0 con 0x7fad8815cce0 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 >> v1:172.21.15.52:6789/0 conn(0x7fad8815cce0 legacy=0x7fad8806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad6c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad6c004020 0x7fad6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad88163890 con 0x7fad6c004020 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad88163ab0 con 0x7fad6c004d40 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.541+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c00ba70 con 0x7fad881604d0 2024-06-02T16:45:34.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad6c004020 0x7fad6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad86800640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85e00640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad6c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 -- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 msgr2=0x7fad6c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad881604d0 0x7fad6c003a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 -- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004d40 msgr2=0x7fad6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:34.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.542+0000 7fad85400640 1 -- 172.21.15.52:0/2759811144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c003520 con 0x7fad6c004020 2024-06-02T16:45:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.543+0000 7fad85400640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad6c004020 0x7fad6c004800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad78009fc0 tx=0x7fad6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9517c97e44fe5e8b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78009c10 con 0x7fad6c004020 2024-06-02T16:45:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78036070 con 0x7fad6c004020 2024-06-02T16:45:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad84a00640 1 -- 172.21.15.52:0/2759811144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7802d070 con 0x7fad6c004020 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 -- 172.21.15.52:0/2759811144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad6c004020 msgr2=0x7fad6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 --2- 172.21.15.52:0/2759811144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad6c004020 0x7fad6c004800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad78009fc0 tx=0x7fad6c005830 comp rx=0 tx=0).stop 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad86800640 1 -- 172.21.15.52:0/2759811144 reap_dead start 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 -- 172.21.15.52:0/2759811144 shutdown_connections 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 -- 172.21.15.52:0/2759811144 >> 172.21.15.52:0/2759811144 conn(0x7fad8806c380 msgr2=0x7fad8806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 -- 172.21.15.52:0/2759811144 shutdown_connections 2024-06-02T16:45:34.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.544+0000 7fad87200640 1 -- 172.21.15.52:0/2759811144 wait complete. 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.546+0000 7fad87200640 1 Processor -- start 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.546+0000 7fad87200640 1 -- start start 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004020 0x7fad881e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad880cf0d0 0x7fad88161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad88163350 con 0x7fad880cec50 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad8815d0c0 con 0x7fad6c004020 2024-06-02T16:45:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.547+0000 7fad87200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fad881634d0 con 0x7fad880cf0d0 2024-06-02T16:45:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56494/0 (socket says 172.21.15.52:56494) 2024-06-02T16:45:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 -- 172.21.15.52:0/318584787 learned_addr learned my addr 172.21.15.52:0/318584787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85e00640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004020 0x7fad881e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 -- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad880cf0d0 msgr2=0x7fad88161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad86800640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad880cf0d0 0x7fad88161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad880cf0d0 0x7fad88161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 -- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004020 msgr2=0x7fad881e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004020 0x7fad881e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.548+0000 7fad85400640 1 -- 172.21.15.52:0/318584787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad880cf680 con 0x7fad880cec50 2024-06-02T16:45:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad85400640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e230 tx=0x7fad78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78009c10 con 0x7fad880cec50 2024-06-02T16:45:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78003bb0 con 0x7fad880cec50 2024-06-02T16:45:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78004020 con 0x7fad880cec50 2024-06-02T16:45:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad880cf960 con 0x7fad880cec50 2024-06-02T16:45:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.549+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad880cff20 con 0x7fad880cec50 2024-06-02T16:45:34.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.550+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad88075ea0 con 0x7fad880cec50 2024-06-02T16:45:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.551+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad78005d10 con 0x7fad880cec50 2024-06-02T16:45:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.552+0000 7fad7e000640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 0x7fad64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.553+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fad780b8b70 con 0x7fad880cec50 2024-06-02T16:45:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.553+0000 7fad85e00640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 0x7fad64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.554+0000 7fad85e00640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 0x7fad64078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad70005a90 tx=0x7fad70009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.557+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fad780824c0 con 0x7fad880cec50 2024-06-02T16:45:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.809+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fad880507e0 con 0x7fad880cec50 2024-06-02T16:45:34.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.810+0000 7fad7e000640 1 -- 172.21.15.52:0/318584787 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fad78081dc0 con 0x7fad880cec50 2024-06-02T16:45:34.810 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:45:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 msgr2=0x7fad64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 0x7fad64078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad70005a90 tx=0x7fad70009040 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 msgr2=0x7fad88160d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e230 tx=0x7fad78009750 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 shutdown_connections 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad640762d0 0x7fad64078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad880cf0d0 0x7fad88161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad880cec50 0x7fad88160d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 --2- 172.21.15.52:0/318584787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6c004020 0x7fad881e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:34.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 >> 172.21.15.52:0/318584787 conn(0x7fad8806c380 msgr2=0x7fad880b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:34.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 shutdown_connections 2024-06-02T16:45:34.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:34.813+0000 7fad87200640 1 -- 172.21.15.52:0/318584787 wait complete. 2024-06-02T16:45:34.832 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:45:34.833 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-02T16:45:34.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:34.833 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-06-02T16:45:34.890 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:34.890 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:34.891 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:45:34.892 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:34.892 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-06-02T16:45:34.892 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42608sec preferred_lft 42608sec 2024-06-02T16:45:34.892 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-06-02T16:45:34.892 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:34.893 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T16:45:34.893 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:35.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:35.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:45:35.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:45:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:35.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:35.375 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:45:35.443 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-06-02T16:45:35.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:35.446 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-06-02T16:45:35.498 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-06-02T16:45:35.498 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:45:35.498 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T16:45:35.498 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T16:45:35.498 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:45:35.498 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:35.498 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:35.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T16:45:35.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T16:45:35.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T16:45:35.499 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:35.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:36.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:36.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:36.208 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:45:36.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:36.259 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-06-02T16:45:36.312 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-02T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:36.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-02T16:45:36.490 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:36.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:36.776 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:36.776 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:36.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-06-02T16:45:36.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T16:45:36.776 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:36.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:36.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:36.979 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-02T16:45:37.022 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-02T16:45:37.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:37.023 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-02T16:45:37.117 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:45:37.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:37.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-06-02T16:45:37.259 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-06-02T16:45:37.259 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-06-02T16:45:37.259 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:37.916 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-06-02T16:45:37.916 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-06-02T16:45:37.916 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:37.916 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:37.916 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:45:37.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:45:37.953 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-06-02T16:45:37.953 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:45:37.953 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:45:37.953 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:45:37.953 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:45:37.958 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:45:37.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:37.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-02T16:45:38.040 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:38.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:38.162 INFO:teuthology.orchestra.run.smithi114.stdout:client4507 2024-06-02T16:45:38.163 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:38.163 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:38.212 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:38.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:38.377 INFO:teuthology.orchestra.run.smithi114.stdout:client4507 2024-06-02T16:45:38.377 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:38.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:38.492 INFO:teuthology.orchestra.run.smithi114.stdout:client4507 2024-06-02T16:45:38.493 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39df44fa-6b94-46ae-87c4-569eff4461cc.client4507/status') 2024-06-02T16:45:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:38.623 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4507 (3)192.168.0.1:0/3403656611 2024-06-02T16:45:38.623 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-06-02T16:45:38.623 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-06-02T16:45:38.623 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-06-02T16:45:38.624 INFO:teuthology.orchestra.run.smithi114.stderr:69 bytes copied, 8.2834e-05 s, 833 kB/s 2024-06-02T16:45:38.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:38.636 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-06-02T16:45:38.636 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T16:45:38.637 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T16:45:38.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:45:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.859+0000 7f911d800640 1 Processor -- start 2024-06-02T16:45:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.860+0000 7f911d800640 1 -- start start 2024-06-02T16:45:38.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.861+0000 7f911d800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f91180ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.861+0000 7f911d800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91180ae8e0 con 0x7f91180d1b60 2024-06-02T16:45:38.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.861+0000 7f911d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91180ae600 con 0x7f911806fed0 2024-06-02T16:45:38.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.861+0000 7f911d800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f911815d6b0 con 0x7f911815d2d0 2024-06-02T16:45:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.862+0000 7f9117400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f91180d1b60 0x7f91180727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57940/0 (socket says 172.21.15.52:57940) 2024-06-02T16:45:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.862+0000 7f9117400640 1 -- 172.21.15.52:0/3680129997 learned_addr learned my addr 172.21.15.52:0/3680129997 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.862+0000 7f9116a00640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f91180ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.862+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079436790 0 0) 0x7f9110001490 con 0x7f91180d1b60 2024-06-02T16:45:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.862+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90fc003520 con 0x7f91180d1b60 2024-06-02T16:45:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2291279363 0 0) 0x7f90fc003520 con 0x7f91180d1b60 2024-06-02T16:45:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 msgr2=0x7f91180ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f91180ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 >> v1:172.21.15.114:6789/0 conn(0x7f911806fed0 legacy=0x7f91180d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911806e740 con 0x7f91180d1b60 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f9110001c40 con 0x7f91180d1b60 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 >> v1:172.21.15.52:6789/0 conn(0x7f91180d1b60 legacy=0x7f91180727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f90fc003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004050 0x7f90fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc004d40 0x7f90fc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f911815d6b0 con 0x7f90fc004d40 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc00bbb0 con 0x7f90fc004050 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc00bdb0 con 0x7f911815d2d0 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.863+0000 7f9117400640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc004d40 0x7f90fc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9116a00640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f90fc003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9116000640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004050 0x7f90fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9117400640 1 -- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 msgr2=0x7f90fc003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9117400640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f90fc003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9117400640 1 -- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004050 msgr2=0x7f90fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9117400640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004050 0x7f90fc004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9117400640 1 -- 172.21.15.52:0/3680129997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc003520 con 0x7f90fc004d40 2024-06-02T16:45:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.864+0000 7f9116a00640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f911815d2d0 0x7f90fc003a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.865+0000 7f9117400640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc004d40 0x7f90fc0051a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f911000a9d0 tx=0x7f90fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9d22786213673a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.865+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911000a5f0 con 0x7f90fc004d40 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.865+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911002f070 con 0x7f90fc004d40 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.865+0000 7f9115600640 1 -- 172.21.15.52:0/3680129997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911002bd90 con 0x7f90fc004d40 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 -- 172.21.15.52:0/3680129997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc004d40 msgr2=0x7f90fc0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 --2- 172.21.15.52:0/3680129997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc004d40 0x7f90fc0051a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f911000a9d0 tx=0x7f90fc005830 comp rx=0 tx=0).stop 2024-06-02T16:45:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f9117400640 1 -- 172.21.15.52:0/3680129997 reap_dead start 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 -- 172.21.15.52:0/3680129997 shutdown_connections 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 -- 172.21.15.52:0/3680129997 >> 172.21.15.52:0/3680129997 conn(0x7f911806c7a0 msgr2=0x7f911806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 -- 172.21.15.52:0/3680129997 shutdown_connections 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.866+0000 7f911d800640 1 -- 172.21.15.52:0/3680129997 wait complete. 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.868+0000 7f911d800640 1 Processor -- start 2024-06-02T16:45:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.868+0000 7f911d800640 1 -- start start 2024-06-02T16:45:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004d40 0x7f91180cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91180cdf80 0x7f911815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91180741b0 con 0x7f91181504c0 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f911806ed90 con 0x7f90fc004d40 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f911d800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f91180ce400 con 0x7f91180cdf80 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f9116000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f9116000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56522/0 (socket says 172.21.15.52:56522) 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.869+0000 7f9116000640 1 -- 172.21.15.52:0/1270410567 learned_addr learned my addr 172.21.15.52:0/1270410567 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116a00640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004d40 0x7f91180cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9117400640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91180cdf80 0x7f911815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 -- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91180cdf80 msgr2=0x7f911815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91180cdf80 0x7f911815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 -- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004d40 msgr2=0x7f91180cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004d40 0x7f91180cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 -- 172.21.15.52:0/1270410567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91180ce6e0 con 0x7f91181504c0 2024-06-02T16:45:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f9116000640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f910400d770 tx=0x7f910400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.870+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104005270 con 0x7f91181504c0 2024-06-02T16:45:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.871+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104017070 con 0x7f91181504c0 2024-06-02T16:45:38.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.871+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91180ce9c0 con 0x7f91181504c0 2024-06-02T16:45:38.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.871+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910400b650 con 0x7f91181504c0 2024-06-02T16:45:38.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.871+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91180cef80 con 0x7f91181504c0 2024-06-02T16:45:38.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.872+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9118069520 con 0x7f91181504c0 2024-06-02T16:45:38.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.873+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f910400b7f0 con 0x7f91181504c0 2024-06-02T16:45:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.874+0000 7f910ea00640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 0x7f90f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.874+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f91040975d0 con 0x7f91181504c0 2024-06-02T16:45:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.875+0000 7f9116a00640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 0x7f90f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:38.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.876+0000 7f9116a00640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 0x7f90f8078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9108009a90 tx=0x7f9108008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:38.879+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9104060e00 con 0x7f91181504c0 2024-06-02T16:45:39.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.135+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f91180b2e00 con 0x7f91181504c0 2024-06-02T16:45:39.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.136+0000 7f910ea00640 1 -- 172.21.15.52:0/1270410567 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f9104060700 con 0x7f91181504c0 2024-06-02T16:45:39.135 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 msgr2=0x7f90f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 0x7f90f8078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9108009a90 tx=0x7f9108008040 comp rx=0 tx=0).stop 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 msgr2=0x7f91180cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f910400d770 tx=0x7f910400dc30 comp rx=0 tx=0).stop 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 shutdown_connections 2024-06-02T16:45:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90f80762d0 0x7f90f8078790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91180cdf80 0x7f911815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.139+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91181504c0 0x7f91180cda40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.140+0000 7f911d800640 1 --2- 172.21.15.52:0/1270410567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90fc004d40 0x7f91180cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.140+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 >> 172.21.15.52:0/1270410567 conn(0x7f911806c7a0 msgr2=0x7f911815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.140+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 shutdown_connections 2024-06-02T16:45:39.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:39.140+0000 7f911d800640 1 -- 172.21.15.52:0/1270410567 wait complete. 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T16:45:39.158 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:45:39.159 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-06-02T16:45:39.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.159 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:39.217 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42604sec preferred_lft 42604sec 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:39.218 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ba:7d:a4:f8:b2:e7 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::74f5:9cff:feb0:97f6/64 scope link 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ba:7d:a4:f8:b2:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::b87d:a4ff:fef8:b2e7/64 scope link 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.220 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:45:39.300 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-06-02T16:45:39.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.305 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-06-02T16:45:39.357 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-06-02T16:45:39.358 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:45:39.358 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T16:45:39.358 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T16:45:39.358 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:45:39.358 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:39.358 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:39.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T16:45:39.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T16:45:39.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T16:45:39.359 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:39.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:39.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.569 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:45:39.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-02T16:45:39.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.614 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-06-02T16:45:39.707 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-06-02T16:45:39.708 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:39.708 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:39.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T16:45:39.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-06-02T16:45:39.708 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:39.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:39.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T16:45:39.969 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ce:19:ee:28:0e:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cc19:eeff:fe28:ed3/64 scope link 2024-06-02T16:45:39.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:39.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:39.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T16:45:40.053 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:45:40.053 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:45:40.053 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:45:40.053 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ce:19:ee:28:0e:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cc19:eeff:fe28:ed3/64 scope link 2024-06-02T16:45:40.054 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:45:40.057 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-06-02T16:45:40.057 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:40.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:40.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:40.328 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:45:40.328 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-06-02T16:45:40.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2024-06-02T16:45:40.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T16:45:40.328 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-06-02T16:45:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:40.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:40.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:40.530 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-06-02T16:45:40.574 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-06-02T16:45:40.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:45:40.574 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-06-02T16:45:40.668 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:45:40.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:40.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-06-02T16:45:40.798 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-06-02T16:45:40.798 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-06-02T16:45:40.798 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-06-02T16:45:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-06-02T16:45:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:40.845 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:45:40.846 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:45:40.850 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-06-02T16:45:40.850 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:45:40.850 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:45:40.850 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:45:40.850 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:45:40.855 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:45:40.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:40.855 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-06-02T16:45:40.929 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:41.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:41.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:41.046 INFO:teuthology.orchestra.run.smithi114.stdout:client4516 2024-06-02T16:45:41.047 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:41.047 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:41.097 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:41.263 INFO:teuthology.orchestra.run.smithi114.stdout:client4516 2024-06-02T16:45:41.263 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:45:41.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:45:41.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:41.380 INFO:teuthology.orchestra.run.smithi114.stdout:client4516 2024-06-02T16:45:41.380 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39df44fa-6b94-46ae-87c4-569eff4461cc.client4516/status') 2024-06-02T16:45:41.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:45:41.510 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4516 (3)192.168.0.2:0/1351454259 2024-06-02T16:45:41.511 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-06-02T16:45:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-06-02T16:45:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-06-02T16:45:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:69 bytes copied, 9.7638e-05 s, 707 kB/s 2024-06-02T16:45:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-06-02T16:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:45:41.523 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-06-02T16:45:41.590 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-06-02T16:45:41.590 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:45:41.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:41.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.815+0000 7fe30dc00640 1 Processor -- start 2024-06-02T16:45:41.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.815+0000 7fe30dc00640 1 -- start start 2024-06-02T16:45:41.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe30dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3080b06a0 0x7fe30815c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe30dc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3080b0a80 con 0x7fe3080d1580 2024-06-02T16:45:41.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe30dc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30815d020 con 0x7fe3080b5c60 2024-06-02T16:45:41.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe30dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe3081600e0 con 0x7fe3080b06a0 2024-06-02T16:45:41.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe307400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe3080d1580 0x7fe3080b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57944/0 (socket says 172.21.15.52:57944) 2024-06-02T16:45:41.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe307400640 1 -- 172.21.15.52:0/84602710 learned_addr learned my addr 172.21.15.52:0/84602710 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:41.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.817+0000 7fe306a00640 1 --2- 172.21.15.52:0/84602710 >> v2:172.21.15.114:3300/0 conn(0x7fe3080b06a0 0x7fe30815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262984552 0 0) 0x7fe3080b0a80 con 0x7fe3080d1580 2024-06-02T16:45:41.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2ec003520 con 0x7fe3080d1580 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865493502 0 0) 0x7fe2ec003520 con 0x7fe3080d1580 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 >> v2:172.21.15.114:3300/0 conn(0x7fe3080b06a0 msgr2=0x7fe30815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 --2- 172.21.15.52:0/84602710 >> v2:172.21.15.114:3300/0 conn(0x7fe3080b06a0 0x7fe30815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 >> v1:172.21.15.114:6789/0 conn(0x7fe3080b5c60 legacy=0x7fe308160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30815d300 con 0x7fe3080d1580 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fe300001a70 con 0x7fe3080d1580 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 >> v1:172.21.15.52:6789/0 conn(0x7fe3080d1580 legacy=0x7fe3080b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 0x7fe2ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec004800 0x7fe2ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081600e0 con 0x7fe2ec003a50 2024-06-02T16:45:41.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec00c160 con 0x7fe2ec004800 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec00e570 con 0x7fe2ec0051c0 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.818+0000 7fe306a00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 0x7fe2ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe306a00640 1 -- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec0051c0 msgr2=0x7fe2ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe306a00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe306a00640 1 -- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec004800 msgr2=0x7fe2ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:41.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe306a00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec004800 0x7fe2ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe306a00640 1 -- 172.21.15.52:0/84602710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec003520 con 0x7fe2ec003a50 2024-06-02T16:45:41.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.819+0000 7fe307400640 1 -- 172.21.15.52:0/84602710 reap_dead start 2024-06-02T16:45:41.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.820+0000 7fe306a00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 0x7fe2ec003e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009ac0 tx=0x7fe2ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753c55afc34b9560 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:41.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.820+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8036070 con 0x7fe2ec003a50 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.820+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f8031400 con 0x7fe2ec003a50 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.820+0000 7fe305600640 1 -- 172.21.15.52:0/84602710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8009690 con 0x7fe2ec003a50 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 -- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 msgr2=0x7fe2ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 0x7fe2ec003e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009ac0 tx=0x7fe2ec005830 comp rx=0 tx=0).stop 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 -- 172.21.15.52:0/84602710 shutdown_connections 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 --2- 172.21.15.52:0/84602710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec003a50 0x7fe2ec003e70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 -- 172.21.15.52:0/84602710 >> 172.21.15.52:0/84602710 conn(0x7fe30806c7a0 msgr2=0x7fe30806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 -- 172.21.15.52:0/84602710 shutdown_connections 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.821+0000 7fe30dc00640 1 -- 172.21.15.52:0/84602710 wait complete. 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.823+0000 7fe30dc00640 1 Processor -- start 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.823+0000 7fe30dc00640 1 -- start start 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 0x7fe308159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 0x7fe30815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080d19e0 con 0x7fe3081535c0 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe30815fd70 con 0x7fe2ec003a50 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe30dc00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe3080d1b60 con 0x7fe30814b340 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe307400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe307400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56534/0 (socket says 172.21.15.52:56534) 2024-06-02T16:45:41.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe307400640 1 -- 172.21.15.52:0/3772292401 learned_addr learned my addr 172.21.15.52:0/3772292401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:41.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe306000640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 0x7fe30815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.824+0000 7fe306a00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 0x7fe308159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 -- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 msgr2=0x7fe30815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 0x7fe30815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 -- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 msgr2=0x7fe308159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 0x7fe308159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 -- 172.21.15.52:0/3772292401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30815e9f0 con 0x7fe3081535c0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe306000640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 0x7fe30815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe306a00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 0x7fe308159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe307400640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe308160050 tx=0x7fe30000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30000ce50 con 0x7fe3081535c0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30000a610 con 0x7fe3081535c0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30000aa00 con 0x7fe3081535c0 2024-06-02T16:45:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30815ecd0 con 0x7fe3081535c0 2024-06-02T16:45:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.825+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30815f290 con 0x7fe3081535c0 2024-06-02T16:45:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.826+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe308069520 con 0x7fe3081535c0 2024-06-02T16:45:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.828+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe30000aba0 con 0x7fe3081535c0 2024-06-02T16:45:41.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.829+0000 7fe2fea00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 0x7fe2e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:41.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.829+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe300096ea0 con 0x7fe3081535c0 2024-06-02T16:45:41.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.830+0000 7fe306a00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 0x7fe2e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:41.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.831+0000 7fe306a00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 0x7fe2e4078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8033000 tx=0x7fe2f8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:41.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:41.834+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe30001a020 con 0x7fe3081535c0 2024-06-02T16:45:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.047+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe308156a90 con 0x7fe3081535c0 2024-06-02T16:45:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.050+0000 7fe2fea00640 1 -- 172.21.15.52:0/3772292401 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7fe3000606d0 con 0x7fe3081535c0 2024-06-02T16:45:42.050 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:42.050 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 msgr2=0x7fe2e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 0x7fe2e4078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8033000 tx=0x7fe2f8008030 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 msgr2=0x7fe308153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe308160050 tx=0x7fe30000cc00 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 shutdown_connections 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2e40762d0 0x7fe2e4078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3081535c0 0x7fe308153a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe30814b340 0x7fe30815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 --2- 172.21.15.52:0/3772292401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec003a50 0x7fe308159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 >> 172.21.15.52:0/3772292401 conn(0x7fe30806c7a0 msgr2=0x7fe3080b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 shutdown_connections 2024-06-02T16:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.053+0000 7fe30dc00640 1 -- 172.21.15.52:0/3772292401 wait complete. 2024-06-02T16:45:42.074 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T16:45:00.031102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T16:45:09.761692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T16:45:10.725639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T16:45:42.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T16:45:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.281+0000 7f9a14a00640 1 Processor -- start 2024-06-02T16:45:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.282+0000 7f9a14a00640 1 -- start start 2024-06-02T16:45:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.283+0000 7f9a14a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 0x7f9a10163930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a14a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a1006fda0 0x7f9a10070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a14a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a10160360 con 0x7f9a100b3f40 2024-06-02T16:45:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a14a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9a10160120 con 0x7f9a1006fda0 2024-06-02T16:45:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a14a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9a10160920 con 0x7f9a10073c20 2024-06-02T16:45:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a0d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a100b3f40 0x7f9a1015fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57958/0 (socket says 172.21.15.52:57958) 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a0d400640 1 -- 172.21.15.52:0/3782002684 learned_addr learned my addr 172.21.15.52:0/3782002684 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a0de00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 0x7f9a10163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.284+0000 7f9a0e800640 1 --2- 172.21.15.52:0/3782002684 >> v2:172.21.15.114:3300/0 conn(0x7f9a1006fda0 0x7f9a10070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641769621 0 0) 0x7f9a10160360 con 0x7f9a100b3f40 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f0003520 con 0x7f9a100b3f40 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 216950063 0 0) 0x7f99f0003520 con 0x7f9a100b3f40 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 msgr2=0x7f9a10163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 0x7f9a10163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 >> v2:172.21.15.114:3300/0 conn(0x7f9a1006fda0 msgr2=0x7f9a10070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 --2- 172.21.15.52:0/3782002684 >> v2:172.21.15.114:3300/0 conn(0x7f9a1006fda0 0x7f9a10070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a10160640 con 0x7f9a100b3f40 2024-06-02T16:45:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f99f8001a70 con 0x7f9a100b3f40 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 >> v1:172.21.15.52:6789/0 conn(0x7f9a100b3f40 legacy=0x7f9a1015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f0003a50 0x7f99f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0004800 0x7f99f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 0x7f99f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10160120 con 0x7f99f0003a50 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10160920 con 0x7f99f0004800 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.285+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f99f000baa0 con 0x7f9a10073c20 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f0003a50 0x7f99f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0d400640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0004800 0x7f99f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 -- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 msgr2=0x7f99f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a10073c20 0x7f99f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 -- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0004800 msgr2=0x7f99f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0004800 0x7f99f0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.286+0000 7f9a0de00640 1 -- 172.21.15.52:0/3782002684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f0003520 con 0x7f99f0003a50 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.287+0000 7f9a0de00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f0003a50 0x7f99f0003e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009a90 tx=0x7f99f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da67214de7f71ca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.287+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00036070 con 0x7f99f0003a50 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.287+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00031400 con 0x7f99f0003a50 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.287+0000 7f9a0ca00640 1 -- 172.21.15.52:0/3782002684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00009690 con 0x7f99f0003a50 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 -- 172.21.15.52:0/3782002684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f0003a50 msgr2=0x7f99f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 --2- 172.21.15.52:0/3782002684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f0003a50 0x7f99f0003e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009a90 tx=0x7f99f0005830 comp rx=0 tx=0).stop 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a0e800640 1 -- 172.21.15.52:0/3782002684 reap_dead start 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 -- 172.21.15.52:0/3782002684 shutdown_connections 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 -- 172.21.15.52:0/3782002684 >> 172.21.15.52:0/3782002684 conn(0x7f9a100b3200 msgr2=0x7f9a100d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 -- 172.21.15.52:0/3782002684 shutdown_connections 2024-06-02T16:45:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.288+0000 7f9a14a00640 1 -- 172.21.15.52:0/3782002684 wait complete. 2024-06-02T16:45:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.290+0000 7f9a14a00640 1 Processor -- start 2024-06-02T16:45:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.290+0000 7f9a14a00640 1 -- start start 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0003a50 0x7f9a101468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a101f9c40 0x7f9a10158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10163930 con 0x7f9a101f97c0 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10163410 con 0x7f99f0003a50 2024-06-02T16:45:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a14a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9a10163ab0 con 0x7f9a101f9c40 2024-06-02T16:45:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.291+0000 7f9a0d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56544/0 (socket says 172.21.15.52:56544) 2024-06-02T16:45:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 -- 172.21.15.52:0/2833571337 learned_addr learned my addr 172.21.15.52:0/2833571337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0e800640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a101f9c40 0x7f9a10158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0de00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0003a50 0x7f9a101468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 -- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a101f9c40 msgr2=0x7f9a10158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a101f9c40 0x7f9a10158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 -- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0003a50 msgr2=0x7f9a101468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0003a50 0x7f9a101468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 -- 172.21.15.52:0/2833571337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101f5d60 con 0x7f9a101f97c0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.292+0000 7f9a0d400640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99f8001a40 tx=0x7f99f800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.293+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8019070 con 0x7f9a101f97c0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.293+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f800bb50 con 0x7f9a101f97c0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.293+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f80070d0 con 0x7f9a101f97c0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.293+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a101f6040 con 0x7f9a101f97c0 2024-06-02T16:45:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.293+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101f6600 con 0x7f9a101f97c0 2024-06-02T16:45:42.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.294+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a100b4fb0 con 0x7f9a101f97c0 2024-06-02T16:45:42.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.295+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99f801c070 con 0x7f9a101f97c0 2024-06-02T16:45:42.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.296+0000 7f9a06000640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 0x7f99ec0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.296+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f99f80974d0 con 0x7f9a101f97c0 2024-06-02T16:45:42.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.297+0000 7f9a0de00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 0x7f99ec0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.298+0000 7f9a0de00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 0x7f99ec0787c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a00033000 tx=0x7f9a00008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.301+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9a100b4fb0 con 0x7f9a101f97c0 2024-06-02T16:45:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.511+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a10163e90 con 0x7f9a101f97c0 2024-06-02T16:45:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.512+0000 7f9a06000640 1 -- 172.21.15.52:0/2833571337 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f9a10163e90 con 0x7f9a101f97c0 2024-06-02T16:45:42.512 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-06-02T16:45:42.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 msgr2=0x7f99ec0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 0x7f99ec0787c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a00033000 tx=0x7f9a00008030 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 msgr2=0x7f9a10158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99f8001a40 tx=0x7f99f800b4a0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 shutdown_connections 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99ec076300 0x7f99ec0787c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a101f9c40 0x7f9a10158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a101f97c0 0x7f9a10158410 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 --2- 172.21.15.52:0/2833571337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99f0003a50 0x7f9a101468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 >> 172.21.15.52:0/2833571337 conn(0x7f9a100b3200 msgr2=0x7f9a10160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 shutdown_connections 2024-06-02T16:45:42.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.515+0000 7f9a14a00640 1 -- 172.21.15.52:0/2833571337 wait complete. 2024-06-02T16:45:42.534 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T16:45:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.753+0000 7f1c70a00640 1 Processor -- start 2024-06-02T16:45:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.753+0000 7f1c70a00640 1 -- start start 2024-06-02T16:45:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.755+0000 7f1c70a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c6c15d330 0x7f1c6c073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.755+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0734f0 0x7f1c6c074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.755+0000 7f1c70a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c070650 con 0x7f1c6c0ade40 2024-06-02T16:45:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.755+0000 7f1c70a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6c072450 con 0x7f1c6c15d330 2024-06-02T16:45:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.755+0000 7f1c70a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c072730 con 0x7f1c6c0734f0 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.756+0000 7f1c6b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c6c15d330 0x7f1c6c073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.756+0000 7f1c6b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c6c15d330 0x7f1c6c073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:41532/0 (socket says 172.21.15.52:41532) 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.756+0000 7f1c6be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c6c0ade40 0x7f1c6c160d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:42066/0 (socket says 172.21.15.52:42066) 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.756+0000 7f1c6b400640 1 -- 172.21.15.52:0/3785528194 learned_addr learned my addr 172.21.15.52:0/3785528194 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.756+0000 7f1c6aa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0734f0 0x7f1c6c074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.757+0000 7f1c6b400640 1 -- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0734f0 msgr2=0x7f1c6c074060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.757+0000 7f1c6b400640 1 --2- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0734f0 0x7f1c6c074060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.757+0000 7f1c6b400640 1 -- 172.21.15.52:0/3785528194 >> v1:172.21.15.114:6789/0 conn(0x7f1c6c0ade40 legacy=0x7f1c6c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.757+0000 7f1c6b400640 1 -- 172.21.15.52:0/3785528194 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c072a10 con 0x7f1c6c15d330 2024-06-02T16:45:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.758+0000 7f1c6b400640 1 --2- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c15d330 0x7f1c6c073b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009870 tx=0x7f1c5c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be750b18f285d0c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.759+0000 7f1c6a000640 1 -- 172.21.15.52:0/3785528194 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c037070 con 0x7f1c6c15d330 2024-06-02T16:45:42.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.759+0000 7f1c6a000640 1 -- 172.21.15.52:0/3785528194 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5c032440 con 0x7f1c6c15d330 2024-06-02T16:45:42.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.759+0000 7f1c6a000640 1 -- 172.21.15.52:0/3785528194 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c032810 con 0x7f1c6c15d330 2024-06-02T16:45:42.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.759+0000 7f1c70a00640 1 -- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c15d330 msgr2=0x7f1c6c073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.759+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c15d330 0x7f1c6c073b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009870 tx=0x7f1c5c02a270 comp rx=0 tx=0).stop 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 -- 172.21.15.52:0/3785528194 shutdown_connections 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0734f0 0x7f1c6c074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3785528194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c15d330 0x7f1c6c073b20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 -- 172.21.15.52:0/3785528194 >> 172.21.15.52:0/3785528194 conn(0x7f1c6c0b2b60 msgr2=0x7f1c6c0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 -- 172.21.15.52:0/3785528194 shutdown_connections 2024-06-02T16:45:42.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.760+0000 7f1c70a00640 1 -- 172.21.15.52:0/3785528194 wait complete. 2024-06-02T16:45:42.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.762+0000 7f1c70a00640 1 Processor -- start 2024-06-02T16:45:42.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.762+0000 7f1c70a00640 1 -- start start 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c0734f0 0x7f1c6c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0ade40 0x7f1c6c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c0ae2d0 con 0x7f1c6c15d330 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c072fd0 con 0x7f1c6c0734f0 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c70a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c0ae450 con 0x7f1c6c0ade40 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56546/0 (socket says 172.21.15.52:56546) 2024-06-02T16:45:42.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c6be00640 1 -- 172.21.15.52:0/3041942786 learned_addr learned my addr 172.21.15.52:0/3041942786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c6b400640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c0734f0 0x7f1c6c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.763+0000 7f1c6aa00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0ade40 0x7f1c6c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 -- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0ade40 msgr2=0x7f1c6c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0ade40 0x7f1c6c0b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 -- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c0734f0 msgr2=0x7f1c6c0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c0734f0 0x7f1c6c0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 -- 172.21.15.52:0/3041942786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c15add0 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c6be00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c710 tx=0x7f1c6400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64017070 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6400ce20 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c15f5b0 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400a7e0 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.764+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c15b330 con 0x7f1c6c15d330 2024-06-02T16:45:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.765+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c0507e0 con 0x7f1c6c15d330 2024-06-02T16:45:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.767+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c6401a070 con 0x7f1c6c15d330 2024-06-02T16:45:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.768+0000 7f1c63400640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 0x7f1c4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.768+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c64096a00 con 0x7f1c6c15d330 2024-06-02T16:45:42.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.768+0000 7f1c6b400640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 0x7f1c4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:42.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.769+0000 7f1c6b400640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 0x7f1c4c078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c034000 tx=0x7f1c5c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.772+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c6c15add0 con 0x7f1c6c15d330 2024-06-02T16:45:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.981+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c6c161b60 con 0x7f1c6c15d330 2024-06-02T16:45:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.982+0000 7f1c63400640 1 -- 172.21.15.52:0/3041942786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f1c6405fd00 con 0x7f1c6c15d330 2024-06-02T16:45:42.982 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-06-02T16:45:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.984+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 msgr2=0x7f1c4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.984+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 0x7f1c4c078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c034000 tx=0x7f1c5c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 msgr2=0x7f1c6c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c710 tx=0x7f1c6400cbd0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 shutdown_connections 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c4c0762d0 0x7f1c4c078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c6c15d330 0x7f1c6c15e7f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c6c0ade40 0x7f1c6c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 --2- 172.21.15.52:0/3041942786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c6c0734f0 0x7f1c6c0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 >> 172.21.15.52:0/3041942786 conn(0x7f1c6c0b2b60 msgr2=0x7f1c6c160cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 shutdown_connections 2024-06-02T16:45:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:42.985+0000 7f1c70a00640 1 -- 172.21.15.52:0/3041942786 wait complete. 2024-06-02T16:45:43.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T16:45:43.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.219+0000 7ff119400640 1 Processor -- start 2024-06-02T16:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.219+0000 7ff119400640 1 -- start start 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff119400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff114074230 0x7ff1140ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff119400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1140734f0 0x7ff1140ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff119400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff114070650 con 0x7ff11415d330 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff119400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff114072450 con 0x7ff1140734f0 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff119400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff114072730 con 0x7ff114074230 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff118a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1140734f0 0x7ff1140ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff118a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1140734f0 0x7ff1140ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58312/0 (socket says 172.21.15.52:58312) 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff118a00640 1 -- 172.21.15.52:0/3815375147 learned_addr learned my addr 172.21.15.52:0/3815375147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.221+0000 7ff10be00640 1 --2- 172.21.15.52:0/3815375147 >> v2:172.21.15.114:3300/0 conn(0x7ff114074230 0x7ff1140ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.222+0000 7ff118a00640 1 -- 172.21.15.52:0/3815375147 >> v2:172.21.15.114:3300/0 conn(0x7ff114074230 msgr2=0x7ff1140ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.222+0000 7ff118a00640 1 --2- 172.21.15.52:0/3815375147 >> v2:172.21.15.114:3300/0 conn(0x7ff114074230 0x7ff1140ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.222+0000 7ff118a00640 1 -- 172.21.15.52:0/3815375147 >> v1:172.21.15.114:6789/0 conn(0x7ff11415d330 legacy=0x7ff114073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.222+0000 7ff118a00640 1 -- 172.21.15.52:0/3815375147 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff114072a10 con 0x7ff1140734f0 2024-06-02T16:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.223+0000 7ff118a00640 1 --2- 172.21.15.52:0/3815375147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1140734f0 0x7ff1140ae380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff11406a220 tx=0x7ff10c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3910247bc51c7e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.223+0000 7ff113400640 1 -- 172.21.15.52:0/3815375147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c036070 con 0x7ff1140734f0 2024-06-02T16:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.223+0000 7ff113400640 1 -- 172.21.15.52:0/3815375147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c031600 con 0x7ff1140734f0 2024-06-02T16:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.223+0000 7ff113400640 1 -- 172.21.15.52:0/3815375147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0319d0 con 0x7ff1140734f0 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 -- 172.21.15.52:0/3815375147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1140734f0 msgr2=0x7ff1140ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 --2- 172.21.15.52:0/3815375147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1140734f0 0x7ff1140ae380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff11406a220 tx=0x7ff10c02a6a0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 -- 172.21.15.52:0/3815375147 shutdown_connections 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 --2- 172.21.15.52:0/3815375147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1140734f0 0x7ff1140ae380 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 --2- 172.21.15.52:0/3815375147 >> v2:172.21.15.114:3300/0 conn(0x7ff114074230 0x7ff1140ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 -- 172.21.15.52:0/3815375147 >> 172.21.15.52:0/3815375147 conn(0x7ff1140b2b60 msgr2=0x7ff1140b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 -- 172.21.15.52:0/3815375147 shutdown_connections 2024-06-02T16:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.224+0000 7ff119400640 1 -- 172.21.15.52:0/3815375147 wait complete. 2024-06-02T16:45:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.226+0000 7ff119400640 1 Processor -- start 2024-06-02T16:45:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.226+0000 7ff119400640 1 -- start start 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1140734f0 0x7ff114160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff114074230 0x7ff11415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff11406e410 con 0x7ff11415d330 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff114072fd0 con 0x7ff1140734f0 2024-06-02T16:45:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff119400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff11406e590 con 0x7ff114074230 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff118a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff118a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58322/0 (socket says 172.21.15.52:58322) 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff118a00640 1 -- 172.21.15.52:0/4166908964 learned_addr learned my addr 172.21.15.52:0/4166908964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.227+0000 7ff113e00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1140734f0 0x7ff114160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 -- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff114074230 msgr2=0x7ff11415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff114074230 0x7ff11415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 -- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1140734f0 msgr2=0x7ff114160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1140734f0 0x7ff114160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 -- 172.21.15.52:0/4166908964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11415f0f0 con 0x7ff11415d330 2024-06-02T16:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff118a00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff10c02ac90 tx=0x7ff10c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c036050 con 0x7ff11415d330 2024-06-02T16:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c042070 con 0x7ff11415d330 2024-06-02T16:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11415f3d0 con 0x7ff11415d330 2024-06-02T16:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c009510 con 0x7ff11415d330 2024-06-02T16:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.228+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11415f990 con 0x7ff11415d330 2024-06-02T16:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.229+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1140507e0 con 0x7ff11415d330 2024-06-02T16:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.231+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff10c007bf0 con 0x7ff11415d330 2024-06-02T16:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.232+0000 7ff110c00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 0x7ff0f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.232+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff10c0b83f0 con 0x7ff11415d330 2024-06-02T16:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.232+0000 7ff113e00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 0x7ff0f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.234+0000 7ff113e00640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 0x7ff0f0078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.237+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff10c081d40 con 0x7ff11415d330 2024-06-02T16:45:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.451+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff1140af630 con 0x7ff11415d330 2024-06-02T16:45:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.454+0000 7ff110c00640 1 -- 172.21.15.52:0/4166908964 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7ff10c081640 con 0x7ff11415d330 2024-06-02T16:45:43.454 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-06-02T16:45:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 msgr2=0x7ff0f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 0x7ff0f0078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104008040 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 msgr2=0x7ff1141546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff10c02ac90 tx=0x7ff10c004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 shutdown_connections 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff0f00762d0 0x7ff0f0078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11415d330 0x7ff1141546a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff114074230 0x7ff11415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 --2- 172.21.15.52:0/4166908964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1140734f0 0x7ff114160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.457+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 >> 172.21.15.52:0/4166908964 conn(0x7ff1140b2b60 msgr2=0x7ff11406e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.458+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 shutdown_connections 2024-06-02T16:45:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.458+0000 7ff119400640 1 -- 172.21.15.52:0/4166908964 wait complete. 2024-06-02T16:45:43.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-06-02T16:45:43.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.691+0000 7f34df200640 1 Processor -- start 2024-06-02T16:45:43.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.691+0000 7f34df200640 1 -- start start 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.693+0000 7f34df200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34e01577f0 0x7f34e0073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.693+0000 7f34df200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e0073fb0 0x7f34e006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.693+0000 7f34df200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e0160c80 con 0x7f34e006e670 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.693+0000 7f34df200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f34e006ead0 con 0x7f34e01577f0 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.693+0000 7f34df200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f34e0073350 con 0x7f34e0073fb0 2024-06-02T16:45:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.694+0000 7f34dde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34e01577f0 0x7f34e0073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.694+0000 7f34dde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34e01577f0 0x7f34e0073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:34652/0 (socket says 172.21.15.52:34652) 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.694+0000 7f34dde00640 1 -- 172.21.15.52:0/328175624 learned_addr learned my addr 172.21.15.52:0/328175624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.694+0000 7f34dd400640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e0073fb0 0x7f34e006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.695+0000 7f34dde00640 1 -- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e0073fb0 msgr2=0x7f34e006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.695+0000 7f34dde00640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e0073fb0 0x7f34e006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.695+0000 7f34dde00640 1 -- 172.21.15.52:0/328175624 >> v1:172.21.15.114:6789/0 conn(0x7f34e006e670 legacy=0x7f34e00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.695+0000 7f34dde00640 1 -- 172.21.15.52:0/328175624 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0160f60 con 0x7f34e01577f0 2024-06-02T16:45:43.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.696+0000 7f34dde00640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e01577f0 0x7f34e0073a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009e50 tx=0x7f34d002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f5f2b4684a89bd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.697+0000 7f34dca00640 1 -- 172.21.15.52:0/328175624 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0036070 con 0x7f34e01577f0 2024-06-02T16:45:43.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.697+0000 7f34dca00640 1 -- 172.21.15.52:0/328175624 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d0031600 con 0x7f34e01577f0 2024-06-02T16:45:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.697+0000 7f34dca00640 1 -- 172.21.15.52:0/328175624 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d00319d0 con 0x7f34e01577f0 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 -- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e01577f0 msgr2=0x7f34e0073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e01577f0 0x7f34e0073a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009e50 tx=0x7f34d002a710 comp rx=0 tx=0).stop 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 -- 172.21.15.52:0/328175624 shutdown_connections 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e0073fb0 0x7f34e006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 --2- 172.21.15.52:0/328175624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e01577f0 0x7f34e0073a70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 -- 172.21.15.52:0/328175624 >> 172.21.15.52:0/328175624 conn(0x7f34e006c380 msgr2=0x7f34e006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 -- 172.21.15.52:0/328175624 shutdown_connections 2024-06-02T16:45:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.698+0000 7f34df200640 1 -- 172.21.15.52:0/328175624 wait complete. 2024-06-02T16:45:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.700+0000 7f34df200640 1 Processor -- start 2024-06-02T16:45:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.700+0000 7f34df200640 1 -- start start 2024-06-02T16:45:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e006e670 0x7f34e00b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e01577f0 0x7f34e00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34e015e510 con 0x7f34e0073fb0 2024-06-02T16:45:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0161520 con 0x7f34e006e670 2024-06-02T16:45:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34df200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f34e0161a40 con 0x7f34e01577f0 2024-06-02T16:45:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.701+0000 7f34dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58326/0 (socket says 172.21.15.52:58326) 2024-06-02T16:45:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 -- 172.21.15.52:0/3286941853 learned_addr learned my addr 172.21.15.52:0/3286941853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34de800640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e01577f0 0x7f34e00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dde00640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e006e670 0x7f34e00b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 -- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e01577f0 msgr2=0x7f34e00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e01577f0 0x7f34e00c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 -- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e006e670 msgr2=0x7f34e00b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e006e670 0x7f34e00b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 -- 172.21.15.52:0/3286941853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e00b41c0 con 0x7f34e0073fb0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.702+0000 7f34dd400640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f34c800e9b0 tx=0x7f34c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.703+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8017070 con 0x7f34e0073fb0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.703+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c800c9a0 con 0x7f34e0073fb0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.703+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e00aef80 con 0x7f34e0073fb0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.703+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c800cd90 con 0x7f34e0073fb0 2024-06-02T16:45:43.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.703+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e00af540 con 0x7f34e0073fb0 2024-06-02T16:45:43.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.704+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e0075ea0 con 0x7f34e0073fb0 2024-06-02T16:45:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.705+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34c801a070 con 0x7f34e0073fb0 2024-06-02T16:45:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.706+0000 7f34d6000640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 0x7f34bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.706+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f34c8097650 con 0x7f34e0073fb0 2024-06-02T16:45:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.707+0000 7f34dde00640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 0x7f34bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.709+0000 7f34dde00640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 0x7f34bc078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f34d0033000 tx=0x7f34d0009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.711+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f34c8060fa0 con 0x7f34e0073fb0 2024-06-02T16:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:43.999+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f34e006f070 con 0x7f34e0073fb0 2024-06-02T16:45:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.464+0000 7f34d6000640 1 -- 172.21.15.52:0/3286941853 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v51) ==== 151+0+0 (secure 0 0 0) 0x7f34c80608a0 con 0x7f34e0073fb0 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 msgr2=0x7f34bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 0x7f34bc078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f34d0033000 tx=0x7f34d0009000 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 msgr2=0x7f34e00ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f34c800e9b0 tx=0x7f34c800ee70 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 shutdown_connections 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f34bc0762d0 0x7f34bc078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34e01577f0 0x7f34e00c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34e0073fb0 0x7f34e00ae830 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 --2- 172.21.15.52:0/3286941853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e006e670 0x7f34e00b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 >> 172.21.15.52:0/3286941853 conn(0x7f34e006c380 msgr2=0x7f34e0159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:44.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 shutdown_connections 2024-06-02T16:45:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.468+0000 7f34df200640 1 -- 172.21.15.52:0/3286941853 wait complete. 2024-06-02T16:45:44.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T16:45:44.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.713+0000 7f9c50e00640 1 Processor -- start 2024-06-02T16:45:44.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.714+0000 7f9c50e00640 1 -- start start 2024-06-02T16:45:44.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.715+0000 7f9c50e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 0x7f9c4c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c50e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c0aeef0 con 0x7f9c4c159eb0 2024-06-02T16:45:44.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c50e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c0af1d0 con 0x7f9c4c073b60 2024-06-02T16:45:44.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c50e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c0af4b0 con 0x7f9c4c06e410 2024-06-02T16:45:44.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c4b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9c4c159eb0 0x7f9c4c073450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54726/0 (socket says 172.21.15.52:54726) 2024-06-02T16:45:44.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c4b400640 1 -- 172.21.15.52:0/596102303 learned_addr learned my addr 172.21.15.52:0/596102303 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:44.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 0x7f9c4c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.716+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740504456 0 0) 0x7f9c4c0aeef0 con 0x7f9c4c159eb0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c30003520 con 0x7f9c4c159eb0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474519113 0 0) 0x7f9c30003520 con 0x7f9c4c159eb0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 msgr2=0x7f9c4c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 0x7f9c4c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 >> v1:172.21.15.114:6789/0 conn(0x7f9c4c073b60 legacy=0x7f9c4c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c0af790 con 0x7f9c4c159eb0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f9c3c0016f0 con 0x7f9c4c159eb0 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 >> v1:172.21.15.52:6789/0 conn(0x7f9c4c159eb0 legacy=0x7f9c4c073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c30003a30 0x7f9c30003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004800 0x7f9c30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 0x7f9c3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c0af4b0 con 0x7f9c30004800 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30005520 con 0x7f9c30003a30 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3000e110 con 0x7f9c4c06e410 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.717+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004800 0x7f9c30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4b400640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c30003a30 0x7f9c30003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4aa00640 1 -- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 msgr2=0x7f9c3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c4c06e410 0x7f9c3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4aa00640 1 -- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c30003a30 msgr2=0x7f9c30003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c30003a30 0x7f9c30003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4aa00640 1 -- 172.21.15.52:0/596102303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30003520 con 0x7f9c30004800 2024-06-02T16:45:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.718+0000 7f9c4b400640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c30003a30 0x7f9c30003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:44.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.719+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004800 0x7f9c30004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400ba30 tx=0x7f9c30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0bef4960e71d60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:44.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.719+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34030070 con 0x7f9c30004800 2024-06-02T16:45:44.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.719+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3402ae10 con 0x7f9c30004800 2024-06-02T16:45:44.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.719+0000 7f9c4a000640 1 -- 172.21.15.52:0/596102303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400b600 con 0x7f9c30004800 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 -- 172.21.15.52:0/596102303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004800 msgr2=0x7f9c30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 --2- 172.21.15.52:0/596102303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c30004800 0x7f9c30004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400ba30 tx=0x7f9c30005830 comp rx=0 tx=0).stop 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c4be00640 1 -- 172.21.15.52:0/596102303 reap_dead start 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 -- 172.21.15.52:0/596102303 shutdown_connections 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 -- 172.21.15.52:0/596102303 >> 172.21.15.52:0/596102303 conn(0x7f9c4c0b2b60 msgr2=0x7f9c4c0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 -- 172.21.15.52:0/596102303 shutdown_connections 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.720+0000 7f9c50e00640 1 -- 172.21.15.52:0/596102303 wait complete. 2024-06-02T16:45:44.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.722+0000 7f9c50e00640 1 Processor -- start 2024-06-02T16:45:44.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.722+0000 7f9c50e00640 1 -- start start 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c30004800 0x7f9c4c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c4c0b13e0 0x7f9c4c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c0aeba0 con 0x7f9c4c09bce0 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c0b6100 con 0x7f9c4c0b13e0 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.723+0000 7f9c50e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c0aff90 con 0x7f9c30004800 2024-06-02T16:45:44.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58348/0 (socket says 172.21.15.52:58348) 2024-06-02T16:45:44.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 -- 172.21.15.52:0/447333050 learned_addr learned my addr 172.21.15.52:0/447333050 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4b400640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c30004800 0x7f9c4c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4aa00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c4c0b13e0 0x7f9c4c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 -- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c30004800 msgr2=0x7f9c4c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c30004800 0x7f9c4c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 -- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c4c0b13e0 msgr2=0x7f9c4c0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c4c0b13e0 0x7f9c4c0b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.724+0000 7f9c4be00640 1 -- 172.21.15.52:0/447333050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c09cab0 con 0x7f9c4c09bce0 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c4be00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c073fb0 tx=0x7f9c4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44007070 con 0x7f9c4c09bce0 2024-06-02T16:45:44.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c44007210 con 0x7f9c4c09bce0 2024-06-02T16:45:44.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44007600 con 0x7f9c4c09bce0 2024-06-02T16:45:44.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c09d2b0 con 0x7f9c4c09bce0 2024-06-02T16:45:44.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.725+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c09d870 con 0x7f9c4c09bce0 2024-06-02T16:45:44.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.726+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4c09da70 con 0x7f9c4c09bce0 2024-06-02T16:45:44.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.727+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c44011070 con 0x7f9c4c09bce0 2024-06-02T16:45:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.728+0000 7f9c43400640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 0x7f9c280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.728+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c44096610 con 0x7f9c4c09bce0 2024-06-02T16:45:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.729+0000 7f9c4b400640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 0x7f9c280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:44.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.730+0000 7f9c4b400640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 0x7f9c280787c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000fb0 tx=0x7f9c3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.734+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c4c09da70 con 0x7f9c4c09bce0 2024-06-02T16:45:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.950+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9c4c0507e0 con 0x7f9c4c09bce0 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.957+0000 7f9c43400640 1 -- 172.21.15.52:0/447333050 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f9c44019060 con 0x7f9c4c09bce0 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 msgr2=0x7f9c280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 0x7f9c280787c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000fb0 tx=0x7f9c3c009040 comp rx=0 tx=0).stop 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 msgr2=0x7f9c4c09c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c073fb0 tx=0x7f9c4400c8e0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 shutdown_connections 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9c28076300 0x7f9c280787c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c4c09bce0 0x7f9c4c09c160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c4c0b13e0 0x7f9c4c0b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 --2- 172.21.15.52:0/447333050 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9c30004800 0x7f9c4c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.960+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 >> 172.21.15.52:0/447333050 conn(0x7f9c4c0b2b60 msgr2=0x7f9c4c072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.961+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 shutdown_connections 2024-06-02T16:45:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:44.961+0000 7f9c50e00640 1 -- 172.21.15.52:0/447333050 wait complete. 2024-06-02T16:45:45.074 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T16:45:45.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:45:45.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:45:45.329 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T16:45:45.329 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:45.329 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:45.390 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:45.391 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:45.449 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:45.449 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:45.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:45:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.720+0000 7f9a44e00640 1 Processor -- start 2024-06-02T16:45:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.720+0000 7f9a44e00640 1 -- start start 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a44e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a400cd890 0x7f9a400ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a44e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a4006e130 0x7f9a4006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a44e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a400cef00 con 0x7f9a4015d010 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a44e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9a400cf1e0 con 0x7f9a4006e130 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a44e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9a40160dc0 con 0x7f9a400cd890 2024-06-02T16:45:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a3fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a4006e130 0x7f9a4006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a3fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a4006e130 0x7f9a4006e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58362/0 (socket says 172.21.15.52:58362) 2024-06-02T16:45:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.722+0000 7f9a3fe00640 1 -- 172.21.15.52:0/751110892 learned_addr learned my addr 172.21.15.52:0/751110892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.723+0000 7f9a3ea00640 1 --2- 172.21.15.52:0/751110892 >> v2:172.21.15.114:3300/0 conn(0x7f9a400cd890 0x7f9a400ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.723+0000 7f9a3fe00640 1 -- 172.21.15.52:0/751110892 >> v2:172.21.15.114:3300/0 conn(0x7f9a400cd890 msgr2=0x7f9a400ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.723+0000 7f9a3fe00640 1 --2- 172.21.15.52:0/751110892 >> v2:172.21.15.114:3300/0 conn(0x7f9a400cd890 0x7f9a400ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.723+0000 7f9a3fe00640 1 -- 172.21.15.52:0/751110892 >> v1:172.21.15.114:6789/0 conn(0x7f9a4015d010 legacy=0x7f9a401615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.723+0000 7f9a3fe00640 1 -- 172.21.15.52:0/751110892 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a401610a0 con 0x7f9a4006e130 2024-06-02T16:45:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.724+0000 7f9a3fe00640 1 --2- 172.21.15.52:0/751110892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a4006e130 0x7f9a4006e5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9a40071fc0 tx=0x7f9a3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7c9033b9ce12f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.724+0000 7f9a3e000640 1 -- 172.21.15.52:0/751110892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38037070 con 0x7f9a4006e130 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.724+0000 7f9a3e000640 1 -- 172.21.15.52:0/751110892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38032440 con 0x7f9a4006e130 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.724+0000 7f9a3e000640 1 -- 172.21.15.52:0/751110892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38032810 con 0x7f9a4006e130 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 -- 172.21.15.52:0/751110892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a4006e130 msgr2=0x7f9a4006e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 --2- 172.21.15.52:0/751110892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a4006e130 0x7f9a4006e5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9a40071fc0 tx=0x7f9a3802a270 comp rx=0 tx=0).stop 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 -- 172.21.15.52:0/751110892 shutdown_connections 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 --2- 172.21.15.52:0/751110892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a4006e130 0x7f9a4006e5c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 --2- 172.21.15.52:0/751110892 >> v2:172.21.15.114:3300/0 conn(0x7f9a400cd890 0x7f9a400ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 -- 172.21.15.52:0/751110892 >> 172.21.15.52:0/751110892 conn(0x7f9a4006c380 msgr2=0x7f9a4006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 -- 172.21.15.52:0/751110892 shutdown_connections 2024-06-02T16:45:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.725+0000 7f9a44e00640 1 -- 172.21.15.52:0/751110892 wait complete. 2024-06-02T16:45:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.727+0000 7f9a44e00640 1 Processor -- start 2024-06-02T16:45:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.727+0000 7f9a44e00640 1 -- start start 2024-06-02T16:45:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 0x7f9a4014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a4015d010 0x7f9a400b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4015d570 con 0x7f9a400cd890 2024-06-02T16:45:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4015d3f0 con 0x7f9a4006e130 2024-06-02T16:45:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.728+0000 7f9a44e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4015d6f0 con 0x7f9a4015d010 2024-06-02T16:45:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58366/0 (socket says 172.21.15.52:58366) 2024-06-02T16:45:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 -- 172.21.15.52:0/616419811 learned_addr learned my addr 172.21.15.52:0/616419811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3f400640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 0x7f9a4014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 -- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a4015d010 msgr2=0x7f9a400b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a4015d010 0x7f9a400b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 -- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 msgr2=0x7f9a4014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 0x7f9a4014ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3ea00640 1 -- 172.21.15.52:0/616419811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4015eb70 con 0x7f9a400cd890 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.729+0000 7f9a3f400640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 0x7f9a4014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a3ea00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e930 tx=0x7f9a2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28017070 con 0x7f9a400cd890 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2800ca00 con 0x7f9a400cd890 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800cdf0 con 0x7f9a400cd890 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a401e7e30 con 0x7f9a400cd890 2024-06-02T16:45:45.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.730+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4015ee10 con 0x7f9a400cd890 2024-06-02T16:45:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.731+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a401e8350 con 0x7f9a400cd890 2024-06-02T16:45:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.732+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a2801a070 con 0x7f9a400cd890 2024-06-02T16:45:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.733+0000 7f9a37400640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 0x7f9a1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.733+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9a28097640 con 0x7f9a400cd890 2024-06-02T16:45:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.734+0000 7f9a3f400640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 0x7f9a1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.735+0000 7f9a3f400640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 0x7f9a1c0787c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a300012e0 tx=0x7f9a30009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.738+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9a401e8350 con 0x7f9a400cd890 2024-06-02T16:45:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.964+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a400507e0 con 0x7f9a400cd890 2024-06-02T16:45:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.965+0000 7f9a37400640 1 -- 172.21.15.52:0/616419811 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f9a28061060 con 0x7f9a400cd890 2024-06-02T16:45:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 msgr2=0x7f9a1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 0x7f9a1c0787c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a300012e0 tx=0x7f9a30009040 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 msgr2=0x7f9a401e7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e930 tx=0x7f9a2800edf0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 shutdown_connections 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9a1c076300 0x7f9a1c0787c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a4015d010 0x7f9a400b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a400cd890 0x7f9a401e7450 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 --2- 172.21.15.52:0/616419811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4006e130 0x7f9a4014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 >> 172.21.15.52:0/616419811 conn(0x7f9a4006c380 msgr2=0x7f9a40073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 shutdown_connections 2024-06-02T16:45:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:45.968+0000 7f9a44e00640 1 -- 172.21.15.52:0/616419811 wait complete. 2024-06-02T16:45:45.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-02T16:45:45.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:45.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-06-02T16:45:46.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:45:46.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:46.081 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T16:45:46.145 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:46.145 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:46.204 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:46.204 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:46.256 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:46.256 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:46.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:45:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.533+0000 7f61ad200640 1 Processor -- start 2024-06-02T16:45:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.533+0000 7f61ad200640 1 -- start start 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61ad200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61ad200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61a8144a20 0x7f61a81603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61ad200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a80b57e0 con 0x7f61a8141e10 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61ad200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f61a8072400 con 0x7f61a8144a20 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61ad200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f61a8144fe0 con 0x7f61a806e840 2024-06-02T16:45:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61a8144a20 0x7f61a81603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61a8144a20 0x7f61a81603a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58376/0 (socket says 172.21.15.52:58376) 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 -- 172.21.15.52:0/776550433 learned_addr learned my addr 172.21.15.52:0/776550433 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f619fe00640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 -- 172.21.15.52:0/776550433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 msgr2=0x7f61a80b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a80b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 -- 172.21.15.52:0/776550433 >> v1:172.21.15.114:6789/0 conn(0x7f61a8141e10 legacy=0x7f61a806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.535+0000 7f61a7e00640 1 -- 172.21.15.52:0/776550433 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a81452c0 con 0x7f61a8144a20 2024-06-02T16:45:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.536+0000 7f61a7e00640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a81603a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009e50 tx=0x7f61a002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a41730a14cbc8a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61a6a00640 1 -- 172.21.15.52:0/776550433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0036070 con 0x7f61a8144a20 2024-06-02T16:45:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61a6a00640 1 -- 172.21.15.52:0/776550433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0031600 con 0x7f61a8144a20 2024-06-02T16:45:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61a6a00640 1 -- 172.21.15.52:0/776550433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00319d0 con 0x7f61a8144a20 2024-06-02T16:45:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 -- 172.21.15.52:0/776550433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 msgr2=0x7f61a81603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a81603a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009e50 tx=0x7f61a002a680 comp rx=0 tx=0).stop 2024-06-02T16:45:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 -- 172.21.15.52:0/776550433 shutdown_connections 2024-06-02T16:45:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a81603a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 --2- 172.21.15.52:0/776550433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.537+0000 7f61ad200640 1 -- 172.21.15.52:0/776550433 >> 172.21.15.52:0/776550433 conn(0x7f61a806c380 msgr2=0x7f61a806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.538+0000 7f61ad200640 1 -- 172.21.15.52:0/776550433 shutdown_connections 2024-06-02T16:45:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.538+0000 7f61ad200640 1 -- 172.21.15.52:0/776550433 wait complete. 2024-06-02T16:45:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.539+0000 7f61ad200640 1 Processor -- start 2024-06-02T16:45:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.540+0000 7f61ad200640 1 -- start start 2024-06-02T16:45:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 0x7f61a8073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61a81421f0 con 0x7f61a8144a20 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8145880 con 0x7f61a8141e10 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61ad200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f61a8142370 con 0x7f61a806e840 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58384/0 (socket says 172.21.15.52:58384) 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7e00640 1 -- 172.21.15.52:0/1227510984 learned_addr learned my addr 172.21.15.52:0/1227510984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f619fe00640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 0x7f61a8073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7e00640 1 -- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 msgr2=0x7f61a815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7400640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.541+0000 7f61a7e00640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a815a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61a7e00640 1 -- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 msgr2=0x7f61a8073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61a7e00640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 0x7f61a8073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61a7e00640 1 -- 172.21.15.52:0/1227510984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a8131830 con 0x7f61a8144a20 2024-06-02T16:45:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f619fe00640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 0x7f61a8073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:46.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61a7400640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:46.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61a7e00640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61a0034040 tx=0x7f61a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:46.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0041020 con 0x7f61a8144a20 2024-06-02T16:45:46.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a00077a0 con 0x7f61a8144a20 2024-06-02T16:45:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a8131b40 con 0x7f61a8144a20 2024-06-02T16:45:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0036040 con 0x7f61a8144a20 2024-06-02T16:45:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.542+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a8132380 con 0x7f61a8144a20 2024-06-02T16:45:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.543+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a80507e0 con 0x7f61a8144a20 2024-06-02T16:45:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.545+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61a0044020 con 0x7f61a8144a20 2024-06-02T16:45:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.546+0000 7f619f400640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 0x7f6184078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.546+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f61a00b83d0 con 0x7f61a8144a20 2024-06-02T16:45:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.546+0000 7f61a7400640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 0x7f6184078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.548+0000 7f61a7400640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 0x7f6184078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6198003eb0 tx=0x7f6198009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.551+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f61a004b030 con 0x7f61a8144a20 2024-06-02T16:45:46.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.774+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61a8162420 con 0x7f61a8144a20 2024-06-02T16:45:46.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.775+0000 7f619f400640 1 -- 172.21.15.52:0/1227510984 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f61a8131b40 con 0x7f61a8144a20 2024-06-02T16:45:46.775 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:45:46.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 msgr2=0x7f6184078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:46.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 0x7f6184078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6198003eb0 tx=0x7f6198009040 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 msgr2=0x7f61a815c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61a0034040 tx=0x7f61a0004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 shutdown_connections 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f61840762d0 0x7f6184078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61a8144a20 0x7f61a815c2e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a8141e10 0x7f61a8073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 --2- 172.21.15.52:0/1227510984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61a806e840 0x7f61a815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 >> 172.21.15.52:0/1227510984 conn(0x7f61a806c380 msgr2=0x7f61a81612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 shutdown_connections 2024-06-02T16:45:46.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:46.779+0000 7f61ad200640 1 -- 172.21.15.52:0/1227510984 wait complete. 2024-06-02T16:45:46.798 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-06-02T16:45:46.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:46.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-06-02T16:45:46.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:45:46.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:46.896 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T16:45:46.958 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:46.958 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.020 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:47.020 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.078 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:45:47.078 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:45:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.344+0000 7f89d3a00640 1 Processor -- start 2024-06-02T16:45:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.344+0000 7f89d3a00640 1 -- start start 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d3a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc0d0150 0x7f89cc06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d3a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc06da70 con 0x7f89cc15f8c0 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d3a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0d1cd0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d3a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0d1fb0 con 0x7f89cc0d0150 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d1a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc0d0150 0x7f89cc06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89cbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89cc15f8c0 0x7f89cc070980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54728/0 (socket says 172.21.15.52:54728) 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89d1a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc0d0150 0x7f89cc06d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58386/0 (socket says 172.21.15.52:58386) 2024-06-02T16:45:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.346+0000 7f89cbe00640 1 -- 172.21.15.52:0/3979605468 learned_addr learned my addr 172.21.15.52:0/3979605468 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.347+0000 7f89d1a00640 1 -- 172.21.15.52:0/3979605468 >> v1:172.21.15.114:6789/0 conn(0x7f89cc15f4e0 legacy=0x7f89cc0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.347+0000 7f89d1a00640 1 -- 172.21.15.52:0/3979605468 >> v1:172.21.15.52:6789/0 conn(0x7f89cc15f8c0 legacy=0x7f89cc070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.347+0000 7f89d1a00640 1 -- 172.21.15.52:0/3979605468 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0d2290 con 0x7f89cc0d0150 2024-06-02T16:45:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.348+0000 7f89d1a00640 1 --2- 172.21.15.52:0/3979605468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc0d0150 0x7f89cc06d490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009d90 tx=0x7f89c402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a165f843d90ce7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.348+0000 7f89cb400640 1 -- 172.21.15.52:0/3979605468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4031600 con 0x7f89cc0d0150 2024-06-02T16:45:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.348+0000 7f89cb400640 1 -- 172.21.15.52:0/3979605468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40317a0 con 0x7f89cc0d0150 2024-06-02T16:45:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.348+0000 7f89cb400640 1 -- 172.21.15.52:0/3979605468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4031b70 con 0x7f89cc0d0150 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 -- 172.21.15.52:0/3979605468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc0d0150 msgr2=0x7f89cc06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 --2- 172.21.15.52:0/3979605468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc0d0150 0x7f89cc06d490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009d90 tx=0x7f89c402a5d0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 -- 172.21.15.52:0/3979605468 shutdown_connections 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 --2- 172.21.15.52:0/3979605468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc0d0150 0x7f89cc06d490 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 -- 172.21.15.52:0/3979605468 >> 172.21.15.52:0/3979605468 conn(0x7f89cc0d31c0 msgr2=0x7f89cc0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 -- 172.21.15.52:0/3979605468 shutdown_connections 2024-06-02T16:45:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.349+0000 7f89d3a00640 1 -- 172.21.15.52:0/3979605468 wait complete. 2024-06-02T16:45:47.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.351+0000 7f89d3a00640 1 Processor -- start 2024-06-02T16:45:47.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.352+0000 7f89d3a00640 1 -- start start 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89cc0d0150 0x7f89cc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89cc15f8c0 0x7f89cc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc06e100 con 0x7f89cc15f4e0 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc06df80 con 0x7f89cc0d0150 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89d3a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc06e280 con 0x7f89cc15f8c0 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58392/0 (socket says 172.21.15.52:58392) 2024-06-02T16:45:47.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.353+0000 7f89cbe00640 1 -- 172.21.15.52:0/960681407 learned_addr learned my addr 172.21.15.52:0/960681407 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89d1000640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89cc0d0150 0x7f89cc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89d1a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89cc15f8c0 0x7f89cc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 -- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89cc15f8c0 msgr2=0x7f89cc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89cc15f8c0 0x7f89cc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 -- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89cc0d0150 msgr2=0x7f89cc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89cc0d0150 0x7f89cc15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 -- 172.21.15.52:0/960681407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc1f8950 con 0x7f89cc15f4e0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.354+0000 7f89cbe00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b800c370 tx=0x7f89b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.355+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8017070 con 0x7f89cc15f4e0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.355+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b8005ce0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.355+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b80072f0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.355+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc1f8c30 con 0x7f89cc15f4e0 2024-06-02T16:45:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.355+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc1f91f0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.356+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc069c30 con 0x7f89cc15f4e0 2024-06-02T16:45:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.357+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89b801a070 con 0x7f89cc15f4e0 2024-06-02T16:45:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.358+0000 7f89c8c00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 0x7f89ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.358+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f89b80969f0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.359+0000 7f89d1000640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 0x7f89ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.360+0000 7f89d1000640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 0x7f89ac078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89c0004ea0 tx=0x7f89c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.365+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89b80602b0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.591+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f89cc1f93c0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.592+0000 7f89c8c00640 1 -- 172.21.15.52:0/960681407 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f89b805fbb0 con 0x7f89cc15f4e0 2024-06-02T16:45:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 msgr2=0x7f89ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 0x7f89ac078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89c0004ea0 tx=0x7f89c0009040 comp rx=0 tx=0).stop 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 msgr2=0x7f89cc0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b800c370 tx=0x7f89b800c830 comp rx=0 tx=0).stop 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 shutdown_connections 2024-06-02T16:45:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f89ac0762d0 0x7f89ac078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89cc15f8c0 0x7f89cc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc15f4e0 0x7f89cc0b0cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 --2- 172.21.15.52:0/960681407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89cc0d0150 0x7f89cc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.595+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 >> 172.21.15.52:0/960681407 conn(0x7f89cc0d31c0 msgr2=0x7f89cc0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.596+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 shutdown_connections 2024-06-02T16:45:47.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:47.596+0000 7f89d3a00640 1 -- 172.21.15.52:0/960681407 wait complete. 2024-06-02T16:45:47.613 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-06-02T16:45:47.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:47.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-06-02T16:45:47.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:45:47.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:47.700 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T16:45:47.746 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:47.746 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.806 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:47.806 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.861 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:45:47.861 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:45:47.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:45:48.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.134+0000 7fc9e5c00640 1 Processor -- start 2024-06-02T16:45:48.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.134+0000 7fc9e5c00640 1 -- start start 2024-06-02T16:45:48.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.136+0000 7fc9e5c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9e015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.136+0000 7fc9e5c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e00d0820 con 0x7fc9e006e3a0 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.136+0000 7fc9e5c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e015c5c0 con 0x7fc9e013f0e0 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.136+0000 7fc9e5c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e0160990 con 0x7fc9e006e780 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.136+0000 7fc9dfe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc9e006e3a0 0x7fc9e013e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54730/0 (socket says 172.21.15.52:54730) 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.137+0000 7fc9dfe00640 1 -- 172.21.15.52:0/4263086908 learned_addr learned my addr 172.21.15.52:0/4263086908 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.137+0000 7fc9df400640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9e015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.137+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549809704 0 0) 0x7fc9e00d0820 con 0x7fc9e006e3a0 2024-06-02T16:45:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.137+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9c4003520 con 0x7fc9e006e3a0 2024-06-02T16:45:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004814065 0 0) 0x7fc9e015c5c0 con 0x7fc9e013f0e0 2024-06-02T16:45:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e00d0820 con 0x7fc9e013f0e0 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1400203962 0 0) 0x7fc9c4003520 con 0x7fc9e006e3a0 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 msgr2=0x7fc9e015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9e015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 >> v1:172.21.15.114:6789/0 conn(0x7fc9e013f0e0 legacy=0x7fc9e0160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e015c880 con 0x7fc9e006e3a0 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fc9d00016f0 con 0x7fc9e006e3a0 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 >> v1:172.21.15.52:6789/0 conn(0x7fc9e006e3a0 legacy=0x7fc9e013e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9c4003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c4004210 0x7fc9c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0160990 con 0x7fc9c4004d90 2024-06-02T16:45:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c400dde0 con 0x7fc9c4004210 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c400dfe0 con 0x7fc9e006e780 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.138+0000 7fc9e5200640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9df400640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c4004210 0x7fc9c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9dfe00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9c4003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9e5200640 1 -- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 msgr2=0x7fc9c4003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9e5200640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e006e780 0x7fc9c4003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9e5200640 1 -- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c4004210 msgr2=0x7fc9c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9e5200640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c4004210 0x7fc9c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.139+0000 7fc9e5200640 1 -- 172.21.15.52:0/4263086908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c4003520 con 0x7fc9c4004d90 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.140+0000 7fc9e5200640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9c4005210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8002000 tx=0x7fc9c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1e56fb734a306b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.140+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8001c20 con 0x7fc9c4004d90 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.140+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d8006d70 con 0x7fc9c4004d90 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.140+0000 7fc9dea00640 1 -- 172.21.15.52:0/4263086908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8003bb0 con 0x7fc9c4004d90 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 -- 172.21.15.52:0/4263086908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 msgr2=0x7fc9c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/4263086908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9c4005210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8002000 tx=0x7fc9c4005830 comp rx=0 tx=0).stop 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5200640 1 -- 172.21.15.52:0/4263086908 reap_dead start 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 -- 172.21.15.52:0/4263086908 shutdown_connections 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 -- 172.21.15.52:0/4263086908 >> 172.21.15.52:0/4263086908 conn(0x7fc9e006c380 msgr2=0x7fc9e006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 -- 172.21.15.52:0/4263086908 shutdown_connections 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.141+0000 7fc9e5c00640 1 -- 172.21.15.52:0/4263086908 wait complete. 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.143+0000 7fc9e5c00640 1 Processor -- start 2024-06-02T16:45:48.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.143+0000 7fc9e5c00640 1 -- start start 2024-06-02T16:45:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 0x7fc9e0142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e00afe50 0x7fc9e0142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e015d340 con 0x7fc9c4004d90 2024-06-02T16:45:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e015ce40 con 0x7fc9e00af9d0 2024-06-02T16:45:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9e5c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e015d4c0 con 0x7fc9e00afe50 2024-06-02T16:45:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58420/0 (socket says 172.21.15.52:58420) 2024-06-02T16:45:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.144+0000 7fc9dfe00640 1 -- 172.21.15.52:0/3002079084 learned_addr learned my addr 172.21.15.52:0/3002079084 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9df400640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 0x7fc9e0142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9e5200640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e00afe50 0x7fc9e0142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 -- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e00afe50 msgr2=0x7fc9e0142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e00afe50 0x7fc9e0142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 -- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 msgr2=0x7fc9e0142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 0x7fc9e0142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 -- 172.21.15.52:0/3002079084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e013ce30 con 0x7fc9c4004d90 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9df400640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 0x7fc9e0142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.145+0000 7fc9dfe00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e710 tx=0x7fc9d000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.146+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000ee20 con 0x7fc9c4004d90 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.146+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d0018070 con 0x7fc9c4004d90 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.146+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000cb10 con 0x7fc9c4004d90 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.146+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e013ff70 con 0x7fc9c4004d90 2024-06-02T16:45:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.146+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e0140530 con 0x7fc9c4004d90 2024-06-02T16:45:48.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.147+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e00507e0 con 0x7fc9c4004d90 2024-06-02T16:45:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.148+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9d000ccb0 con 0x7fc9c4004d90 2024-06-02T16:45:48.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.149+0000 7fc9d7e00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 0x7fc9c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.149+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc9d0097500 con 0x7fc9c4004d90 2024-06-02T16:45:48.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.150+0000 7fc9df400640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 0x7fc9c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.151+0000 7fc9df400640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 0x7fc9c0078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0145900 tx=0x7fc9cc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.154+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9e013ce30 con 0x7fc9c4004d90 2024-06-02T16:45:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.378+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9e006f0b0 con 0x7fc9c4004d90 2024-06-02T16:45:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.379+0000 7fc9d7e00640 1 -- 172.21.15.52:0/3002079084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc9d0060dc0 con 0x7fc9c4004d90 2024-06-02T16:45:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 msgr2=0x7fc9c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 0x7fc9c0078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0145900 tx=0x7fc9cc008040 comp rx=0 tx=0).stop 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 msgr2=0x7fc9e0144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e710 tx=0x7fc9d000ebd0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 shutdown_connections 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9c00762d0 0x7fc9c0078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9e00afe50 0x7fc9e0142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e00af9d0 0x7fc9e0142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 --2- 172.21.15.52:0/3002079084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c4004d90 0x7fc9e0144f40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 >> 172.21.15.52:0/3002079084 conn(0x7fc9e006c380 msgr2=0x7fc9e015fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 shutdown_connections 2024-06-02T16:45:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.382+0000 7fc9e5c00640 1 -- 172.21.15.52:0/3002079084 wait complete. 2024-06-02T16:45:48.400 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-06-02T16:45:48.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:48.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-06-02T16:45:48.500 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:45:48.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:45:48.501 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T16:45:48.547 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T16:45:48.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:48.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.774+0000 7fdcaae00640 1 Processor -- start 2024-06-02T16:45:48.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.775+0000 7fdcaae00640 1 -- start start 2024-06-02T16:45:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.776+0000 7fdcaae00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 0x7fdca40bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.776+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.776+0000 7fdcaae00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca415f7a0 con 0x7fdca40b7030 2024-06-02T16:45:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.776+0000 7fdcaae00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdca40b9310 con 0x7fdca40b6c50 2024-06-02T16:45:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.776+0000 7fdcaae00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdca40d3aa0 con 0x7fdca40d4da0 2024-06-02T16:45:48.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.777+0000 7fdca9000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.777+0000 7fdca9000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:38768/0 (socket says 172.21.15.52:38768) 2024-06-02T16:45:48.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.777+0000 7fdca9000640 1 -- 172.21.15.52:0/379406511 learned_addr learned my addr 172.21.15.52:0/379406511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:48.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.777+0000 7fdca9a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 0x7fdca40bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.778+0000 7fdca9000640 1 -- 172.21.15.52:0/379406511 >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 msgr2=0x7fdca40bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.778+0000 7fdca9000640 1 --2- 172.21.15.52:0/379406511 >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 0x7fdca40bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.778+0000 7fdca9000640 1 -- 172.21.15.52:0/379406511 >> v1:172.21.15.114:6789/0 conn(0x7fdca40b7030 legacy=0x7fdca406d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.778+0000 7fdca9000640 1 -- 172.21.15.52:0/379406511 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca40d3d00 con 0x7fdca40d4da0 2024-06-02T16:45:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.778+0000 7fdca9a00640 1 --2- 172.21.15.52:0/379406511 >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 0x7fdca40bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:45:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.780+0000 7fdca9000640 1 --2- 172.21.15.52:0/379406511 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009870 tx=0x7fdc9002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27f042a97d90adc3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.780+0000 7fdca3e00640 1 -- 172.21.15.52:0/379406511 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037070 con 0x7fdca40d4da0 2024-06-02T16:45:48.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.780+0000 7fdca3e00640 1 -- 172.21.15.52:0/379406511 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90032440 con 0x7fdca40d4da0 2024-06-02T16:45:48.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.780+0000 7fdca3e00640 1 -- 172.21.15.52:0/379406511 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90032810 con 0x7fdca40d4da0 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 -- 172.21.15.52:0/379406511 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 msgr2=0x7fdca40d3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 --2- 172.21.15.52:0/379406511 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009870 tx=0x7fdc9002a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 -- 172.21.15.52:0/379406511 shutdown_connections 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 --2- 172.21.15.52:0/379406511 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40d4da0 0x7fdca40d3560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 --2- 172.21.15.52:0/379406511 >> v2:172.21.15.114:3300/0 conn(0x7fdca40b6c50 0x7fdca40bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 -- 172.21.15.52:0/379406511 >> 172.21.15.52:0/379406511 conn(0x7fdca40740e0 msgr2=0x7fdca40d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 -- 172.21.15.52:0/379406511 shutdown_connections 2024-06-02T16:45:48.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.781+0000 7fdcaae00640 1 -- 172.21.15.52:0/379406511 wait complete. 2024-06-02T16:45:48.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.784+0000 7fdcaae00640 1 Processor -- start 2024-06-02T16:45:48.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.784+0000 7fdcaae00640 1 -- start start 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 0x7fdca41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 0x7fdca40cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdca40d45a0 con 0x7fdca40b7030 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdca40d42c0 con 0x7fdca40d4da0 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.785+0000 7fdcaae00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdca40d4880 con 0x7fdca40b6c50 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58426/0 (socket says 172.21.15.52:58426) 2024-06-02T16:45:48.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 -- 172.21.15.52:0/1021853847 learned_addr learned my addr 172.21.15.52:0/1021853847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9a00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 0x7fdca41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdcaa400640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 0x7fdca40cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 -- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 msgr2=0x7fdca41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 0x7fdca41542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 -- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 msgr2=0x7fdca40cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 0x7fdca40cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 -- 172.21.15.52:0/1021853847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca40cd370 con 0x7fdca40b7030 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9a00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 0x7fdca41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdcaa400640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 0x7fdca40cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.786+0000 7fdca9000640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009990 tx=0x7fdc900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.787+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90043070 con 0x7fdca40b7030 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.787+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90038040 con 0x7fdca40b7030 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.787+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037050 con 0x7fdca40b7030 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.787+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca40ced30 con 0x7fdca40b7030 2024-06-02T16:45:48.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.787+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca40cf2f0 con 0x7fdca40b7030 2024-06-02T16:45:48.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.788+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca40507e0 con 0x7fdca40b7030 2024-06-02T16:45:48.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.789+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc90046070 con 0x7fdca40b7030 2024-06-02T16:45:48.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.791+0000 7fdca1600640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 0x7fdc84078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:48.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.791+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdc900b76e0 con 0x7fdca40b7030 2024-06-02T16:45:48.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.792+0000 7fdca9a00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 0x7fdc84078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:48.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.793+0000 7fdca9a00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 0x7fdc84078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009ac0 tx=0x7fdc98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:48.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:48.796+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc90080fa0 con 0x7fdca40b7030 2024-06-02T16:45:49.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.047+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdca40b4910 con 0x7fdca40b7030 2024-06-02T16:45:49.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.049+0000 7fdca1600640 1 -- 172.21.15.52:0/1021853847 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fdc900808a0 con 0x7fdca40b7030 2024-06-02T16:45:49.048 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:49.048 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:49.048 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 msgr2=0x7fdc84078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 0x7fdc84078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009ac0 tx=0x7fdc98008040 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 msgr2=0x7fdca40cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009990 tx=0x7fdc900046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 shutdown_connections 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc840762d0 0x7fdc84078790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40d4da0 0x7fdca40cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdca40b7030 0x7fdca40cca70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 --2- 172.21.15.52:0/1021853847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdca40b6c50 0x7fdca41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 >> 172.21.15.52:0/1021853847 conn(0x7fdca40740e0 msgr2=0x7fdca406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:49.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 shutdown_connections 2024-06-02T16:45:49.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.052+0000 7fdcaae00640 1 -- 172.21.15.52:0/1021853847 wait complete. 2024-06-02T16:45:49.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.288+0000 7f30bbe00640 1 Processor -- start 2024-06-02T16:45:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.288+0000 7f30bbe00640 1 -- start start 2024-06-02T16:45:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30bc15cce0 0x7f30bc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bbe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc15fa10 con 0x7f30bc163520 2024-06-02T16:45:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bbe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc163ab0 con 0x7f30bc1604d0 2024-06-02T16:45:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bbe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc15fcd0 con 0x7f30bc15cce0 2024-06-02T16:45:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f30bc163520 0x7f30bc0b5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54746/0 (socket says 172.21.15.52:54746) 2024-06-02T16:45:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.291+0000 7f30bb400640 1 -- 172.21.15.52:0/2938274329 learned_addr learned my addr 172.21.15.52:0/2938274329 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30baa00640 1 --2- 172.21.15.52:0/2938274329 >> v2:172.21.15.114:3300/0 conn(0x7f30bc15cce0 0x7f30bc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331274520 0 0) 0x7f30bc15fa10 con 0x7f30bc163520 2024-06-02T16:45:49.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a0003520 con 0x7f30bc163520 2024-06-02T16:45:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3029610025 0 0) 0x7f30a0003520 con 0x7f30bc163520 2024-06-02T16:45:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 >> v2:172.21.15.114:3300/0 conn(0x7f30bc15cce0 msgr2=0x7f30bc06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 --2- 172.21.15.52:0/2938274329 >> v2:172.21.15.114:3300/0 conn(0x7f30bc15cce0 0x7f30bc06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 >> v1:172.21.15.114:6789/0 conn(0x7f30bc1604d0 legacy=0x7f30bc162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc15ffb0 con 0x7f30bc163520 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f30b4001a70 con 0x7f30bc163520 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 >> v1:172.21.15.52:6789/0 conn(0x7f30bc163520 legacy=0x7f30bc0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.292+0000 7f30ba000640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 0x7f30a0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30ba000640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0004800 0x7f30a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30ba000640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30a0005210 0x7f30a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc15fcd0 con 0x7f30a0003aa0 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000c160 con 0x7f30a0005210 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f30a000c360 con 0x7f30a0004800 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 0x7f30a0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30b2000640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0004800 0x7f30a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30bb400640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30a0005210 0x7f30a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 -- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0004800 msgr2=0x7f30a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0004800 0x7f30a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 -- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30a0005210 msgr2=0x7f30a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30a0005210 0x7f30a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30baa00640 1 -- 172.21.15.52:0/2938274329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a0003520 con 0x7f30a0003aa0 2024-06-02T16:45:49.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.293+0000 7f30bb400640 1 -- 172.21.15.52:0/2938274329 reap_dead start 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.295+0000 7f30baa00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 0x7f30a0003ec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009a90 tx=0x7f30a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d1f9b7c37d6746 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.295+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac036070 con 0x7f30a0003aa0 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.295+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac031400 con 0x7f30a0003aa0 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.295+0000 7f30ba000640 1 -- 172.21.15.52:0/2938274329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac009690 con 0x7f30a0003aa0 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 -- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 msgr2=0x7f30a0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 0x7f30a0003ec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009a90 tx=0x7f30a0005830 comp rx=0 tx=0).stop 2024-06-02T16:45:49.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 -- 172.21.15.52:0/2938274329 shutdown_connections 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 --2- 172.21.15.52:0/2938274329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30a0003aa0 0x7f30a0003ec0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 -- 172.21.15.52:0/2938274329 >> 172.21.15.52:0/2938274329 conn(0x7f30bc06c380 msgr2=0x7f30bc06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 -- 172.21.15.52:0/2938274329 shutdown_connections 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.296+0000 7f30bbe00640 1 -- 172.21.15.52:0/2938274329 wait complete. 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.298+0000 7f30bbe00640 1 Processor -- start 2024-06-02T16:45:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.298+0000 7f30bbe00640 1 -- start start 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0003aa0 0x7f30bc1eab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30bc146cd0 0x7f30bc0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc162f90 con 0x7f30bc1f9770 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc162e10 con 0x7f30bc146cd0 2024-06-02T16:45:49.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30bbe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc163110 con 0x7f30a0003aa0 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30b2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30b2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58452/0 (socket says 172.21.15.52:58452) 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.299+0000 7f30b2000640 1 -- 172.21.15.52:0/1181608679 learned_addr learned my addr 172.21.15.52:0/1181608679 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30baa00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0003aa0 0x7f30bc1eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30bb400640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30bc146cd0 0x7f30bc0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 -- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0003aa0 msgr2=0x7f30bc1eab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0003aa0 0x7f30bc1eab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 -- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30bc146cd0 msgr2=0x7f30bc0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30bc146cd0 0x7f30bc0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 -- 172.21.15.52:0/1181608679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0b3720 con 0x7f30bc1f9770 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b2000640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e550 tx=0x7f30a400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40052e0 con 0x7f30bc1f9770 2024-06-02T16:45:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4018070 con 0x7f30bc1f9770 2024-06-02T16:45:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.300+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc1f8c90 con 0x7f30bc1f9770 2024-06-02T16:45:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.301+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4003830 con 0x7f30bc1f9770 2024-06-02T16:45:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.301+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1f9250 con 0x7f30bc1f9770 2024-06-02T16:45:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.302+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc075ea0 con 0x7f30bc1f9770 2024-06-02T16:45:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.303+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30a40039d0 con 0x7f30bc1f9770 2024-06-02T16:45:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.304+0000 7f30b3400640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 0x7f30980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.304+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f30a4097080 con 0x7f30bc1f9770 2024-06-02T16:45:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.305+0000 7f30baa00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 0x7f30980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.306+0000 7f30baa00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 0x7f30980787c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30ac033000 tx=0x7f30ac008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.309+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30a4022020 con 0x7f30bc1f9770 2024-06-02T16:45:49.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.566+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30bc15f150 con 0x7f30bc1f9770 2024-06-02T16:45:49.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.567+0000 7f30b3400640 1 -- 172.21.15.52:0/1181608679 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f30bc15f150 con 0x7f30bc1f9770 2024-06-02T16:45:49.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:49.566 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:49.566 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:49.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 msgr2=0x7f30980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 0x7f30980787c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30ac033000 tx=0x7f30ac008030 comp rx=0 tx=0).stop 2024-06-02T16:45:49.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 msgr2=0x7f30bc146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e550 tx=0x7f30a400ea10 comp rx=0 tx=0).stop 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 shutdown_connections 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3098076300 0x7f30980787c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30bc146cd0 0x7f30bc0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc1f9770 0x7f30bc146790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 --2- 172.21.15.52:0/1181608679 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30a0003aa0 0x7f30bc1eab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 >> 172.21.15.52:0/1181608679 conn(0x7f30bc06c380 msgr2=0x7f30bc1475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.571+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 shutdown_connections 2024-06-02T16:45:49.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.572+0000 7f30bbe00640 1 -- 172.21.15.52:0/1181608679 wait complete. 2024-06-02T16:45:49.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:49.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.809+0000 7f06eda00640 1 Processor -- start 2024-06-02T16:45:49.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.809+0000 7f06eda00640 1 -- start start 2024-06-02T16:45:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.811+0000 7f06eda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06e81604d0 0x7f06e816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.811+0000 7f06eda00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e815fa10 con 0x7f06e815cce0 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.811+0000 7f06eda00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e8163ab0 con 0x7f06e806e840 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.811+0000 7f06eda00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f06e815fcd0 con 0x7f06e81604d0 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.812+0000 7f06e7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06e815cce0 0x7f06e806e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54758/0 (socket says 172.21.15.52:54758) 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.812+0000 7f06e7e00640 1 -- 172.21.15.52:0/4099602969 learned_addr learned my addr 172.21.15.52:0/4099602969 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.812+0000 7f06ed000640 1 --2- 172.21.15.52:0/4099602969 >> v2:172.21.15.114:3300/0 conn(0x7f06e81604d0 0x7f06e816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.812+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412279649 0 0) 0x7f06e815fa10 con 0x7f06e815cce0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.812+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06cc003520 con 0x7f06e815cce0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 620314719 0 0) 0x7f06cc003520 con 0x7f06e815cce0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 >> v2:172.21.15.114:3300/0 conn(0x7f06e81604d0 msgr2=0x7f06e816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 --2- 172.21.15.52:0/4099602969 >> v2:172.21.15.114:3300/0 conn(0x7f06e81604d0 0x7f06e816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 >> v1:172.21.15.114:6789/0 conn(0x7f06e806e840 legacy=0x7f06e8162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e815ffb0 con 0x7f06e815cce0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f06d80016f0 con 0x7f06e815cce0 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 >> v1:172.21.15.52:6789/0 conn(0x7f06e815cce0 legacy=0x7f06e806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc003aa0 0x7f06cc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 0x7f06cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06cc005210 0x7f06cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06e815fcd0 con 0x7f06cc004800 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc00c160 con 0x7f06cc003aa0 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f06cc00c360 con 0x7f06cc005210 2024-06-02T16:45:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.813+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 0x7f06cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06ed000640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06cc005210 0x7f06cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06e7e00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc003aa0 0x7f06cc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06dfe00640 1 -- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06cc005210 msgr2=0x7f06cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06cc005210 0x7f06cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06dfe00640 1 -- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc003aa0 msgr2=0x7f06cc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc003aa0 0x7f06cc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06dfe00640 1 -- 172.21.15.52:0/4099602969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc003520 con 0x7f06cc004800 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.814+0000 7f06ed000640 1 -- 172.21.15.52:0/4099602969 reap_dead start 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.815+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 0x7f06cc004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001760 tx=0x7f06cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bbc09989d4ddbf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.815+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00013b0 con 0x7f06cc004800 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.815+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00052d0 con 0x7f06cc004800 2024-06-02T16:45:49.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.815+0000 7f06e7400640 1 -- 172.21.15.52:0/4099602969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d002aa50 con 0x7f06cc004800 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 -- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 msgr2=0x7f06cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 0x7f06cc004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001760 tx=0x7f06cc005830 comp rx=0 tx=0).stop 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 -- 172.21.15.52:0/4099602969 shutdown_connections 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 --2- 172.21.15.52:0/4099602969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc004800 0x7f06cc004c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 -- 172.21.15.52:0/4099602969 >> 172.21.15.52:0/4099602969 conn(0x7f06e806c380 msgr2=0x7f06e806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 -- 172.21.15.52:0/4099602969 shutdown_connections 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.816+0000 7f06eda00640 1 -- 172.21.15.52:0/4099602969 wait complete. 2024-06-02T16:45:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.818+0000 7f06eda00640 1 Processor -- start 2024-06-02T16:45:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.818+0000 7f06eda00640 1 -- start start 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 0x7f06e81f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 0x7f06e80b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06e806e2b0 con 0x7f06e80cfcb0 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06e806e130 con 0x7f06cc004800 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06eda00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f06e806e430 con 0x7f06e80b2ca0 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06ed000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06ed000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58476/0 (socket says 172.21.15.52:58476) 2024-06-02T16:45:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.819+0000 7f06ed000640 1 -- 172.21.15.52:0/4286686276 learned_addr learned my addr 172.21.15.52:0/4286686276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06e7e00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 0x7f06e81f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 0x7f06e80b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 -- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 msgr2=0x7f06e80b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 0x7f06e80b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 -- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 msgr2=0x7f06e81f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 0x7f06e81f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 -- 172.21.15.52:0/4286686276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e80ce670 con 0x7f06e80cfcb0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06dfe00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 0x7f06e80b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06e7e00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 0x7f06e81f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06ed000640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06e80d0e40 tx=0x7f06e00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.820+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011de0 con 0x7f06e80cfcb0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.821+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e001b070 con 0x7f06e80cfcb0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.821+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0003990 con 0x7f06e80cfcb0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.821+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e80ce950 con 0x7f06e80cfcb0 2024-06-02T16:45:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.821+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e80cef10 con 0x7f06e80cfcb0 2024-06-02T16:45:49.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.822+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8075ea0 con 0x7f06e80cfcb0 2024-06-02T16:45:49.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.823+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06e0003b30 con 0x7f06e80cfcb0 2024-06-02T16:45:49.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.824+0000 7f06e4c00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:49.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.824+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06e0097f20 con 0x7f06e80cfcb0 2024-06-02T16:45:49.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.825+0000 7f06e7e00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:49.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.826+0000 7f06e7e00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 0x7f06c4078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000fb0 tx=0x7f06d8001e10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:49.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:49.829+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06e0003e20 con 0x7f06e80cfcb0 2024-06-02T16:45:50.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.040+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06e80507e0 con 0x7f06e80cfcb0 2024-06-02T16:45:50.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.042+0000 7f06e4c00640 1 -- 172.21.15.52:0/4286686276 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7f06e00617e0 con 0x7f06e80cfcb0 2024-06-02T16:45:50.051 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:50.051 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 msgr2=0x7f06c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 0x7f06c4078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000fb0 tx=0x7f06d8001e10 comp rx=0 tx=0).stop 2024-06-02T16:45:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 msgr2=0x7f06e80d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06e80d0e40 tx=0x7f06e00115a0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 shutdown_connections 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e80cfcb0 0x7f06e80d0130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.045+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06e80b2ca0 0x7f06e80b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.046+0000 7f06eda00640 1 --2- 172.21.15.52:0/4286686276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc004800 0x7f06e81f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.046+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 >> 172.21.15.52:0/4286686276 conn(0x7f06e806c380 msgr2=0x7f06e815ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.046+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 shutdown_connections 2024-06-02T16:45:50.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.046+0000 7f06eda00640 1 -- 172.21.15.52:0/4286686276 wait complete. 2024-06-02T16:45:50.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T16:45:50.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.293+0000 7efefb600640 1 Processor -- start 2024-06-02T16:45:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.294+0000 7efefb600640 1 -- start start 2024-06-02T16:45:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efefb600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efef415d2d0 0x7efef40ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efefb600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efef40d1b60 0x7efef406f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efefb600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef40ae8e0 con 0x7efef406fed0 2024-06-02T16:45:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efefb600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efef415d6b0 con 0x7efef415d2d0 2024-06-02T16:45:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efefb600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efef406ed90 con 0x7efef40d1b60 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efef8c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efef415d2d0 0x7efef40ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efef3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efef406fed0 0x7efef40d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54766/0 (socket says 172.21.15.52:54766) 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.295+0000 7efef3e00640 1 -- 172.21.15.52:0/2898818749 learned_addr learned my addr 172.21.15.52:0/2898818749 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef9600640 1 --2- 172.21.15.52:0/2898818749 >> v2:172.21.15.114:3300/0 conn(0x7efef40d1b60 0x7efef406f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef8c00640 1 -- 172.21.15.52:0/2898818749 >> v2:172.21.15.114:3300/0 conn(0x7efef40d1b60 msgr2=0x7efef406f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef8c00640 1 --2- 172.21.15.52:0/2898818749 >> v2:172.21.15.114:3300/0 conn(0x7efef40d1b60 0x7efef406f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef8c00640 1 -- 172.21.15.52:0/2898818749 >> v1:172.21.15.52:6789/0 conn(0x7efef406fed0 legacy=0x7efef40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef8c00640 1 -- 172.21.15.52:0/2898818749 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef40ae600 con 0x7efef415d2d0 2024-06-02T16:45:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.296+0000 7efef3400640 1 -- 172.21.15.52:0/2898818749 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716090750 0 0) 0x7efee0001110 con 0x7efef406fed0 2024-06-02T16:45:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.297+0000 7efef8c00640 1 --2- 172.21.15.52:0/2898818749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef415d2d0 0x7efef40ae020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efef4074770 tx=0x7efee402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2c5794eba3e3c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.297+0000 7efef3400640 1 -- 172.21.15.52:0/2898818749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4037070 con 0x7efef415d2d0 2024-06-02T16:45:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.297+0000 7efef3400640 1 -- 172.21.15.52:0/2898818749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee4032440 con 0x7efef415d2d0 2024-06-02T16:45:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.297+0000 7efef3400640 1 -- 172.21.15.52:0/2898818749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4032810 con 0x7efef415d2d0 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 -- 172.21.15.52:0/2898818749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef415d2d0 msgr2=0x7efef40ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 --2- 172.21.15.52:0/2898818749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef415d2d0 0x7efef40ae020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efef4074770 tx=0x7efee402a1a0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 -- 172.21.15.52:0/2898818749 shutdown_connections 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 --2- 172.21.15.52:0/2898818749 >> v2:172.21.15.114:3300/0 conn(0x7efef40d1b60 0x7efef406f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 --2- 172.21.15.52:0/2898818749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef415d2d0 0x7efef40ae020 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 -- 172.21.15.52:0/2898818749 >> 172.21.15.52:0/2898818749 conn(0x7efef406c7a0 msgr2=0x7efef406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 -- 172.21.15.52:0/2898818749 shutdown_connections 2024-06-02T16:45:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.298+0000 7efefb600640 1 -- 172.21.15.52:0/2898818749 wait complete. 2024-06-02T16:45:50.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.300+0000 7efefb600640 1 Processor -- start 2024-06-02T16:45:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.300+0000 7efefb600640 1 -- start start 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efef40d1b60 0x7efef4149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef415d2d0 0x7efef415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efef40741b0 con 0x7efef406fed0 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efef406ea20 con 0x7efef415d2d0 2024-06-02T16:45:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efefb600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7efef4157d70 con 0x7efef40d1b60 2024-06-02T16:45:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efef8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efef8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58494/0 (socket says 172.21.15.52:58494) 2024-06-02T16:45:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.301+0000 7efef8c00640 1 -- 172.21.15.52:0/1194714280 learned_addr learned my addr 172.21.15.52:0/1194714280 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 -- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efef40d1b60 msgr2=0x7efef4149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efef40d1b60 0x7efef4149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 -- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef415d2d0 msgr2=0x7efef415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef415d2d0 0x7efef415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 -- 172.21.15.52:0/1194714280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef40cb950 con 0x7efef406fed0 2024-06-02T16:45:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef8c00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efee4000c00 tx=0x7efee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.302+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4037040 con 0x7efef406fed0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.303+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee4042070 con 0x7efef406fed0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.303+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef40cbc30 con 0x7efef406fed0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.303+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4030bd0 con 0x7efef406fed0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.303+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef4158050 con 0x7efef406fed0 2024-06-02T16:45:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.304+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef4069520 con 0x7efef406fed0 2024-06-02T16:45:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.305+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efee4047460 con 0x7efef406fed0 2024-06-02T16:45:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.306+0000 7efef0c00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 0x7efed4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.306+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efee40b8310 con 0x7efef406fed0 2024-06-02T16:45:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.307+0000 7efef3e00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 0x7efed4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.308+0000 7efef3e00640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 0x7efed4078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efee00013f0 tx=0x7efee0001300 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.311+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efee4032e20 con 0x7efef406fed0 2024-06-02T16:45:50.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.562+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efef4158cf0 con 0x7efef406fed0 2024-06-02T16:45:50.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.563+0000 7efef0c00640 1 -- 172.21.15.52:0/1194714280 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7efee4081c60 con 0x7efef406fed0 2024-06-02T16:45:50.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:50.562 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 msgr2=0x7efed4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 0x7efed4078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efee00013f0 tx=0x7efee0001300 comp rx=0 tx=0).stop 2024-06-02T16:45:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 msgr2=0x7efef4154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efee4000c00 tx=0x7efee40046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 shutdown_connections 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7efed40762d0 0x7efed4078790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef415d2d0 0x7efef415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efef40d1b60 0x7efef4149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 --2- 172.21.15.52:0/1194714280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efef406fed0 0x7efef4154db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.566+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 >> 172.21.15.52:0/1194714280 conn(0x7efef406c7a0 msgr2=0x7efef40d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.567+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 shutdown_connections 2024-06-02T16:45:50.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.567+0000 7efefb600640 1 -- 172.21.15.52:0/1194714280 wait complete. 2024-06-02T16:45:50.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:45:50.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.801+0000 7fbd6fa00640 1 Processor -- start 2024-06-02T16:45:50.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.801+0000 7fbd6fa00640 1 -- start start 2024-06-02T16:45:50.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.803+0000 7fbd6fa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd6815d2d0 0x7fbd680ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.803+0000 7fbd6fa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd680ae8e0 con 0x7fbd680d1b60 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.803+0000 7fbd6fa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd680ae600 con 0x7fbd6806fed0 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.803+0000 7fbd6fa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6815d6b0 con 0x7fbd6815d2d0 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.804+0000 7fbd6da00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd680d1b60 0x7fbd680727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54782/0 (socket says 172.21.15.52:54782) 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.804+0000 7fbd6da00640 1 -- 172.21.15.52:0/2491533301 learned_addr learned my addr 172.21.15.52:0/2491533301 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:50.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.804+0000 7fbd6d000640 1 --2- 172.21.15.52:0/2491533301 >> v2:172.21.15.114:3300/0 conn(0x7fbd6815d2d0 0x7fbd680ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.804+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683849986 0 0) 0x7fbd60001490 con 0x7fbd680d1b60 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.804+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd50003520 con 0x7fbd680d1b60 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.805+0000 7fbd6d000640 1 -- 172.21.15.52:0/2491533301 >> v1:172.21.15.114:6789/0 conn(0x7fbd6806fed0 legacy=0x7fbd680d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.805+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 299618131 0 0) 0x7fbd50003520 con 0x7fbd680d1b60 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.805+0000 7fbd6d000640 1 -- 172.21.15.52:0/2491533301 >> v1:172.21.15.52:6789/0 conn(0x7fbd680d1b60 legacy=0x7fbd680727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.805+0000 7fbd6d000640 1 -- 172.21.15.52:0/2491533301 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6806e740 con 0x7fbd6815d2d0 2024-06-02T16:45:50.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.806+0000 7fbd6d000640 1 --2- 172.21.15.52:0/2491533301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6815d2d0 0x7fbd680ae020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542b33a3efeb3657 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.807+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c037070 con 0x7fbd6815d2d0 2024-06-02T16:45:50.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.807+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c02ac50 con 0x7fbd6815d2d0 2024-06-02T16:45:50.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.807+0000 7fbd67400640 1 -- 172.21.15.52:0/2491533301 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60001c40 con 0x7fbd6815d2d0 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.807+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2491533301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6815d2d0 msgr2=0x7fbd680ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.807+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2491533301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6815d2d0 0x7fbd680ae020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a1c0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.808+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2491533301 shutdown_connections 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.808+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2491533301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6815d2d0 0x7fbd680ae020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.808+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2491533301 >> 172.21.15.52:0/2491533301 conn(0x7fbd6806c7a0 msgr2=0x7fbd6806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.808+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2491533301 shutdown_connections 2024-06-02T16:45:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.808+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2491533301 wait complete. 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.810+0000 7fbd6fa00640 1 Processor -- start 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.810+0000 7fbd6fa00640 1 -- start start 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.811+0000 7fbd6fa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6806fed0 0x7fbd6814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.811+0000 7fbd6fa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 0x7fbd680ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.811+0000 7fbd6fa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.811+0000 7fbd6fa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd680741b0 con 0x7fbd6815d2d0 2024-06-02T16:45:50.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6fa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6806ed90 con 0x7fbd6806fed0 2024-06-02T16:45:50.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6fa00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbd681597e0 con 0x7fbd680d1b60 2024-06-02T16:45:50.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58500/0 (socket says 172.21.15.52:58500) 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6da00640 1 -- 172.21.15.52:0/2422635942 learned_addr learned my addr 172.21.15.52:0/2422635942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd67e00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 0x7fbd680ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.812+0000 7fbd6d000640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6806fed0 0x7fbd6814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 -- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 msgr2=0x7fbd680ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 0x7fbd680ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 -- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6806fed0 msgr2=0x7fbd6814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6806fed0 0x7fbd6814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 -- 172.21.15.52:0/2422635942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd68159a80 con 0x7fbd6815d2d0 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd67e00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 0x7fbd680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6da00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000cbe0 tx=0x7fbd6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd6815d2d0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6000ad40 con 0x7fbd6815d2d0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60012620 con 0x7fbd6815d2d0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.813+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd68159d60 con 0x7fbd6815d2d0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.814+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6815a320 con 0x7fbd6815d2d0 2024-06-02T16:45:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.815+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd68069520 con 0x7fbd6815d2d0 2024-06-02T16:45:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.816+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd6001a070 con 0x7fbd6815d2d0 2024-06-02T16:45:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.817+0000 7fbd64c00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 0x7fbd48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.818+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd60097520 con 0x7fbd6815d2d0 2024-06-02T16:45:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.818+0000 7fbd6d000640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 0x7fbd48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:50.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.819+0000 7fbd6d000640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 0x7fbd48078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c034000 tx=0x7fbd5c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:50.822+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd680ae8e0 con 0x7fbd6815d2d0 2024-06-02T16:45:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.065+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd68158a30 con 0x7fbd6815d2d0 2024-06-02T16:45:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.066+0000 7fbd64c00640 1 -- 172.21.15.52:0/2422635942 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fbd60060700 con 0x7fbd6815d2d0 2024-06-02T16:45:51.065 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:51.065 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1222795990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1222795990},{"type":"v1","addr":"172.21.15.52:6834","nonce":1222795990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3486316879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3486316879},{"type":"v1","addr":"172.21.15.52:6835","nonce":3486316879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1943442161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1943442161},{"type":"v1","addr":"172.21.15.114:6835","nonce":1943442161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:45:11.730081+0000","modified":"2024-06-02T16:45:14.803414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1104742771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1104742771},{"type":"v1","addr":"172.21.15.114:6837","nonce":1104742771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-06-02T16:45:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 msgr2=0x7fbd48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 0x7fbd48078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c034000 tx=0x7fbd5c02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 msgr2=0x7fbd680b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000cbe0 tx=0x7fbd6000a430 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 shutdown_connections 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbd480762d0 0x7fbd48078790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd6815d2d0 0x7fbd680b29b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd680d1b60 0x7fbd680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 --2- 172.21.15.52:0/2422635942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd6806fed0 0x7fbd6814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 >> 172.21.15.52:0/2422635942 conn(0x7fbd6806c7a0 msgr2=0x7fbd68157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.069+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 shutdown_connections 2024-06-02T16:45:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.070+0000 7fbd6fa00640 1 -- 172.21.15.52:0/2422635942 wait complete. 2024-06-02T16:45:51.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:45:51.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.297+0000 7f935f200640 1 Processor -- start 2024-06-02T16:45:51.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.297+0000 7f935f200640 1 -- start start 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.298+0000 7f935f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f936006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93601604d0 0x7f936006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 0x7f93601632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9360163800 con 0x7f93601604d0 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f936015fa10 con 0x7f9360162e10 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9360163ab0 con 0x7f936015cce0 2024-06-02T16:45:51.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93601604d0 0x7f936006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93601604d0 0x7f936006e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58504/0 (socket says 172.21.15.52:58504) 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 -- 172.21.15.52:0/2278008404 learned_addr learned my addr 172.21.15.52:0/2278008404 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935de00640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f936006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935e800640 1 --2- 172.21.15.52:0/2278008404 >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 0x7f93601632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 -- 172.21.15.52:0/2278008404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 msgr2=0x7f936006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f936006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 -- 172.21.15.52:0/2278008404 >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 msgr2=0x7f93601632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 --2- 172.21.15.52:0/2278008404 >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 0x7f93601632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935d400640 1 -- 172.21.15.52:0/2278008404 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936015fcd0 con 0x7f93601604d0 2024-06-02T16:45:51.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.299+0000 7f935e800640 1 --2- 172.21.15.52:0/2278008404 >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 0x7f93601632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.301+0000 7f935d400640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f936006e670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93600b6560 tx=0x7f934c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb46c48b790b93d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.301+0000 7f935ca00640 1 -- 172.21.15.52:0/2278008404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c037070 con 0x7f93601604d0 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.301+0000 7f935ca00640 1 -- 172.21.15.52:0/2278008404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c032440 con 0x7f93601604d0 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.301+0000 7f935ca00640 1 -- 172.21.15.52:0/2278008404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c032810 con 0x7f93601604d0 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 -- 172.21.15.52:0/2278008404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 msgr2=0x7f936006e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f936006e670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93600b6560 tx=0x7f934c02a1e0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 -- 172.21.15.52:0/2278008404 shutdown_connections 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 --2- 172.21.15.52:0/2278008404 >> v2:172.21.15.114:3300/0 conn(0x7f9360162e10 0x7f93601632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f936006e670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 --2- 172.21.15.52:0/2278008404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f936006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 -- 172.21.15.52:0/2278008404 >> 172.21.15.52:0/2278008404 conn(0x7f936006c380 msgr2=0x7f936006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:51.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 -- 172.21.15.52:0/2278008404 shutdown_connections 2024-06-02T16:45:51.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.302+0000 7f935f200640 1 -- 172.21.15.52:0/2278008404 wait complete. 2024-06-02T16:45:51.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.304+0000 7f935f200640 1 Processor -- start 2024-06-02T16:45:51.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.304+0000 7f935f200640 1 -- start start 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f93600b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9360162e10 0x7f93601f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f93600ae830 con 0x7f93601604d0 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f936015d0c0 con 0x7f9360162e10 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f93600ae9b0 con 0x7f936015cce0 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58516/0 (socket says 172.21.15.52:58516) 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935d400640 1 -- 172.21.15.52:0/3245621323 learned_addr learned my addr 172.21.15.52:0/3245621323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935e800640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9360162e10 0x7f93601f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935de00640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f93600b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.305+0000 7f935d400640 1 -- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 msgr2=0x7f93600b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935d400640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f93600b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935d400640 1 -- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9360162e10 msgr2=0x7f93601f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935d400640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9360162e10 0x7f93601f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935d400640 1 -- 172.21.15.52:0/3245621323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600b3230 con 0x7f93601604d0 2024-06-02T16:45:51.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935d400640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f934c02a220 tx=0x7f934c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c037040 con 0x7f93601604d0 2024-06-02T16:45:51.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c042070 con 0x7f93601604d0 2024-06-02T16:45:51.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c030bb0 con 0x7f93601604d0 2024-06-02T16:45:51.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.306+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93600b16d0 con 0x7f93601604d0 2024-06-02T16:45:51.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.307+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93600b1c90 con 0x7f93601604d0 2024-06-02T16:45:51.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.308+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9360075ea0 con 0x7f93601604d0 2024-06-02T16:45:51.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.309+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f934c047460 con 0x7f93601604d0 2024-06-02T16:45:51.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.310+0000 7f9356000640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 0x7f9340078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.310+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f934c0b8260 con 0x7f93601604d0 2024-06-02T16:45:51.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.310+0000 7f935de00640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 0x7f9340078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.312+0000 7f935de00640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 0x7f9340078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.315+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f934c081bb0 con 0x7f93601604d0 2024-06-02T16:45:51.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.525+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93600af840 con 0x7f93601604d0 2024-06-02T16:45:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.528+0000 7f9356000640 1 -- 172.21.15.52:0/3245621323 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16605 (secure 0 0 0) 0x7f934c0814b0 con 0x7f93601604d0 2024-06-02T16:45:51.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:51.527 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:45:13.280842+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:45:09.761692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T16:45:10.725639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:45:51.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.530+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 msgr2=0x7f9340078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.530+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 0x7f9340078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f9350008040 comp rx=0 tx=0).stop 2024-06-02T16:45:51.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.530+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 msgr2=0x7f93601f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.530+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f934c02a220 tx=0x7f934c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.530+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 shutdown_connections 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f93400762d0 0x7f9340078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9360162e10 0x7f93601f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93601604d0 0x7f93601f6410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 --2- 172.21.15.52:0/3245621323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f936015cce0 0x7f93600b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 >> 172.21.15.52:0/3245621323 conn(0x7f936006c380 msgr2=0x7f93600b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 shutdown_connections 2024-06-02T16:45:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.531+0000 7f935f200640 1 -- 172.21.15.52:0/3245621323 wait complete. 2024-06-02T16:45:51.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T16:45:51.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.763+0000 7fb173200640 1 Processor -- start 2024-06-02T16:45:51.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.764+0000 7fb173200640 1 -- start start 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.765+0000 7fb173200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17415d010 0x7fb1741615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb173200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 0x7fb17406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb173200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1740cef00 con 0x7fb1740cd890 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb173200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb1740cf1e0 con 0x7fb17415d010 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb173200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb174160dc0 con 0x7fb17406e130 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17415d010 0x7fb1741615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17415d010 0x7fb1741615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58526/0 (socket says 172.21.15.52:58526) 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 -- 172.21.15.52:0/2655277505 learned_addr learned my addr 172.21.15.52:0/2655277505 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb172800640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 0x7fb17406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 -- 172.21.15.52:0/2655277505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 msgr2=0x7fb17406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 0x7fb17406e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 -- 172.21.15.52:0/2655277505 >> v1:172.21.15.52:6789/0 conn(0x7fb1740cd890 legacy=0x7fb1740ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb171e00640 1 -- 172.21.15.52:0/2655277505 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1741610a0 con 0x7fb17415d010 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.766+0000 7fb172800640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 0x7fb17406e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:51.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb171e00640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17415d010 0x7fb1741615c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb164009870 tx=0x7fb16402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdda25a982587605 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb170a00640 1 -- 172.21.15.52:0/2655277505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164037070 con 0x7fb17415d010 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb170a00640 1 -- 172.21.15.52:0/2655277505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb164032440 con 0x7fb17415d010 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb170a00640 1 -- 172.21.15.52:0/2655277505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164032810 con 0x7fb17415d010 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb173200640 1 -- 172.21.15.52:0/2655277505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17415d010 msgr2=0x7fb1741615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.768+0000 7fb173200640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17415d010 0x7fb1741615c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb164009870 tx=0x7fb16402a250 comp rx=0 tx=0).stop 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 -- 172.21.15.52:0/2655277505 shutdown_connections 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb17406e130 0x7fb17406e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 --2- 172.21.15.52:0/2655277505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17415d010 0x7fb1741615c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 -- 172.21.15.52:0/2655277505 >> 172.21.15.52:0/2655277505 conn(0x7fb17406c380 msgr2=0x7fb17406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 -- 172.21.15.52:0/2655277505 shutdown_connections 2024-06-02T16:45:51.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.769+0000 7fb173200640 1 -- 172.21.15.52:0/2655277505 wait complete. 2024-06-02T16:45:51.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.770+0000 7fb173200640 1 Processor -- start 2024-06-02T16:45:51.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.771+0000 7fb173200640 1 -- start start 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.771+0000 7fb173200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb173200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 0x7fb174145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb173200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 0x7fb1740cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb173200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb17415d570 con 0x7fb17406e130 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb173200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb17415d3f0 con 0x7fb17415d010 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb173200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb17415d6f0 con 0x7fb1740cd890 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58534/0 (socket says 172.21.15.52:58534) 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 -- 172.21.15.52:0/893209292 learned_addr learned my addr 172.21.15.52:0/893209292 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb172800640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 0x7fb1740cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 -- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 msgr2=0x7fb174145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171400640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 0x7fb174145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 0x7fb174145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 -- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 msgr2=0x7fb1740cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 0x7fb1740cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171e00640 1 -- 172.21.15.52:0/893209292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb174153b40 con 0x7fb17406e130 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.772+0000 7fb171400640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 0x7fb174145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.773+0000 7fb172800640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 0x7fb1740cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.773+0000 7fb171e00640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb16402a290 tx=0x7fb1640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.773+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164037040 con 0x7fb17406e130 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.773+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb164042070 con 0x7fb17406e130 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.773+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164030bd0 con 0x7fb17406e130 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.774+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb174145b40 con 0x7fb17406e130 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.774+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741f8fc0 con 0x7fb17406e130 2024-06-02T16:45:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.775+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1740507e0 con 0x7fb17406e130 2024-06-02T16:45:51.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.776+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb164047460 con 0x7fb17406e130 2024-06-02T16:45:51.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.777+0000 7fb16a000640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 0x7fb154078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:51.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.777+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb1640b82f0 con 0x7fb17406e130 2024-06-02T16:45:51.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.778+0000 7fb171400640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 0x7fb154078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:51.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.779+0000 7fb171400640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 0x7fb154078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b5c60 tx=0x7fb160009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:51.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:51.782+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb164081bb0 con 0x7fb17406e130 2024-06-02T16:45:52.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.039+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb17406f0b0 con 0x7fb17406e130 2024-06-02T16:45:52.038 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-06-02T16:45:52.040+0000 7f30fc200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T16:45:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.043+0000 7fb16a000640 1 -- 172.21.15.52:0/893209292 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb1640814b0 con 0x7fb17406e130 2024-06-02T16:45:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T16:45:52.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.047+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 msgr2=0x7fb154078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.047+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 0x7fb154078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b5c60 tx=0x7fb160009040 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.047+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 msgr2=0x7fb1740b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.047+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb16402a290 tx=0x7fb1640046c0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 shutdown_connections 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1540762d0 0x7fb154078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17415d010 0x7fb1740cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1740cd890 0x7fb174145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 --2- 172.21.15.52:0/893209292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406e130 0x7fb1740b3fb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 >> 172.21.15.52:0/893209292 conn(0x7fb17406c380 msgr2=0x7fb17415c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 shutdown_connections 2024-06-02T16:45:52.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.048+0000 7fb173200640 1 -- 172.21.15.52:0/893209292 wait complete. 2024-06-02T16:45:52.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T16:45:52.085 INFO:tasks.ceph.mds.b.smithi114.stderr: -4414> 2024-06-02T16:45:18.000+0000 7f19b7a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T16:45:52.173 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2024-06-02T16:45:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.278+0000 7fb198400640 1 Processor -- start 2024-06-02T16:45:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.279+0000 7fb198400640 1 -- start start 2024-06-02T16:45:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb198400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 0x7fb1900adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb198400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb19015ec80 0x7fb1900ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb198400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb19009eec0 con 0x7fb19015d8b0 2024-06-02T16:45:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb198400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb19006ebd0 con 0x7fb19015ec80 2024-06-02T16:45:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb198400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb19015e490 con 0x7fb1900b0610 2024-06-02T16:45:52.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb196400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb19015d8b0 0x7fb1901600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54800/0 (socket says 172.21.15.52:54800) 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.280+0000 7fb196400640 1 -- 172.21.15.52:0/3765165326 learned_addr learned my addr 172.21.15.52:0/3765165326 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb195000640 1 --2- 172.21.15.52:0/3765165326 >> v2:172.21.15.114:3300/0 conn(0x7fb19015ec80 0x7fb1900ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb195a00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 0x7fb1900adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137615074 0 0) 0x7fb19009eec0 con 0x7fb19015d8b0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb178003520 con 0x7fb19015d8b0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2449196160 0 0) 0x7fb178003520 con 0x7fb19015d8b0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 msgr2=0x7fb1900adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 0x7fb1900adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 >> v2:172.21.15.114:3300/0 conn(0x7fb19015ec80 msgr2=0x7fb1900ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 --2- 172.21.15.52:0/3765165326 >> v2:172.21.15.114:3300/0 conn(0x7fb19015ec80 0x7fb1900ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19015e770 con 0x7fb19015d8b0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fb188001a70 con 0x7fb19015d8b0 2024-06-02T16:45:52.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 >> v1:172.21.15.52:6789/0 conn(0x7fb19015d8b0 legacy=0x7fb1901600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb178003a50 0x7fb178003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 0x7fb178004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004d40 0x7fb1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb19006ebd0 con 0x7fb178003a50 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb19015e490 con 0x7fb178004d40 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.281+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb17800ba90 con 0x7fb1900b0610 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb178003a50 0x7fb178003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 -- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 msgr2=0x7fb178004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1900b0610 0x7fb178004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 -- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004d40 msgr2=0x7fb1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004d40 0x7fb1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.282+0000 7fb195a00640 1 -- 172.21.15.52:0/3765165326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb178003520 con 0x7fb178003a50 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.283+0000 7fb195a00640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb178003a50 0x7fb178003e70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb184009ac0 tx=0x7fb178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90efda66a219f557 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.283+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184036070 con 0x7fb178003a50 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.283+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb184031400 con 0x7fb178003a50 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.283+0000 7fb18fe00640 1 -- 172.21.15.52:0/3765165326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184009690 con 0x7fb178003a50 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 -- 172.21.15.52:0/3765165326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb178003a50 msgr2=0x7fb178003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 --2- 172.21.15.52:0/3765165326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb178003a50 0x7fb178003e70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb184009ac0 tx=0x7fb178005830 comp rx=0 tx=0).stop 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb196400640 1 -- 172.21.15.52:0/3765165326 reap_dead start 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 -- 172.21.15.52:0/3765165326 shutdown_connections 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 -- 172.21.15.52:0/3765165326 >> 172.21.15.52:0/3765165326 conn(0x7fb1900b3200 msgr2=0x7fb1900d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 -- 172.21.15.52:0/3765165326 shutdown_connections 2024-06-02T16:45:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.284+0000 7fb198400640 1 -- 172.21.15.52:0/3765165326 wait complete. 2024-06-02T16:45:52.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.286+0000 7fb198400640 1 Processor -- start 2024-06-02T16:45:52.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.286+0000 7fb198400640 1 -- start start 2024-06-02T16:45:52.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb178003a50 0x7fb1901f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900b1a40 0x7fb1900b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900adeb0 con 0x7fb190072fc0 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb19006e860 con 0x7fb1900b1a40 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb198400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb1900ae030 con 0x7fb178003a50 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.287+0000 7fb195000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58540/0 (socket says 172.21.15.52:58540) 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 -- 172.21.15.52:0/2536661687 learned_addr learned my addr 172.21.15.52:0/2536661687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195a00640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb178003a50 0x7fb1901f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb196400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900b1a40 0x7fb1900b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 -- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb178003a50 msgr2=0x7fb1901f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb178003a50 0x7fb1901f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 -- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900b1a40 msgr2=0x7fb1900b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:52.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900b1a40 0x7fb1900b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:52.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 -- 172.21.15.52:0/2536661687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1901f6630 con 0x7fb190072fc0 2024-06-02T16:45:52.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb195000640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00e7c0 tx=0x7fb17c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:52.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.288+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c017070 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.289+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c00c940 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.289+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00cd30 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.289+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb190072520 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.289+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb190161730 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.290+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb190069520 con 0x7fb190072fc0 2024-06-02T16:45:52.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.291+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb17c01a070 con 0x7fb190072fc0 2024-06-02T16:45:52.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.293+0000 7fb18d600640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 0x7fb1700787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:52.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.293+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7fb17c0975d0 con 0x7fb190072fc0 2024-06-02T16:45:52.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.293+0000 7fb195a00640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 0x7fb1700787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:52.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.295+0000 7fb195a00640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 0x7fb1700787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb184033000 tx=0x7fb184008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:52.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.298+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb1901f6630 con 0x7fb190072fc0 2024-06-02T16:45:52.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:52.543+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb1900b3fd0 con 0x7fb190072fc0 2024-06-02T16:45:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.060+0000 7fb18d600640 1 -- 172.21.15.52:0/2536661687 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fb17c060da0 con 0x7fb190072fc0 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.064+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 msgr2=0x7fb1700787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.064+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 0x7fb1700787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb184033000 tx=0x7fb184008030 comp rx=0 tx=0).stop 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.064+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 msgr2=0x7fb1901607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.064+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00e7c0 tx=0x7fb17c00ec80 comp rx=0 tx=0).stop 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 shutdown_connections 2024-06-02T16:45:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb170076300 0x7fb1700787c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900b1a40 0x7fb1900b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb190072fc0 0x7fb1901607a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 --2- 172.21.15.52:0/2536661687 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb178003a50 0x7fb1901f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 >> 172.21.15.52:0/2536661687 conn(0x7fb1900b3200 msgr2=0x7fb19015c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 shutdown_connections 2024-06-02T16:45:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.065+0000 7fb198400640 1 -- 172.21.15.52:0/2536661687 wait complete. 2024-06-02T16:45:53.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T16:45:53.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.300+0000 7f3932200640 1 Processor -- start 2024-06-02T16:45:53.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.300+0000 7f3932200640 1 -- start start 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.301+0000 7f3932200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 0x7f392c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.301+0000 7f3932200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f392c072aa0 0x7f392c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.301+0000 7f3932200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0b54b0 con 0x7f392c0b58b0 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.301+0000 7f3932200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f392c0b3ed0 con 0x7f392c072aa0 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.301+0000 7f3932200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0b41b0 con 0x7f392c06f950 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f392be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f392c0b58b0 0x7f392c072390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46984/0 (socket says 172.21.15.52:46984) 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f392be00640 1 -- 172.21.15.52:0/1515715211 learned_addr learned my addr 172.21.15.52:0/1515715211 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f3930e00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 0x7f392c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f3931800640 1 --2- 172.21.15.52:0/1515715211 >> v2:172.21.15.114:3300/0 conn(0x7f392c072aa0 0x7f392c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741993483 0 0) 0x7f392c0b54b0 con 0x7f392c0b58b0 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.302+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3914003520 con 0x7f392c0b58b0 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3444493428 0 0) 0x7f3914003520 con 0x7f392c0b58b0 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 msgr2=0x7f392c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 0x7f392c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 >> v2:172.21.15.114:3300/0 conn(0x7f392c072aa0 msgr2=0x7f392c06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 --2- 172.21.15.52:0/1515715211 >> v2:172.21.15.114:3300/0 conn(0x7f392c072aa0 0x7f392c06e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0b4490 con 0x7f392c0b58b0 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f39180016f0 con 0x7f392c0b58b0 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 >> v1:172.21.15.52:6789/0 conn(0x7f392c0b58b0 legacy=0x7f392c072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3914003a70 0x7f3914003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3914004800 0x7f3914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 0x7f39140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0b3ed0 con 0x7f3914003a70 2024-06-02T16:45:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0b41b0 con 0x7f3914004800 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f391400baf0 con 0x7f392c06f950 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f3931800640 1 --2- 172.21.15.52:0/1515715211 >> v2:172.21.15.114:3300/0 conn(0x7f392c072aa0 0x7f392c06e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.303+0000 7f3930e00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3914003a70 0x7f3914003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f392be00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3914004800 0x7f3914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f3930e00640 1 -- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 msgr2=0x7f39140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f3930e00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06f950 0x7f39140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f3930e00640 1 -- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3914004800 msgr2=0x7f3914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f3930e00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3914004800 0x7f3914004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.304+0000 7f3930e00640 1 -- 172.21.15.52:0/1515715211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3914003520 con 0x7f3914003a70 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.305+0000 7f3930e00640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3914003a70 0x7f3914003e90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3920009a90 tx=0x7f3914005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8545dbf045bfb79f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.305+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920036070 con 0x7f3914003a70 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.305+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3920031400 con 0x7f3914003a70 2024-06-02T16:45:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.305+0000 7f392b400640 1 -- 172.21.15.52:0/1515715211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920009690 con 0x7f3914003a70 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 -- 172.21.15.52:0/1515715211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3914003a70 msgr2=0x7f3914003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 --2- 172.21.15.52:0/1515715211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3914003a70 0x7f3914003e90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3920009a90 tx=0x7f3914005830 comp rx=0 tx=0).stop 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3931800640 1 -- 172.21.15.52:0/1515715211 reap_dead start 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 -- 172.21.15.52:0/1515715211 shutdown_connections 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 -- 172.21.15.52:0/1515715211 >> 172.21.15.52:0/1515715211 conn(0x7f392c0b2bd0 msgr2=0x7f392c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 -- 172.21.15.52:0/1515715211 shutdown_connections 2024-06-02T16:45:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.306+0000 7f3932200640 1 -- 172.21.15.52:0/1515715211 wait complete. 2024-06-02T16:45:53.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.307+0000 7f3932200640 1 Processor -- start 2024-06-02T16:45:53.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.308+0000 7f3932200640 1 -- start start 2024-06-02T16:45:53.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3914003a70 0x7f392c147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0af390 0x7f392c0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c06fd30 con 0x7f392c09d3e0 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0b4a50 con 0x7f392c0af390 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3932200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f392c1594d0 con 0x7f3914003a70 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51358/0 (socket says 172.21.15.52:51358) 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 -- 172.21.15.52:0/2307107224 learned_addr learned my addr 172.21.15.52:0/2307107224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3931800640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0af390 0x7f392c0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f3930e00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3914003a70 0x7f392c147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 -- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3914003a70 msgr2=0x7f392c147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3914003a70 0x7f392c147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 -- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0af390 msgr2=0x7f392c0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0af390 0x7f392c0af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.309+0000 7f392be00640 1 -- 172.21.15.52:0/2307107224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1597b0 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f392be00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f391800d770 tx=0x7f391800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180074e0 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391800de20 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c159a90 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918004a00 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.310+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c09e2f0 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.311+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c0507e0 con 0x7f392c09d3e0 2024-06-02T16:45:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.313+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f391801b020 con 0x7f392c09d3e0 2024-06-02T16:45:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.313+0000 7f3928c00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 0x7f390c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.314+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5940+0+0 (secure 0 0 0) 0x7f39180973f0 con 0x7f392c09d3e0 2024-06-02T16:45:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.314+0000 7f3930e00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 0x7f390c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.315+0000 7f3930e00640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 0x7f390c078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3920033000 tx=0x7f3920008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.318+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3918060c60 con 0x7f392c09d3e0 2024-06-02T16:45:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:53.527+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f392c06feb0 con 0x7f392c09d3e0 2024-06-02T16:45:54.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.535+0000 7f3928c00640 1 -- 172.21.15.52:0/2307107224 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7f3918060560 con 0x7f392c09d3e0 2024-06-02T16:45:54.535 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-06-02T16:45:54.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.539+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 msgr2=0x7f390c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.539+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 0x7f390c078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3920033000 tx=0x7f3920008030 comp rx=0 tx=0).stop 2024-06-02T16:45:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.539+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 msgr2=0x7f392c09d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.539+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f391800d770 tx=0x7f391800dc30 comp rx=0 tx=0).stop 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 shutdown_connections 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f390c0762d0 0x7f390c078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0af390 0x7f392c0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c09d3e0 0x7f392c09d860 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 --2- 172.21.15.52:0/2307107224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3914003a70 0x7f392c147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.541+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 >> 172.21.15.52:0/2307107224 conn(0x7f392c0b2bd0 msgr2=0x7f392c072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.542+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 shutdown_connections 2024-06-02T16:45:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.542+0000 7f3932200640 1 -- 172.21.15.52:0/2307107224 wait complete. 2024-06-02T16:45:54.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T16:45:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.777+0000 7f33bb200640 1 Processor -- start 2024-06-02T16:45:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.777+0000 7f33bb200640 1 -- start start 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.778+0000 7f33bb200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 0x7f33b4072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.778+0000 7f33bb200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33b416b7c0 0x7f33b416dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.778+0000 7f33bb200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b406ee10 con 0x7f33b415dfa0 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.778+0000 7f33bb200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f33b406feb0 con 0x7f33b416b7c0 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.778+0000 7f33bb200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f33b4167230 con 0x7f33b4072390 2024-06-02T16:45:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33b9e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f33b415dfa0 0x7f33b406e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46994/0 (socket says 172.21.15.52:46994) 2024-06-02T16:45:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33b9e00640 1 -- 172.21.15.52:0/3773627948 learned_addr learned my addr 172.21.15.52:0/3773627948 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33ba800640 1 --2- 172.21.15.52:0/3773627948 >> v2:172.21.15.52:3300/0 conn(0x7f33b416b7c0 0x7f33b416dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33b8a00640 1 -- 172.21.15.52:0/3773627948 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583891314 0 0) 0x7f33b406ee10 con 0x7f33b415dfa0 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33b9400640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 0x7f33b4072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33ba800640 1 -- 172.21.15.52:0/3773627948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 msgr2=0x7f33b4072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33ba800640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 0x7f33b4072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33ba800640 1 -- 172.21.15.52:0/3773627948 >> v1:172.21.15.52:6789/0 conn(0x7f33b415dfa0 legacy=0x7f33b406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33ba800640 1 -- 172.21.15.52:0/3773627948 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b406f0f0 con 0x7f33b416b7c0 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.779+0000 7f33b9400640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 0x7f33b4072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.780+0000 7f33ba800640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b416b7c0 0x7f33b416dbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009d90 tx=0x7f33b002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea57801e8411b09 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33b8a00640 1 -- 172.21.15.52:0/3773627948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b002ae60 con 0x7f33b416b7c0 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33b8a00640 1 -- 172.21.15.52:0/3773627948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b0007740 con 0x7f33b416b7c0 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33b8a00640 1 -- 172.21.15.52:0/3773627948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0007b10 con 0x7f33b416b7c0 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 -- 172.21.15.52:0/3773627948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b416b7c0 msgr2=0x7f33b416dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b416b7c0 0x7f33b416dbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009d90 tx=0x7f33b002a640 comp rx=0 tx=0).stop 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 -- 172.21.15.52:0/3773627948 shutdown_connections 2024-06-02T16:45:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b416b7c0 0x7f33b416dbb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 --2- 172.21.15.52:0/3773627948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b4072390 0x7f33b4072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 -- 172.21.15.52:0/3773627948 >> 172.21.15.52:0/3773627948 conn(0x7f33b40b2bd0 msgr2=0x7f33b40b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 -- 172.21.15.52:0/3773627948 shutdown_connections 2024-06-02T16:45:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.781+0000 7f33bb200640 1 -- 172.21.15.52:0/3773627948 wait complete. 2024-06-02T16:45:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.783+0000 7f33bb200640 1 Processor -- start 2024-06-02T16:45:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.783+0000 7f33bb200640 1 -- start start 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b415dfa0 0x7f33b409cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b416b7c0 0x7f33b415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f33b406f990 con 0x7f33b4072390 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33b406f6b0 con 0x7f33b416b7c0 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33bb200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f33b4164070 con 0x7f33b415dfa0 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.784+0000 7f33b9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51370/0 (socket says 172.21.15.52:51370) 2024-06-02T16:45:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 -- 172.21.15.52:0/913664590 learned_addr learned my addr 172.21.15.52:0/913664590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 -- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b415dfa0 msgr2=0x7f33b409cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b415dfa0 0x7f33b409cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 -- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b416b7c0 msgr2=0x7f33b415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b416b7c0 0x7f33b415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 -- 172.21.15.52:0/913664590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b409d660 con 0x7f33b4072390 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33b9e00640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c490 tx=0x7f33a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.785+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8018070 con 0x7f33b4072390 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.786+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8007500 con 0x7f33b4072390 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.786+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8004a20 con 0x7f33b4072390 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.786+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b409d940 con 0x7f33b4072390 2024-06-02T16:45:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.786+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b409e1e0 con 0x7f33b4072390 2024-06-02T16:45:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.787+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b409db10 con 0x7f33b4072390 2024-06-02T16:45:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.788+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33a8004bc0 con 0x7f33b4072390 2024-06-02T16:45:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.789+0000 7f33ae000640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 0x7f3394078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.789+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5502+0+0 (secure 0 0 0) 0x7f33a80969a0 con 0x7f33b4072390 2024-06-02T16:45:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.790+0000 7f33b9400640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 0x7f3394078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.791+0000 7f33b9400640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 0x7f3394078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33a0006fd0 tx=0x7f33a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:54.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:54.793+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f33a8060330 con 0x7f33b4072390 2024-06-02T16:45:55.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.004+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f33b40507e0 con 0x7f33b4072390 2024-06-02T16:45:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.540+0000 7f33ae000640 1 -- 172.21.15.52:0/913664590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f33a805fc30 con 0x7f33b4072390 2024-06-02T16:45:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 msgr2=0x7f3394078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 0x7f3394078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33a0006fd0 tx=0x7f33a0008040 comp rx=0 tx=0).stop 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 msgr2=0x7f33b415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c490 tx=0x7f33a800c950 comp rx=0 tx=0).stop 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 shutdown_connections 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33940762d0 0x7f3394078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b416b7c0 0x7f33b415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33b415dfa0 0x7f33b409cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 --2- 172.21.15.52:0/913664590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33b4072390 0x7f33b415cc50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.543+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 >> 172.21.15.52:0/913664590 conn(0x7f33b40b2bd0 msgr2=0x7f33b40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.544+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 shutdown_connections 2024-06-02T16:45:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.544+0000 7f33bb200640 1 -- 172.21.15.52:0/913664590 wait complete. 2024-06-02T16:45:55.567 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T16:45:55.567 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T16:45:55.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T16:45:55.568 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:45:55.568 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T16:45:55.568 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T16:45:55.568 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T16:45:55.568 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:45:55.568 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T16:45:55.569 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T16:45:55.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T16:45:55.569 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:45:55.569 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T16:45:55.569 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T16:45:55.569 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T16:45:55.569 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:45:55.586 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T16:45:55.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T16:45:55.587 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T16:45:55.587 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T16:45:55.592 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T16:45:55.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T16:45:55.594 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T16:45:55.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T16:45:55.632 INFO:tasks.ceph.mds.a:Started 2024-06-02T16:45:55.633 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:55.640 INFO:tasks.ceph.mds.c:Started 2024-06-02T16:45:55.640 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:55.641 INFO:tasks.ceph.mds.b:Started 2024-06-02T16:45:55.642 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:55.647 INFO:tasks.ceph.mds.d:Started 2024-06-02T16:45:55.647 DEBUG:teuthology.parallel:result is None 2024-06-02T16:45:55.648 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T16:45:55.785 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-06-02T16:45:55.791 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-06-02T16:45:55.791 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2024-06-02T16:45:55.792 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2024-06-02T16:45:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.836+0000 7f1c67c00640 1 Processor -- start 2024-06-02T16:45:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.836+0000 7f1c67c00640 1 -- start start 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c67c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c600b43d0 0x7f1c60163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c67c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c60164180 0x7f1c60162850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c67c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c600d5fa0 con 0x7f1c60163860 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c67c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6006f090 con 0x7f1c60164180 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c67c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c600d6210 con 0x7f1c600b43d0 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c65c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c60164180 0x7f1c60162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c65c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c60164180 0x7f1c60162850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51424/0 (socket says 172.21.15.52:51424) 2024-06-02T16:45:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c5fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c600b43d0 0x7f1c60163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.837+0000 7f1c65c00640 1 -- 172.21.15.52:0/2372299401 learned_addr learned my addr 172.21.15.52:0/2372299401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.838+0000 7f1c65c00640 1 -- 172.21.15.52:0/2372299401 >> v2:172.21.15.114:3300/0 conn(0x7f1c600b43d0 msgr2=0x7f1c60163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.838+0000 7f1c65c00640 1 --2- 172.21.15.52:0/2372299401 >> v2:172.21.15.114:3300/0 conn(0x7f1c600b43d0 0x7f1c60163c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.838+0000 7f1c65c00640 1 -- 172.21.15.52:0/2372299401 >> v1:172.21.15.114:6789/0 conn(0x7f1c60163860 legacy=0x7f1c600d3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.838+0000 7f1c65c00640 1 -- 172.21.15.52:0/2372299401 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6006f370 con 0x7f1c60164180 2024-06-02T16:45:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.839+0000 7f1c65c00640 1 --2- 172.21.15.52:0/2372299401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60164180 0x7f1c60162850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c6008dc40 tx=0x7f1c5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275700156431b25e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.839+0000 7f1c5f400640 1 -- 172.21.15.52:0/2372299401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58036070 con 0x7f1c60164180 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.839+0000 7f1c5f400640 1 -- 172.21.15.52:0/2372299401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58031600 con 0x7f1c60164180 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.839+0000 7f1c5f400640 1 -- 172.21.15.52:0/2372299401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580319d0 con 0x7f1c60164180 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 -- 172.21.15.52:0/2372299401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60164180 msgr2=0x7f1c60162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 --2- 172.21.15.52:0/2372299401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60164180 0x7f1c60162850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c6008dc40 tx=0x7f1c5802a6a0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 -- 172.21.15.52:0/2372299401 shutdown_connections 2024-06-02T16:45:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 --2- 172.21.15.52:0/2372299401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60164180 0x7f1c60162850 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 --2- 172.21.15.52:0/2372299401 >> v2:172.21.15.114:3300/0 conn(0x7f1c600b43d0 0x7f1c60163c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 -- 172.21.15.52:0/2372299401 >> 172.21.15.52:0/2372299401 conn(0x7f1c6008cf50 msgr2=0x7f1c600d55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 -- 172.21.15.52:0/2372299401 shutdown_connections 2024-06-02T16:45:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.840+0000 7f1c67c00640 1 -- 172.21.15.52:0/2372299401 wait complete. 2024-06-02T16:45:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.842+0000 7f1c67c00640 1 Processor -- start 2024-06-02T16:45:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.842+0000 7f1c67c00640 1 -- start start 2024-06-02T16:45:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c600b43d0 0x7f1c600bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c60164180 0x7f1c601516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60162f10 con 0x7f1c60163860 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60162d90 con 0x7f1c60164180 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c67c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1c60163090 con 0x7f1c600b43d0 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51438/0 (socket says 172.21.15.52:51438) 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c65200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c600b43d0 0x7f1c600bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c5fe00640 1 -- 172.21.15.52:0/1936191660 learned_addr learned my addr 172.21.15.52:0/1936191660 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.843+0000 7f1c65c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c60164180 0x7f1c601516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 -- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c600b43d0 msgr2=0x7f1c600bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c600b43d0 0x7f1c600bae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 -- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c60164180 msgr2=0x7f1c601516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c60164180 0x7f1c601516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 -- 172.21.15.52:0/1936191660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c600bb3d0 con 0x7f1c60163860 2024-06-02T16:45:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5fe00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00e9b0 tx=0x7f1c4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c017070 con 0x7f1c60163860 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00c9a0 con 0x7f1c60163860 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6014fa70 con 0x7f1c60163860 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00cd90 con 0x7f1c60163860 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.844+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c600caa90 con 0x7f1c60163860 2024-06-02T16:45:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.846+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c60069520 con 0x7f1c60163860 2024-06-02T16:45:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.847+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c4c01a070 con 0x7f1c60163860 2024-06-02T16:45:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.848+0000 7f1c5cc00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 0x7f1c40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.848+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7f1c4c097330 con 0x7f1c60163860 2024-06-02T16:45:55.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.849+0000 7f1c65200640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 0x7f1c40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:55.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.849+0000 7f1c65200640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 0x7f1c40078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c540017c0 tx=0x7f1c54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:55.853+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c4c0608a0 con 0x7f1c60163860 2024-06-02T16:45:56.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.077+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1c600b6960 con 0x7f1c60163860 2024-06-02T16:45:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.581+0000 7f1c5cc00640 1 -- 172.21.15.52:0/1936191660 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7f1c4c064ba0 con 0x7f1c60163860 2024-06-02T16:45:56.580 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-06-02T16:45:56.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 msgr2=0x7f1c40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 0x7f1c40078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c540017c0 tx=0x7f1c54009040 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 msgr2=0x7f1c600c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00e9b0 tx=0x7f1c4c00ee70 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 shutdown_connections 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1c400762d0 0x7f1c40078790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c60164180 0x7f1c601516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c60163860 0x7f1c600c88e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 --2- 172.21.15.52:0/1936191660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c600b43d0 0x7f1c600bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 >> 172.21.15.52:0/1936191660 conn(0x7f1c6008cf50 msgr2=0x7f1c600d3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 shutdown_connections 2024-06-02T16:45:56.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.586+0000 7f1c67c00640 1 -- 172.21.15.52:0/1936191660 wait complete. 2024-06-02T16:45:56.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T16:45:56.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.805+0000 7fe39b400640 1 Processor -- start 2024-06-02T16:45:56.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.805+0000 7fe39b400640 1 -- start start 2024-06-02T16:45:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.806+0000 7fe39b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe39415fd10 0x7fe39415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.806+0000 7fe39b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 0x7fe394160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.806+0000 7fe39b400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe3940d0750 0x7fe3940d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.806+0000 7fe39b400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe3940b1120 con 0x7fe39415fd10 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe39b400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe3940b5d00 con 0x7fe3941600f0 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe39b400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe3940b5fa0 con 0x7fe3940d0750 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe39415fd10 0x7fe39415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe39415fd10 0x7fe39415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51452/0 (socket says 172.21.15.52:51452) 2024-06-02T16:45:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 -- 172.21.15.52:0/1193873930 learned_addr learned my addr 172.21.15.52:0/1193873930 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe393e00640 1 --2- 172.21.15.52:0/1193873930 >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 0x7fe394160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 -- 172.21.15.52:0/1193873930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe3940d0750 msgr2=0x7fe3940d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 --2- 172.21.15.52:0/1193873930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe3940d0750 0x7fe3940d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 -- 172.21.15.52:0/1193873930 >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 msgr2=0x7fe394160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 --2- 172.21.15.52:0/1193873930 >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 0x7fe394160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe398a00640 1 -- 172.21.15.52:0/1193873930 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3940b6280 con 0x7fe39415fd10 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.807+0000 7fe393e00640 1 --2- 172.21.15.52:0/1193873930 >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 0x7fe394160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.808+0000 7fe398a00640 1 --2- 172.21.15.52:0/1193873930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe39415fd10 0x7fe39415d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe394063130 tx=0x7fe38802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd4ff411e32bae0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.809+0000 7fe393400640 1 -- 172.21.15.52:0/1193873930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388037070 con 0x7fe39415fd10 2024-06-02T16:45:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.809+0000 7fe393400640 1 -- 172.21.15.52:0/1193873930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388032440 con 0x7fe39415fd10 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.809+0000 7fe393400640 1 -- 172.21.15.52:0/1193873930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388032810 con 0x7fe39415fd10 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.809+0000 7fe39b400640 1 -- 172.21.15.52:0/1193873930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe39415fd10 msgr2=0x7fe39415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.809+0000 7fe39b400640 1 --2- 172.21.15.52:0/1193873930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe39415fd10 0x7fe39415d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe394063130 tx=0x7fe38802a1e0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 -- 172.21.15.52:0/1193873930 shutdown_connections 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 --2- 172.21.15.52:0/1193873930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe3940d0750 0x7fe3940d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 --2- 172.21.15.52:0/1193873930 >> v2:172.21.15.114:3300/0 conn(0x7fe3941600f0 0x7fe394160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 --2- 172.21.15.52:0/1193873930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe39415fd10 0x7fe39415d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 -- 172.21.15.52:0/1193873930 >> 172.21.15.52:0/1193873930 conn(0x7fe394073b70 msgr2=0x7fe39406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 -- 172.21.15.52:0/1193873930 shutdown_connections 2024-06-02T16:45:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.810+0000 7fe39b400640 1 -- 172.21.15.52:0/1193873930 wait complete. 2024-06-02T16:45:56.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.811+0000 7fe39b400640 1 Processor -- start 2024-06-02T16:45:56.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.812+0000 7fe39b400640 1 -- start start 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.812+0000 7fe39b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940d0750 0x7fe39406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.812+0000 7fe39b400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39415fd10 0x7fe3941f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe39b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe39b400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940b6d60 con 0x7fe3941600f0 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe39b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940b6840 con 0x7fe3940d0750 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe39b400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe394160a90 con 0x7fe39415fd10 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51460/0 (socket says 172.21.15.52:51460) 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 -- 172.21.15.52:0/534000358 learned_addr learned my addr 172.21.15.52:0/534000358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe398a00640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940d0750 0x7fe39406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 -- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39415fd10 msgr2=0x7fe3941f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39415fd10 0x7fe3941f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 -- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940d0750 msgr2=0x7fe39406ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940d0750 0x7fe39406ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.813+0000 7fe399400640 1 -- 172.21.15.52:0/534000358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941f9860 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe399400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b970 tx=0x7fe38c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c019070 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c00cb60 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c014440 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3941f9b40 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.814+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39414d8d0 con 0x7fe3941600f0 2024-06-02T16:45:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.815+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39414dad0 con 0x7fe3941600f0 2024-06-02T16:45:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.816+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe38c01c070 con 0x7fe3941600f0 2024-06-02T16:45:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.818+0000 7fe390c00640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 0x7fe374078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.818+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fe38c096ff0 con 0x7fe3941600f0 2024-06-02T16:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.819+0000 7fe398a00640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 0x7fe374078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.820+0000 7fe398a00640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 0x7fe374078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe388034000 tx=0x7fe38802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:56.823+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe39414dad0 con 0x7fe3941600f0 2024-06-02T16:45:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.117+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe3940cf1d0 con 0x7fe3941600f0 2024-06-02T16:45:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.118+0000 7fe390c00640 1 -- 172.21.15.52:0/534000358 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fe38c060c90 con 0x7fe3941600f0 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmkrauNRAAtSub8IGAOmQ8jfF/xTX67A==", 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmIbxBGRAAG68t8uJC+GuNbFc+SC8/NA==", 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.118 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmjEFeCRAA+YqDS+DB83q8NUpSJ8FO6A==", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmjpKiJhAAWpU4lunYnPmsz9zy/PDTdg==", 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.119 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBcoVxmbTuuExAAAzEdHpKz4dpD5YaxsFcPmQ==", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.120 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBfoVxmUW6eLhAA0LnI1X4gkZleDKWEsNX3tg==", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBioVxmAv0SOxAAlLO2sN1rvUm/UC4BoqAtZQ==", 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.121 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBmoVxmw9NuGhAAqFXZzV11Daf/s4vHmrz0Jw==", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBsoVxmqFpWJRAAOA2Nsp5qjzyy+QUEl17VqA==", 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBvoVxmh40YLxAAE/CjbilEWfYvm9s981NWFg==", 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQByoVxmfLmLOxAAKVMtkROjbvvGefI4R322Dw==", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB2oVxm4PEpCRAAnsHEBG7RsSY+jEhAyuN9ww==", 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.125 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ==", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:45:57.126 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxmRyQ6DBAA81tsOoBRr09hbKxgg/1YuQ==", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-06-02T16:45:57.127 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxmHDpvAhAAzdzaT56O4WUkRLNYHP3fnw==", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxm29IKFhAA3bLnZJX2M0CykpQt+g2JHA==", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:45:57.128 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBXoVxmii5JLxAAkh2TeU4jkTcYDNjHxHNHjA==", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.129 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mds", 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmA2nsIBAA86rk5XSE4Y+u7Ziq246lFg==", 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mds" 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mgr", 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmknLsIBAAeYkcrkxEuo1mTztVzVzLFA==", 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mgr" 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.130 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-osd", 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmMnzsIBAAf/VnpeICllvJJ9PmdvxTAQ==", 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-osd" 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd", 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmqoTsIBAAC7gZDH/RrtD4O4mvaA677g==", 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd" 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmZI3sIBAAj6li6WT7n8+2yWg8iOc1Gw==", 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rgw", 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB+oVxmZ5bsIBAA4SmtdnyALXGbb0n4D1wwsA==", 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rgw" 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.132 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmeV9VKhAAWRGPPyEnG/7idTtgebGCKA==", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmkKoxIBAAqO4kNYlr+tMKK3s4ubHuVA==", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-06-02T16:45:57.133 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:45:57.134 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.134 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:45:57.134 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-06-02T16:45:57.134 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.120+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 msgr2=0x7fe374078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.120+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 0x7fe374078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe388034000 tx=0x7fe38802e000 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.120+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 msgr2=0x7fe3940aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.120+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b970 tx=0x7fe38c00be30 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 shutdown_connections 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe3740762d0 0x7fe374078790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3941600f0 0x7fe3940aff30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39415fd10 0x7fe3941f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 --2- 172.21.15.52:0/534000358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940d0750 0x7fe39406ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 >> 172.21.15.52:0/534000358 conn(0x7fe394073b70 msgr2=0x7fe39415d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 shutdown_connections 2024-06-02T16:45:57.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.121+0000 7fe39b400640 1 -- 172.21.15.52:0/534000358 wait complete. 2024-06-02T16:45:57.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-06-02T16:45:57.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.347+0000 7f8ffe800640 1 Processor -- start 2024-06-02T16:45:57.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.347+0000 7f8ffe800640 1 -- start start 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffe800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ff815f420 0x7f8ff80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffe800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 0x7f8ff80b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffe800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff80d3e20 con 0x7f8ff80badc0 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffe800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff80d4a30 con 0x7f8ff815f420 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffe800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff80d4100 con 0x7f8ff80d0830 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ff815f420 0x7f8ff80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffca00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8ff80badc0 0x7f8ff80d0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47008/0 (socket says 172.21.15.52:47008) 2024-06-02T16:45:57.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.349+0000 7f8ffca00640 1 -- 172.21.15.52:0/2915936355 learned_addr learned my addr 172.21.15.52:0/2915936355 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:57.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffde00640 1 --2- 172.21.15.52:0/2915936355 >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 0x7f8ff80b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffd400640 1 -- 172.21.15.52:0/2915936355 >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 msgr2=0x7f8ff80b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:57.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffd400640 1 --2- 172.21.15.52:0/2915936355 >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 0x7f8ff80b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffd400640 1 -- 172.21.15.52:0/2915936355 >> v1:172.21.15.52:6789/0 conn(0x7f8ff80badc0 legacy=0x7f8ff80d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffd400640 1 -- 172.21.15.52:0/2915936355 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff80d43e0 con 0x7f8ff815f420 2024-06-02T16:45:57.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.350+0000 7f8ffde00640 1 --2- 172.21.15.52:0/2915936355 >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 0x7f8ff80b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:57.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.351+0000 7f8ffd400640 1 --2- 172.21.15.52:0/2915936355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff80d34b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80d49a0 tx=0x7f8fec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f992f7b65954472 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.351+0000 7f8ff7e00640 1 -- 172.21.15.52:0/2915936355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec037070 con 0x7f8ff815f420 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.351+0000 7f8ff7e00640 1 -- 172.21.15.52:0/2915936355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec032440 con 0x7f8ff815f420 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.351+0000 7f8ff7e00640 1 -- 172.21.15.52:0/2915936355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec032810 con 0x7f8ff815f420 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 -- 172.21.15.52:0/2915936355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 msgr2=0x7f8ff80d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 --2- 172.21.15.52:0/2915936355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff80d34b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80d49a0 tx=0x7f8fec02a1a0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 -- 172.21.15.52:0/2915936355 shutdown_connections 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 --2- 172.21.15.52:0/2915936355 >> v2:172.21.15.114:3300/0 conn(0x7f8ff80d0830 0x7f8ff80b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 --2- 172.21.15.52:0/2915936355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff80d34b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 -- 172.21.15.52:0/2915936355 >> 172.21.15.52:0/2915936355 conn(0x7f8ff80740e0 msgr2=0x7f8ff806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 -- 172.21.15.52:0/2915936355 shutdown_connections 2024-06-02T16:45:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.352+0000 7f8ffe800640 1 -- 172.21.15.52:0/2915936355 wait complete. 2024-06-02T16:45:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.354+0000 7f8ffe800640 1 Processor -- start 2024-06-02T16:45:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.354+0000 7f8ffe800640 1 -- start start 2024-06-02T16:45:57.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ff80badc0 0x7f8ff8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 0x7f8ff8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80d4ec0 con 0x7f8ff815f420 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80d39f0 con 0x7f8ff80d0830 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffe800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff80b59b0 con 0x7f8ff80badc0 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.355+0000 7f8ffde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51472/0 (socket says 172.21.15.52:51472) 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 -- 172.21.15.52:0/3620455472 learned_addr learned my addr 172.21.15.52:0/3620455472 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffd400640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ff80badc0 0x7f8ff8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffca00640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 0x7f8ff8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 -- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ff80badc0 msgr2=0x7f8ff8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ff80badc0 0x7f8ff8155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 -- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 msgr2=0x7f8ff8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 0x7f8ff8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 -- 172.21.15.52:0/3620455472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff80b5c90 con 0x7f8ff815f420 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffca00640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 0x7f8ff8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.356+0000 7f8ffde00640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000cef0 tx=0x7f8ff000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.357+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff001a070 con 0x7f8ff815f420 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.357+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff000d860 con 0x7f8ff815f420 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.357+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000dc50 con 0x7f8ff815f420 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.357+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff80b5f70 con 0x7f8ff815f420 2024-06-02T16:45:57.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.357+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff80b6530 con 0x7f8ff815f420 2024-06-02T16:45:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.358+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff80507e0 con 0x7f8ff815f420 2024-06-02T16:45:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.359+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ff001d070 con 0x7f8ff815f420 2024-06-02T16:45:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.361+0000 7f8ff5600640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 0x7f8fd8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.361+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f8ff0097b20 con 0x7f8ff815f420 2024-06-02T16:45:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.361+0000 7f8ffd400640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 0x7f8fd8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.362+0000 7f8ffd400640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 0x7f8fd8078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fec034000 tx=0x7f8fec02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.365+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ff0061880 con 0x7f8ff815f420 2024-06-02T16:45:57.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.660+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f8ff806e1f0 con 0x7f8ff815f420 2024-06-02T16:45:57.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.665+0000 7f8ff5600640 1 -- 172.21.15.52:0/3620455472 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f8ff0061180 con 0x7f8ff815f420 2024-06-02T16:45:57.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 msgr2=0x7f8fd8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 0x7f8fd8078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fec034000 tx=0x7f8fec02e000 comp rx=0 tx=0).stop 2024-06-02T16:45:57.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 msgr2=0x7f8ff81588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000cef0 tx=0x7f8ff000a710 comp rx=0 tx=0).stop 2024-06-02T16:45:57.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 shutdown_connections 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8fd80762d0 0x7f8fd8078790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ff815f420 0x7f8ff81588f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ff80d0830 0x7f8ff8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 --2- 172.21.15.52:0/3620455472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ff80badc0 0x7f8ff8155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.667+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 >> 172.21.15.52:0/3620455472 conn(0x7f8ff80740e0 msgr2=0x7f8ff80c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.668+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 shutdown_connections 2024-06-02T16:45:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.668+0000 7f8ffe800640 1 -- 172.21.15.52:0/3620455472 wait complete. 2024-06-02T16:45:57.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-06-02T16:45:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.879+0000 7f1285e00640 1 Processor -- start 2024-06-02T16:45:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.879+0000 7f1285e00640 1 -- start start 2024-06-02T16:45:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12800b5b60 0x7f128006eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800b5fd0 con 0x7f128015f470 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1280072e50 con 0x7f12800b56d0 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f12800b4320 con 0x7f12800b5b60 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1284a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f128015f470 0x7f12800723b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47020/0 (socket says 172.21.15.52:47020) 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1284a00640 1 -- 172.21.15.52:0/1425570331 learned_addr learned my addr 172.21.15.52:0/1425570331 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285400640 1 --2- 172.21.15.52:0/1425570331 >> v2:172.21.15.52:3300/0 conn(0x7f12800b5b60 0x7f128006eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f127f400640 1 -- 172.21.15.52:0/1425570331 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655670646 0 0) 0x7f12800b5fd0 con 0x7f128015f470 2024-06-02T16:45:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f127f400640 1 -- 172.21.15.52:0/1425570331 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1268003520 con 0x7f128015f470 2024-06-02T16:45:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.881+0000 7f1285400640 1 -- 172.21.15.52:0/1425570331 >> v1:172.21.15.114:6789/0 conn(0x7f12800b56d0 legacy=0x7f128006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.882+0000 7f1285400640 1 -- 172.21.15.52:0/1425570331 >> v1:172.21.15.52:6789/0 conn(0x7f128015f470 legacy=0x7f12800723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.882+0000 7f1285400640 1 -- 172.21.15.52:0/1425570331 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12800b4600 con 0x7f12800b5b60 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285400640 1 --2- 172.21.15.52:0/1425570331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12800b5b60 0x7f128006eb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f127802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f24ac1fc4b3e58 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f127f400640 1 -- 172.21.15.52:0/1425570331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278007740 con 0x7f12800b5b60 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f127f400640 1 -- 172.21.15.52:0/1425570331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12780078e0 con 0x7f12800b5b60 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f127f400640 1 -- 172.21.15.52:0/1425570331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278007cb0 con 0x7f12800b5b60 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285e00640 1 -- 172.21.15.52:0/1425570331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12800b5b60 msgr2=0x7f128006eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285e00640 1 --2- 172.21.15.52:0/1425570331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12800b5b60 0x7f128006eb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f127802a660 comp rx=0 tx=0).stop 2024-06-02T16:45:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285e00640 1 -- 172.21.15.52:0/1425570331 shutdown_connections 2024-06-02T16:45:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285e00640 1 --2- 172.21.15.52:0/1425570331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12800b5b60 0x7f128006eb20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.883+0000 7f1285e00640 1 -- 172.21.15.52:0/1425570331 >> 172.21.15.52:0/1425570331 conn(0x7f12800b2b60 msgr2=0x7f12800b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.884+0000 7f1285e00640 1 -- 172.21.15.52:0/1425570331 shutdown_connections 2024-06-02T16:45:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.884+0000 7f1285e00640 1 -- 172.21.15.52:0/1425570331 wait complete. 2024-06-02T16:45:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.885+0000 7f1285e00640 1 Processor -- start 2024-06-02T16:45:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.885+0000 7f1285e00640 1 -- start start 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12800b56d0 0x7f128014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 0x7f128009e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1280072ac0 con 0x7f128015f470 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f12800b4bc0 con 0x7f12800b5b60 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.886+0000 7f1285e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f12800b50e0 con 0x7f12800b56d0 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51492/0 (socket says 172.21.15.52:51492) 2024-06-02T16:45:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 -- 172.21.15.52:0/255985 learned_addr learned my addr 172.21.15.52:0/255985 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 -- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12800b56d0 msgr2=0x7f128014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12800b56d0 0x7f128014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 -- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 msgr2=0x7f128009e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f127fe00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 0x7f128009e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 0x7f128009e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 -- 172.21.15.52:0/255985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128014bef0 con 0x7f128015f470 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f127fe00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 0x7f128009e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.887+0000 7f1285400640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f1278004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.888+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278040070 con 0x7f128015f470 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.888+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278031bc0 con 0x7f128015f470 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.888+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278009450 con 0x7f128015f470 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.888+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12801f90d0 con 0x7f128015f470 2024-06-02T16:45:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.888+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12801f9690 con 0x7f128015f470 2024-06-02T16:45:57.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.889+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280160450 con 0x7f128015f470 2024-06-02T16:45:57.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.890+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1278039040 con 0x7f128015f470 2024-06-02T16:45:57.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.891+0000 7f127cc00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 0x7f1260078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:57.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.891+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f12780b8680 con 0x7f128015f470 2024-06-02T16:45:57.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.892+0000 7f1284a00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 0x7f1260078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.893+0000 7f1284a00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 0x7f1260078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1274001220 tx=0x7f12740078f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:57.895+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1280160450 con 0x7f128015f470 2024-06-02T16:45:58.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.183+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f12800b0220 con 0x7f128015f470 2024-06-02T16:45:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.188+0000 7f127cc00640 1 -- 172.21.15.52:0/255985 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f12800b0220 con 0x7f128015f470 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 msgr2=0x7f1260078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 0x7f1260078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1274001220 tx=0x7f12740078f0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 msgr2=0x7f128015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f1278004a40 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 shutdown_connections 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12600762d0 0x7f1260078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f128015f470 0x7f128015c430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800b5b60 0x7f128009e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 --2- 172.21.15.52:0/255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12800b56d0 0x7f128014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 >> 172.21.15.52:0/255985 conn(0x7f12800b2b60 msgr2=0x7f12800ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:58.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 shutdown_connections 2024-06-02T16:45:58.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.191+0000 7f1285e00640 1 -- 172.21.15.52:0/255985 wait complete. 2024-06-02T16:45:58.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-06-02T16:45:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.428+0000 7f2ca6200640 1 Processor -- start 2024-06-02T16:45:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.428+0000 7f2ca6200640 1 -- start start 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.429+0000 7f2ca6200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ca015d330 0x7f2ca0073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca6200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca0070650 con 0x7f2ca00ae550 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca6200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca0072450 con 0x7f2ca00734f0 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca6200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca0072730 con 0x7f2ca015d330 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca5800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2ca00ae550 0x7f2ca006e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47036/0 (socket says 172.21.15.52:47036) 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca5800640 1 -- 172.21.15.52:0/2420026117 learned_addr learned my addr 172.21.15.52:0/2420026117 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.430+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/2420026117 >> v2:172.21.15.114:3300/0 conn(0x7f2ca015d330 0x7f2ca0073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973892793 0 0) 0x7f2ca0070650 con 0x7f2ca00ae550 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c88003520 con 0x7f2ca00ae550 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1937817984 0 0) 0x7f2c88003520 con 0x7f2ca00ae550 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 >> v2:172.21.15.114:3300/0 conn(0x7f2ca015d330 msgr2=0x7f2ca0073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 --2- 172.21.15.52:0/2420026117 >> v2:172.21.15.114:3300/0 conn(0x7f2ca015d330 0x7f2ca0073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 >> v1:172.21.15.114:6789/0 conn(0x7f2ca00734f0 legacy=0x7f2ca00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca0072a10 con 0x7f2ca00ae550 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f2c98001a70 con 0x7f2ca00ae550 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 >> v1:172.21.15.52:6789/0 conn(0x7f2ca00ae550 legacy=0x7f2ca006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 0x7f2c88003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c88004800 0x7f2c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88005210 0x7f2c8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca0072730 con 0x7f2c88003aa0 2024-06-02T16:45:58.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8800c160 con 0x7f2c88004800 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8800c360 con 0x7f2c88005210 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.431+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 0x7f2c88003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca4e00640 1 -- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88005210 msgr2=0x7f2c8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88005210 0x7f2c8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca4e00640 1 -- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c88004800 msgr2=0x7f2c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c88004800 0x7f2c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca4e00640 1 -- 172.21.15.52:0/2420026117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c88003520 con 0x7f2c88003aa0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.432+0000 7f2ca5800640 1 -- 172.21.15.52:0/2420026117 reap_dead start 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.433+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 0x7f2c88003ec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009a90 tx=0x7f2c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1d9868db8e2398 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.433+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94036070 con 0x7f2c88003aa0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.433+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94031400 con 0x7f2c88003aa0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.433+0000 7f2c9f400640 1 -- 172.21.15.52:0/2420026117 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94009690 con 0x7f2c88003aa0 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 -- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 msgr2=0x7f2c88003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 0x7f2c88003ec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009a90 tx=0x7f2c88005830 comp rx=0 tx=0).stop 2024-06-02T16:45:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 -- 172.21.15.52:0/2420026117 shutdown_connections 2024-06-02T16:45:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 --2- 172.21.15.52:0/2420026117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c88003aa0 0x7f2c88003ec0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 -- 172.21.15.52:0/2420026117 >> 172.21.15.52:0/2420026117 conn(0x7f2ca00b2b60 msgr2=0x7f2ca00b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 -- 172.21.15.52:0/2420026117 shutdown_connections 2024-06-02T16:45:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.434+0000 7f2ca6200640 1 -- 172.21.15.52:0/2420026117 wait complete. 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.436+0000 7f2ca6200640 1 Processor -- start 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.436+0000 7f2ca6200640 1 -- start start 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88003aa0 0x7f2ca0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 0x7f2ca015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca00ade40 con 0x7f2ca0149d40 2024-06-02T16:45:58.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca0072fd0 con 0x7f2ca015b900 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.437+0000 7f2ca6200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca00adfc0 con 0x7f2c88003aa0 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51510/0 (socket says 172.21.15.52:51510) 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 -- 172.21.15.52:0/644517731 learned_addr learned my addr 172.21.15.52:0/644517731 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88003aa0 0x7f2ca0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2c9fe00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 0x7f2ca015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 -- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88003aa0 msgr2=0x7f2ca0157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88003aa0 0x7f2ca0157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 -- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 msgr2=0x7f2ca015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 0x7f2ca015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2ca5800640 1 -- 172.21.15.52:0/644517731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca015c850 con 0x7f2ca0149d40 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.438+0000 7f2c9fe00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 0x7f2ca015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:45:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2ca5800640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0051140 tx=0x7f2c9800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98004d60 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9800a5b0 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800a9a0 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca0159290 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.439+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca009bb60 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.440+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca01597b0 con 0x7f2ca0149d40 2024-06-02T16:45:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.442+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c98011070 con 0x7f2ca0149d40 2024-06-02T16:45:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.443+0000 7f2c9cc00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 0x7f2c800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.443+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f2c980966f0 con 0x7f2ca0149d40 2024-06-02T16:45:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.443+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 0x7f2c800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.445+0000 7f2ca4e00640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 0x7f2c800787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c94033000 tx=0x7f2c94008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.448+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2ca015c850 con 0x7f2ca0149d40 2024-06-02T16:45:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.736+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f2ca00507e0 con 0x7f2ca0149d40 2024-06-02T16:45:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.740+0000 7f2c9cc00640 1 -- 172.21.15.52:0/644517731 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f2c9805fcb0 con 0x7f2ca0149d40 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 msgr2=0x7f2c800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 0x7f2c800787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c94033000 tx=0x7f2c94008030 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 msgr2=0x7f2ca014a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0051140 tx=0x7f2c9800cb90 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 shutdown_connections 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2c80076300 0x7f2c800787c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca0149d40 0x7f2ca014a1f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca015b900 0x7f2ca015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 --2- 172.21.15.52:0/644517731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c88003aa0 0x7f2ca0157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 >> 172.21.15.52:0/644517731 conn(0x7f2ca00b2b60 msgr2=0x7f2ca00b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 shutdown_connections 2024-06-02T16:45:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.743+0000 7f2ca6200640 1 -- 172.21.15.52:0/644517731 wait complete. 2024-06-02T16:45:58.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-06-02T16:45:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.970+0000 7f648b200640 1 Processor -- start 2024-06-02T16:45:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.970+0000 7f648b200640 1 -- start start 2024-06-02T16:45:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c15d330 0x7f648c073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f648c0ae550 0x7f648c074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c070650 con 0x7f648c0734f0 2024-06-02T16:45:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f648c072450 con 0x7f648c0ae550 2024-06-02T16:45:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f648c072730 con 0x7f648c15d330 2024-06-02T16:45:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f648a800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f648c0ae550 0x7f648c074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f6489400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f648c0734f0 0x7f648c0ade40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47048/0 (socket says 172.21.15.52:47048) 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.972+0000 7f6489400640 1 -- 172.21.15.52:0/3887937411 learned_addr learned my addr 172.21.15.52:0/3887937411 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f6489e00640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c15d330 0x7f648c073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f648a800640 1 -- 172.21.15.52:0/3887937411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c15d330 msgr2=0x7f648c073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f648a800640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c15d330 0x7f648c073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f648a800640 1 -- 172.21.15.52:0/3887937411 >> v1:172.21.15.52:6789/0 conn(0x7f648c0734f0 legacy=0x7f648c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f648a800640 1 -- 172.21.15.52:0/3887937411 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c072a10 con 0x7f648c0ae550 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.973+0000 7f6488a00640 1 -- 172.21.15.52:0/3887937411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484302462 0 0) 0x7f648c070650 con 0x7f648c0734f0 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.974+0000 7f648a800640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0ae550 0x7f648c074060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6484009d90 tx=0x7f648402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5557c4fe152e498f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.974+0000 7f6488a00640 1 -- 172.21.15.52:0/3887937411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484007740 con 0x7f648c0ae550 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.974+0000 7f6488a00640 1 -- 172.21.15.52:0/3887937411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64840078e0 con 0x7f648c0ae550 2024-06-02T16:45:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.974+0000 7f6488a00640 1 -- 172.21.15.52:0/3887937411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484007cb0 con 0x7f648c0ae550 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 -- 172.21.15.52:0/3887937411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0ae550 msgr2=0x7f648c074060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0ae550 0x7f648c074060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6484009d90 tx=0x7f648402a660 comp rx=0 tx=0).stop 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 -- 172.21.15.52:0/3887937411 shutdown_connections 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0ae550 0x7f648c074060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 --2- 172.21.15.52:0/3887937411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c15d330 0x7f648c073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 -- 172.21.15.52:0/3887937411 >> 172.21.15.52:0/3887937411 conn(0x7f648c0b2b60 msgr2=0x7f648c0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 -- 172.21.15.52:0/3887937411 shutdown_connections 2024-06-02T16:45:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.975+0000 7f648b200640 1 -- 172.21.15.52:0/3887937411 wait complete. 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.977+0000 7f648b200640 1 Processor -- start 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.977+0000 7f648b200640 1 -- start start 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c0ae550 0x7f648c09e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f648c15d330 0x7f648c1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f648c06e410 con 0x7f648c0734f0 2024-06-02T16:45:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f648c072fd0 con 0x7f648c15d330 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f648b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f648c06e590 con 0x7f648c0ae550 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f6489e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f6489e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51534/0 (socket says 172.21.15.52:51534) 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.978+0000 7f6489e00640 1 -- 172.21.15.52:0/918593958 learned_addr learned my addr 172.21.15.52:0/918593958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489400640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c0ae550 0x7f648c09e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f648a800640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f648c15d330 0x7f648c1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 -- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c0ae550 msgr2=0x7f648c09e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c0ae550 0x7f648c09e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 -- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f648c15d330 msgr2=0x7f648c1f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f648c15d330 0x7f648c1f3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 -- 172.21.15.52:0/918593958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c09e9d0 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6489e00640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d5f0 tx=0x7f647c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.979+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0125f0 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.980+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c019070 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.980+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0129d0 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.980+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1f3f60 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.980+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c143a50 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.981+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c0507e0 con 0x7f648c0734f0 2024-06-02T16:45:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.982+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f647c012b70 con 0x7f648c0734f0 2024-06-02T16:45:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.984+0000 7f6482000640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 0x7f646c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.984+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f647c097680 con 0x7f648c0734f0 2024-06-02T16:45:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.984+0000 7f6489400640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 0x7f646c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.985+0000 7f6489400640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 0x7f646c0787c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f648c06ff40 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:58.988+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f648c09e9d0 con 0x7f648c0734f0 2024-06-02T16:45:59.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.276+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f648c09e060 con 0x7f648c0734f0 2024-06-02T16:45:59.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.281+0000 7f6482000640 1 -- 172.21.15.52:0/918593958 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f647c061320 con 0x7f648c0734f0 2024-06-02T16:45:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 msgr2=0x7f646c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 0x7f646c0787c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f648c06ff40 tx=0x7f6478009040 comp rx=0 tx=0).stop 2024-06-02T16:45:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 msgr2=0x7f648c09c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d5f0 tx=0x7f647c00dab0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 shutdown_connections 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f646c076300 0x7f646c0787c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f648c15d330 0x7f648c1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f648c0ae550 0x7f648c09e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 --2- 172.21.15.52:0/918593958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f648c0734f0 0x7f648c09c340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.284+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 >> 172.21.15.52:0/918593958 conn(0x7f648c0b2b60 msgr2=0x7f648c0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.285+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 shutdown_connections 2024-06-02T16:45:59.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.285+0000 7f648b200640 1 -- 172.21.15.52:0/918593958 wait complete. 2024-06-02T16:45:59.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-06-02T16:45:59.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.518+0000 7f54f6400640 1 Processor -- start 2024-06-02T16:45:59.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.518+0000 7f54f6400640 1 -- start start 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54f00b0610 0x7f54f00adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f015ec80 0x7f54f00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54f015d8b0 0x7f54f015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f54f006ebd0 con 0x7f54f00b0610 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f54f015e240 con 0x7f54f015d8b0 2024-06-02T16:45:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.520+0000 7f54f6400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f54f009eec0 con 0x7f54f015ec80 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54f00b0610 0x7f54f00adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54f00b0610 0x7f54f00adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51542/0 (socket says 172.21.15.52:51542) 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 -- 172.21.15.52:0/3428417980 learned_addr learned my addr 172.21.15.52:0/3428417980 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54efe00640 1 --2- 172.21.15.52:0/3428417980 >> v2:172.21.15.114:3300/0 conn(0x7f54f015d8b0 0x7f54f015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54e7e00640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f015ec80 0x7f54f00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 -- 172.21.15.52:0/3428417980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f015ec80 msgr2=0x7f54f00ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f015ec80 0x7f54f00ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 -- 172.21.15.52:0/3428417980 >> v2:172.21.15.114:3300/0 conn(0x7f54f015d8b0 msgr2=0x7f54f015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:45:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 --2- 172.21.15.52:0/3428417980 >> v2:172.21.15.114:3300/0 conn(0x7f54f015d8b0 0x7f54f015dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.521+0000 7f54ef400640 1 -- 172.21.15.52:0/3428417980 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f015e490 con 0x7f54f00b0610 2024-06-02T16:45:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.522+0000 7f54ef400640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f00b0610 0x7f54f00adeb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54f00724b0 tx=0x7f54e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa67546cc216017f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.523+0000 7f54eea00640 1 -- 172.21.15.52:0/3428417980 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0037070 con 0x7f54f00b0610 2024-06-02T16:45:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.523+0000 7f54eea00640 1 -- 172.21.15.52:0/3428417980 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e0032440 con 0x7f54f00b0610 2024-06-02T16:45:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.523+0000 7f54eea00640 1 -- 172.21.15.52:0/3428417980 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0032810 con 0x7f54f00b0610 2024-06-02T16:45:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.523+0000 7f54f6400640 1 -- 172.21.15.52:0/3428417980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f00b0610 msgr2=0x7f54f00adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.523+0000 7f54f6400640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f00b0610 0x7f54f00adeb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54f00724b0 tx=0x7f54e002a140 comp rx=0 tx=0).stop 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 -- 172.21.15.52:0/3428417980 shutdown_connections 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f015ec80 0x7f54f00ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 --2- 172.21.15.52:0/3428417980 >> v2:172.21.15.114:3300/0 conn(0x7f54f015d8b0 0x7f54f015dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 --2- 172.21.15.52:0/3428417980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f00b0610 0x7f54f00adeb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 -- 172.21.15.52:0/3428417980 >> 172.21.15.52:0/3428417980 conn(0x7f54f00b3200 msgr2=0x7f54f00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 -- 172.21.15.52:0/3428417980 shutdown_connections 2024-06-02T16:45:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.524+0000 7f54f6400640 1 -- 172.21.15.52:0/3428417980 wait complete. 2024-06-02T16:45:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.526+0000 7f54f6400640 1 Processor -- start 2024-06-02T16:45:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.526+0000 7f54f6400640 1 -- start start 2024-06-02T16:45:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f00b0610 0x7f54f0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 0x7f54f00ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54f006e860 con 0x7f54f015d8b0 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f54f006e580 con 0x7f54f015ec80 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54f6400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f54f01600e0 con 0x7f54f00b0610 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51556/0 (socket says 172.21.15.52:51556) 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.527+0000 7f54e7e00640 1 -- 172.21.15.52:0/3953714460 learned_addr learned my addr 172.21.15.52:0/3953714460 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54ef400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f00b0610 0x7f54f0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54efe00640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 0x7f54f00ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 -- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f00b0610 msgr2=0x7f54f0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f00b0610 0x7f54f0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 -- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 msgr2=0x7f54f00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 0x7f54f00ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 -- 172.21.15.52:0/3953714460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f0074400 con 0x7f54f015d8b0 2024-06-02T16:45:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54efe00640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 0x7f54f00ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:45:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7e00640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d5c0 tx=0x7f54d800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.528+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d80125f0 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.529+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d8019070 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.529+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f009ba60 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.529+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d80129d0 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.529+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f009c020 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.530+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f0069520 con 0x7f54f015d8b0 2024-06-02T16:45:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.531+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54d8012b70 con 0x7f54f015d8b0 2024-06-02T16:45:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.532+0000 7f54e7400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 0x7f54cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:45:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.532+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f54d80976a0 con 0x7f54f015d8b0 2024-06-02T16:45:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.533+0000 7f54ef400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 0x7f54cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:45:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.534+0000 7f54ef400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 0x7f54cc078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54e0034000 tx=0x7f54e002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:45:59.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.537+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f54d8061340 con 0x7f54f015d8b0 2024-06-02T16:45:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.824+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f54f00b3fd0 con 0x7f54f015d8b0 2024-06-02T16:45:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.828+0000 7f54e7400640 1 -- 172.21.15.52:0/3953714460 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f54d8060c40 con 0x7f54f015d8b0 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 msgr2=0x7f54cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 0x7f54cc078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54e0034000 tx=0x7f54e002e000 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 msgr2=0x7f54f0073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d5c0 tx=0x7f54d800da80 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 shutdown_connections 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f54cc0762d0 0x7f54cc078790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015ec80 0x7f54f00ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54f015d8b0 0x7f54f0073940 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 --2- 172.21.15.52:0/3953714460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54f00b0610 0x7f54f0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:45:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 >> 172.21.15.52:0/3953714460 conn(0x7f54f00b3200 msgr2=0x7f54f00b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:45:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 shutdown_connections 2024-06-02T16:45:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:45:59.831+0000 7f54f6400640 1 -- 172.21.15.52:0/3953714460 wait complete. 2024-06-02T16:45:59.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-06-02T16:46:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.067+0000 7f201a200640 1 Processor -- start 2024-06-02T16:46:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.067+0000 7f201a200640 1 -- start start 2024-06-02T16:46:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f201a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f201415f470 0x7f20140723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f201a200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20140b5de0 0x7f201406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f201a200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2014072e50 con 0x7f20140728f0 2024-06-02T16:46:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f201a200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f20140b4320 con 0x7f201415f470 2024-06-02T16:46:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f201a200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f20140b4600 con 0x7f20140b5de0 2024-06-02T16:46:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f2018e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f201415f470 0x7f20140723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f2013e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20140728f0 0x7f20140b56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47058/0 (socket says 172.21.15.52:47058) 2024-06-02T16:46:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.069+0000 7f2013e00640 1 -- 172.21.15.52:0/2647058600 learned_addr learned my addr 172.21.15.52:0/2647058600 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2019800640 1 --2- 172.21.15.52:0/2647058600 >> v2:172.21.15.114:3300/0 conn(0x7f20140b5de0 0x7f201406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2018e00640 1 -- 172.21.15.52:0/2647058600 >> v2:172.21.15.114:3300/0 conn(0x7f20140b5de0 msgr2=0x7f201406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2018e00640 1 --2- 172.21.15.52:0/2647058600 >> v2:172.21.15.114:3300/0 conn(0x7f20140b5de0 0x7f201406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2018e00640 1 -- 172.21.15.52:0/2647058600 >> v1:172.21.15.52:6789/0 conn(0x7f20140728f0 legacy=0x7f20140b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2013400640 1 -- 172.21.15.52:0/2647058600 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099586958 0 0) 0x7f2014072e50 con 0x7f20140728f0 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.070+0000 7f2018e00640 1 -- 172.21.15.52:0/2647058600 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20140b48e0 con 0x7f201415f470 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.071+0000 7f2018e00640 1 --2- 172.21.15.52:0/2647058600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f201415f470 0x7f20140723b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f201406d620 tx=0x7f200802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d98349611208ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.071+0000 7f2013400640 1 -- 172.21.15.52:0/2647058600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008037070 con 0x7f201415f470 2024-06-02T16:46:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.071+0000 7f2013400640 1 -- 172.21.15.52:0/2647058600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2008032440 con 0x7f201415f470 2024-06-02T16:46:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.071+0000 7f2013400640 1 -- 172.21.15.52:0/2647058600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008032810 con 0x7f201415f470 2024-06-02T16:46:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 -- 172.21.15.52:0/2647058600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f201415f470 msgr2=0x7f20140723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 --2- 172.21.15.52:0/2647058600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f201415f470 0x7f20140723b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f201406d620 tx=0x7f200802a1a0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 -- 172.21.15.52:0/2647058600 shutdown_connections 2024-06-02T16:46:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 --2- 172.21.15.52:0/2647058600 >> v2:172.21.15.114:3300/0 conn(0x7f20140b5de0 0x7f201406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 --2- 172.21.15.52:0/2647058600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f201415f470 0x7f20140723b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 -- 172.21.15.52:0/2647058600 >> 172.21.15.52:0/2647058600 conn(0x7f20140b2b60 msgr2=0x7f20140b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:00.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 -- 172.21.15.52:0/2647058600 shutdown_connections 2024-06-02T16:46:00.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.072+0000 7f201a200640 1 -- 172.21.15.52:0/2647058600 wait complete. 2024-06-02T16:46:00.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.074+0000 7f201a200640 1 Processor -- start 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.074+0000 7f201a200640 1 -- start start 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20140728f0 0x7f20140cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f201415f470 0x7f20140d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20140b5260 con 0x7f20140b5de0 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20140b50e0 con 0x7f20140728f0 2024-06-02T16:46:00.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f201a200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2014160680 con 0x7f201415f470 2024-06-02T16:46:00.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f2013e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f2013e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51570/0 (socket says 172.21.15.52:51570) 2024-06-02T16:46:00.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.075+0000 7f2013e00640 1 -- 172.21.15.52:0/1848454333 learned_addr learned my addr 172.21.15.52:0/1848454333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:00.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2019800640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f201415f470 0x7f20140d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2018e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20140728f0 0x7f20140cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 -- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f201415f470 msgr2=0x7f20140d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f201415f470 0x7f20140d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 -- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20140728f0 msgr2=0x7f20140cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20140728f0 0x7f20140cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 -- 172.21.15.52:0/1848454333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201409dda0 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2013e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f200000c450 tx=0x7f200000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000018070 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2000007500 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000004a20 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.076+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201409e080 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.077+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201409e640 con 0x7f20140b5de0 2024-06-02T16:46:00.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.078+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201409e880 con 0x7f20140b5de0 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.079+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2000004bc0 con 0x7f20140b5de0 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.080+0000 7f2010c00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 0x7f1ff4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.080+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f20000965a0 con 0x7f20140b5de0 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.081+0000 7f2018e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 0x7f1ff4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.082+0000 7f2018e00640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 0x7f1ff4078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2008034000 tx=0x7f200802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.084+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f201409e880 con 0x7f20140b5de0 2024-06-02T16:46:00.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.371+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f20140507e0 con 0x7f20140b5de0 2024-06-02T16:46:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.376+0000 7f2010c00640 1 -- 172.21.15.52:0/1848454333 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f20000601b0 con 0x7f20140b5de0 2024-06-02T16:46:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.379+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 msgr2=0x7f1ff4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.379+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 0x7f1ff4078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2008034000 tx=0x7f200802e000 comp rx=0 tx=0).stop 2024-06-02T16:46:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.379+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 msgr2=0x7f20140d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.379+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f200000c450 tx=0x7f200000c910 comp rx=0 tx=0).stop 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 shutdown_connections 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1ff40762d0 0x7f1ff4078790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f201415f470 0x7f20140d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20140b5de0 0x7f20140d1250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 --2- 172.21.15.52:0/1848454333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20140728f0 0x7f20140cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 >> 172.21.15.52:0/1848454333 conn(0x7f20140b2b60 msgr2=0x7f20140b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 shutdown_connections 2024-06-02T16:46:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.380+0000 7f201a200640 1 -- 172.21.15.52:0/1848454333 wait complete. 2024-06-02T16:46:00.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T16:46:00.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.604+0000 7f84de200640 1 Processor -- start 2024-06-02T16:46:00.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.605+0000 7f84de200640 1 -- start start 2024-06-02T16:46:00.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.606+0000 7f84de200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84d80afdb0 0x7f84d80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.606+0000 7f84de200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d815c870 con 0x7f84d80b1bc0 2024-06-02T16:46:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.607+0000 7f84de200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d80b1270 con 0x7f84d815c490 2024-06-02T16:46:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.607+0000 7f84de200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f84d80b0210 con 0x7f84d80afdb0 2024-06-02T16:46:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.607+0000 7f84dd800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84d80b1bc0 0x7f84d80b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47060/0 (socket says 172.21.15.52:47060) 2024-06-02T16:46:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.607+0000 7f84dd800640 1 -- 172.21.15.52:0/3158904131 learned_addr learned my addr 172.21.15.52:0/3158904131 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.607+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3158904131 >> v2:172.21.15.114:3300/0 conn(0x7f84d80afdb0 0x7f84d80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911295911 0 0) 0x7f84d815c870 con 0x7f84d80b1bc0 2024-06-02T16:46:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84bc005730 con 0x7f84d80b1bc0 2024-06-02T16:46:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1500404290 0 0) 0x7f84bc005730 con 0x7f84d80b1bc0 2024-06-02T16:46:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 >> v2:172.21.15.114:3300/0 conn(0x7f84d80afdb0 msgr2=0x7f84d80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 --2- 172.21.15.52:0/3158904131 >> v2:172.21.15.114:3300/0 conn(0x7f84d80afdb0 0x7f84d80b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 >> v1:172.21.15.114:6789/0 conn(0x7f84d815c490 legacy=0x7f84d80af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d80b1550 con 0x7f84d80b1bc0 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f84d00016f0 con 0x7f84d80b1bc0 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 >> v1:172.21.15.52:6789/0 conn(0x7f84d80b1bc0 legacy=0x7f84d80b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84bc005c60 0x7f84bc006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc006a10 0x7f84bc006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 0x7f84bc00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80b0210 con 0x7f84bc0073d0 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc00e370 con 0x7f84bc006a10 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.608+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc00e570 con 0x7f84bc005c60 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 0x7f84bc00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dce00640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84bc005c60 0x7f84bc006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc006a10 0x7f84bc006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 -- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84bc005c60 msgr2=0x7f84bc006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84bc005c60 0x7f84bc006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 -- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc006a10 msgr2=0x7f84bc006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc006a10 0x7f84bc006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84dd800640 1 -- 172.21.15.52:0/3158904131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc005730 con 0x7f84bc0073d0 2024-06-02T16:46:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.609+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc006a10 0x7f84bc006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.610+0000 7f84dd800640 1 -- 172.21.15.52:0/3158904131 reap_dead start 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.610+0000 7f84dd800640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 0x7f84bc00dbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c240 tx=0x7f84bc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b116f762f13dee75 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.610+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0007d70 con 0x7f84bc0073d0 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.610+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0005af0 con 0x7f84bc0073d0 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.610+0000 7f84d7400640 1 -- 172.21.15.52:0/3158904131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0007070 con 0x7f84bc0073d0 2024-06-02T16:46:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 -- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 msgr2=0x7f84bc00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 0x7f84bc00dbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c240 tx=0x7f84bc007a40 comp rx=0 tx=0).stop 2024-06-02T16:46:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 -- 172.21.15.52:0/3158904131 shutdown_connections 2024-06-02T16:46:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 --2- 172.21.15.52:0/3158904131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84bc0073d0 0x7f84bc00dbd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 -- 172.21.15.52:0/3158904131 >> 172.21.15.52:0/3158904131 conn(0x7f84d806df90 msgr2=0x7f84d80b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 -- 172.21.15.52:0/3158904131 shutdown_connections 2024-06-02T16:46:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.611+0000 7f84de200640 1 -- 172.21.15.52:0/3158904131 wait complete. 2024-06-02T16:46:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.613+0000 7f84de200640 1 Processor -- start 2024-06-02T16:46:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.613+0000 7f84de200640 1 -- start start 2024-06-02T16:46:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.614+0000 7f84de200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 0x7f84d81fc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.614+0000 7f84de200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.614+0000 7f84de200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84d815cdb0 0x7f84d815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.614+0000 7f84de200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80b0c70 con 0x7f84d81591d0 2024-06-02T16:46:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84de200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80b0750 con 0x7f84bc0073d0 2024-06-02T16:46:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84de200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f84d80b0f00 con 0x7f84d815cdb0 2024-06-02T16:46:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51596/0 (socket says 172.21.15.52:51596) 2024-06-02T16:46:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 -- 172.21.15.52:0/3050845169 learned_addr learned my addr 172.21.15.52:0/3050845169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84dd800640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84d815cdb0 0x7f84d815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84dce00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 0x7f84d81fc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 -- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84d815cdb0 msgr2=0x7f84d815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84d815cdb0 0x7f84d815e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 -- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 msgr2=0x7f84d81fc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 0x7f84d81fc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84d7e00640 1 -- 172.21.15.52:0/3050845169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d815f530 con 0x7f84d81591d0 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.615+0000 7f84dce00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 0x7f84d81fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84d7e00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f84c800f380 tx=0x7f84c800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8003b90 con 0x7f84d81591d0 2024-06-02T16:46:00.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c8003d30 con 0x7f84d81591d0 2024-06-02T16:46:00.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8004220 con 0x7f84d81591d0 2024-06-02T16:46:00.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d814ca50 con 0x7f84d81591d0 2024-06-02T16:46:00.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.616+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d815f810 con 0x7f84d81591d0 2024-06-02T16:46:00.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.617+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d815d1c0 con 0x7f84d81591d0 2024-06-02T16:46:00.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.618+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84c8005d10 con 0x7f84d81591d0 2024-06-02T16:46:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.620+0000 7f84d4c00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 0x7f84b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.620+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f84c8097930 con 0x7f84d81591d0 2024-06-02T16:46:00.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.620+0000 7f84dce00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 0x7f84b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:00.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.621+0000 7f84dce00640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 0x7f84b40787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84d80ce900 tx=0x7f84c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:00.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.624+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84d815d1c0 con 0x7f84d81591d0 2024-06-02T16:46:00.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.844+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f84d80b19a0 con 0x7f84d81591d0 2024-06-02T16:46:00.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.845+0000 7f84d4c00640 1 -- 172.21.15.52:0/3050845169 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7f84c8012070 con 0x7f84d81591d0 2024-06-02T16:46:00.843 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:00.844 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-06-02T16:46:00.844 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:46:00.844 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-06-02T16:46:00.844 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-06-02T16:46:00.844 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:46:00.845 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-06-02T16:46:00.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 msgr2=0x7f84b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 0x7f84b40787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84d80ce900 tx=0x7f84c0009040 comp rx=0 tx=0).stop 2024-06-02T16:46:00.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 msgr2=0x7f84d815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:00.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f84c800f380 tx=0x7f84c800f840 comp rx=0 tx=0).stop 2024-06-02T16:46:00.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 shutdown_connections 2024-06-02T16:46:00.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f84b4076300 0x7f84b40787c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84d815cdb0 0x7f84d815e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84d81591d0 0x7f84d815c870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 --2- 172.21.15.52:0/3050845169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84bc0073d0 0x7f84d81fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:00.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 >> 172.21.15.52:0/3050845169 conn(0x7f84d806df90 msgr2=0x7f84d80b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:00.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 shutdown_connections 2024-06-02T16:46:00.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:00.848+0000 7f84de200640 1 -- 172.21.15.52:0/3050845169 wait complete. 2024-06-02T16:46:00.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T16:46:00.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T16:46:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.077+0000 7f501e400640 1 Processor -- start 2024-06-02T16:46:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.077+0000 7f501e400640 1 -- start start 2024-06-02T16:46:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 0x7f501806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50180b51b0 0x7f50180b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f501806dd20 con 0x7f50180b51b0 2024-06-02T16:46:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f501806d890 con 0x7f50180b4dd0 2024-06-02T16:46:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.079+0000 7f501e400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f50180b12d0 con 0x7f501815fab0 2024-06-02T16:46:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50180b51b0 0x7f50180b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50180b51b0 0x7f50180b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51612/0 (socket says 172.21.15.52:51612) 2024-06-02T16:46:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 -- 172.21.15.52:0/2271964616 learned_addr learned my addr 172.21.15.52:0/2271964616 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f5017e00640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501d000640 1 --2- 172.21.15.52:0/2271964616 >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 0x7f501806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 -- 172.21.15.52:0/2271964616 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 msgr2=0x7f50180b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 -- 172.21.15.52:0/2271964616 >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 msgr2=0x7f501806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 --2- 172.21.15.52:0/2271964616 >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 0x7f501806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501da00640 1 -- 172.21.15.52:0/2271964616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501806cc80 con 0x7f50180b51b0 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f5017e00640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.080+0000 7f501d000640 1 --2- 172.21.15.52:0/2271964616 >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 0x7f501806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.081+0000 7f501da00640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50180b0d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f501806df10 tx=0x7f501002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0ddfeb1f98ac71 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.082+0000 7f5017400640 1 -- 172.21.15.52:0/2271964616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010037070 con 0x7f50180b51b0 2024-06-02T16:46:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.082+0000 7f5017400640 1 -- 172.21.15.52:0/2271964616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010032440 con 0x7f50180b51b0 2024-06-02T16:46:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.082+0000 7f5017400640 1 -- 172.21.15.52:0/2271964616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010032810 con 0x7f50180b51b0 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.082+0000 7f501e400640 1 -- 172.21.15.52:0/2271964616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 msgr2=0x7f50180b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.082+0000 7f501e400640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50180b0d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f501806df10 tx=0x7f501002a1e0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 -- 172.21.15.52:0/2271964616 shutdown_connections 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 --2- 172.21.15.52:0/2271964616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50180b0d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 --2- 172.21.15.52:0/2271964616 >> v2:172.21.15.114:3300/0 conn(0x7f50180b4dd0 0x7f501806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 -- 172.21.15.52:0/2271964616 >> 172.21.15.52:0/2271964616 conn(0x7f50180d17a0 msgr2=0x7f50180d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 -- 172.21.15.52:0/2271964616 shutdown_connections 2024-06-02T16:46:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.083+0000 7f501e400640 1 -- 172.21.15.52:0/2271964616 wait complete. 2024-06-02T16:46:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.084+0000 7f501e400640 1 Processor -- start 2024-06-02T16:46:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.085+0000 7f501e400640 1 -- start start 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.085+0000 7f501e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 0x7f50181f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.085+0000 7f501e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501e400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f501806d520 con 0x7f50180b51b0 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f501806d240 con 0x7f50180b4dd0 2024-06-02T16:46:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501e400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f501806c8c0 con 0x7f501815fab0 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51620/0 (socket says 172.21.15.52:51620) 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 -- 172.21.15.52:0/760885912 learned_addr learned my addr 172.21.15.52:0/760885912 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501d000640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 0x7f50181f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501da00640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 -- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 msgr2=0x7f50180ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 -- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 msgr2=0x7f50181f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 0x7f50181f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f5017e00640 1 -- 172.21.15.52:0/760885912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181f8a50 con 0x7f50180b51b0 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.086+0000 7f501d000640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 0x7f50181f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f5017e00640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f500000c7c0 tx=0x7f500000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000015070 con 0x7f50180b51b0 2024-06-02T16:46:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5000007820 con 0x7f50180b51b0 2024-06-02T16:46:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000007bf0 con 0x7f50180b51b0 2024-06-02T16:46:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50181f8d30 con 0x7f50180b51b0 2024-06-02T16:46:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.087+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50181f92f0 con 0x7f50180b51b0 2024-06-02T16:46:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.088+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50180507e0 con 0x7f50180b51b0 2024-06-02T16:46:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.089+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5000018070 con 0x7f50180b51b0 2024-06-02T16:46:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.090+0000 7f5014c00640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 0x7f4ff4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.090+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f5000097130 con 0x7f50180b51b0 2024-06-02T16:46:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.091+0000 7f501d000640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 0x7f4ff4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.092+0000 7f501d000640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 0x7f4ff4078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f50180b03f0 tx=0x7f5008007550 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:01.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.095+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5000060d40 con 0x7f50180b51b0 2024-06-02T16:46:01.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.295+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5018063d50 con 0x7f50180b51b0 2024-06-02T16:46:01.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.836+0000 7f5014c00640 1 -- 172.21.15.52:0/760885912 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f5000060640 con 0x7f50180b51b0 2024-06-02T16:46:01.835 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-06-02T16:46:01.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 msgr2=0x7f4ff4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:01.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 0x7f4ff4078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f50180b03f0 tx=0x7f5008007550 comp rx=0 tx=0).stop 2024-06-02T16:46:01.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 msgr2=0x7f50181f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:01.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f500000c7c0 tx=0x7f500000cc80 comp rx=0 tx=0).stop 2024-06-02T16:46:01.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 shutdown_connections 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4ff40762d0 0x7f4ff4078790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f501815fab0 0x7f50180ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50180b51b0 0x7f50181f5920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 --2- 172.21.15.52:0/760885912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50180b4dd0 0x7f50181f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.840+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 >> 172.21.15.52:0/760885912 conn(0x7f50180d17a0 msgr2=0x7f5018162ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.841+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 shutdown_connections 2024-06-02T16:46:01.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:01.841+0000 7f501e400640 1 -- 172.21.15.52:0/760885912 wait complete. 2024-06-02T16:46:01.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T16:46:02.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.073+0000 7f0f87600640 1 Processor -- start 2024-06-02T16:46:02.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.074+0000 7f0f87600640 1 -- start start 2024-06-02T16:46:02.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.075+0000 7f0f87600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 0x7f0f800b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.075+0000 7f0f87600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f801631f0 0x7f0f800b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f87600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f800b7b20 con 0x7f0f800d5f10 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f87600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0f800b7e00 con 0x7f0f801631f0 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f87600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8006ee90 con 0x7f0f800b7130 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f801631f0 0x7f0f800b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f801631f0 0x7f0f800b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51632/0 (socket says 172.21.15.52:51632) 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 -- 172.21.15.52:0/1792250019 learned_addr learned my addr 172.21.15.52:0/1792250019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 0x7f0f800b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 -- 172.21.15.52:0/1792250019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 msgr2=0x7f0f800b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 0x7f0f800b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 -- 172.21.15.52:0/1792250019 >> v1:172.21.15.114:6789/0 conn(0x7f0f800d5f10 legacy=0x7f0f80162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f85600640 1 -- 172.21.15.52:0/1792250019 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8006f170 con 0x7f0f801631f0 2024-06-02T16:46:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.076+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 0x7f0f800b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:02.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f85600640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f801631f0 0x7f0f800b42b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009870 tx=0x7f0f7802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6970c6ff309a072 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:02.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f7f400640 1 -- 172.21.15.52:0/1792250019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f801631f0 2024-06-02T16:46:02.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f7f400640 1 -- 172.21.15.52:0/1792250019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78032440 con 0x7f0f801631f0 2024-06-02T16:46:02.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f7f400640 1 -- 172.21.15.52:0/1792250019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78032810 con 0x7f0f801631f0 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f87600640 1 -- 172.21.15.52:0/1792250019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f801631f0 msgr2=0x7f0f800b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.078+0000 7f0f87600640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f801631f0 0x7f0f800b42b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009870 tx=0x7f0f7802a130 comp rx=0 tx=0).stop 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 -- 172.21.15.52:0/1792250019 shutdown_connections 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f801631f0 0x7f0f800b42b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 --2- 172.21.15.52:0/1792250019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f800b7130 0x7f0f800b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 -- 172.21.15.52:0/1792250019 >> 172.21.15.52:0/1792250019 conn(0x7f0f8008cf50 msgr2=0x7f0f800d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 -- 172.21.15.52:0/1792250019 shutdown_connections 2024-06-02T16:46:02.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.079+0000 7f0f87600640 1 -- 172.21.15.52:0/1792250019 wait complete. 2024-06-02T16:46:02.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.080+0000 7f0f87600640 1 Processor -- start 2024-06-02T16:46:02.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 -- start start 2024-06-02T16:46:02.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 0x7f0f800cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 0x7f0f800ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f800d4270 con 0x7f0f800d5f10 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f800b49f0 con 0x7f0f800b7130 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.081+0000 7f0f87600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f0f800d43f0 con 0x7f0f801631f0 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51634/0 (socket says 172.21.15.52:51634) 2024-06-02T16:46:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 -- 172.21.15.52:0/1666954299 learned_addr learned my addr 172.21.15.52:0/1666954299 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f85600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 0x7f0f800ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 0x7f0f800cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 -- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 msgr2=0x7f0f800ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 0x7f0f800ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 -- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 msgr2=0x7f0f800cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 0x7f0f800cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f7fe00640 1 -- 172.21.15.52:0/1666954299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f800cc620 con 0x7f0f800d5f10 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f85600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 0x7f0f800ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.082+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 0x7f0f800cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f7fe00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c7c0 tx=0x7f0f6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68016020 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6800aa50 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68012420 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f800cee60 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.083+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f800cc8c0 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.084+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f80069520 con 0x7f0f800d5f10 2024-06-02T16:46:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.086+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f68019020 con 0x7f0f800d5f10 2024-06-02T16:46:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.087+0000 7f0f7cc00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 0x7f0f5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.087+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7f0f680971d0 con 0x7f0f800d5f10 2024-06-02T16:46:02.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.087+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 0x7f0f5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.088+0000 7f0f84c00640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 0x7f0f5c078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.092+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f68020070 con 0x7f0f800d5f10 2024-06-02T16:46:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.301+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0f8006e110 con 0x7f0f800d5f10 2024-06-02T16:46:02.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.853+0000 7f0f7cc00640 1 -- 172.21.15.52:0/1666954299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7f0f68060c70 con 0x7f0f800d5f10 2024-06-02T16:46:02.853 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-06-02T16:46:02.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.856+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 msgr2=0x7f0f5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:02.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.856+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 0x7f0f5c078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70008040 comp rx=0 tx=0).stop 2024-06-02T16:46:02.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.856+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 msgr2=0x7f0f800ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:02.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.856+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c7c0 tx=0x7f0f6800cc80 comp rx=0 tx=0).stop 2024-06-02T16:46:02.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 shutdown_connections 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0f5c0762d0 0x7f0f5c078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f801631f0 0x7f0f800ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f800d5f10 0x7f0f800ce2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 --2- 172.21.15.52:0/1666954299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f800b7130 0x7f0f800cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 >> 172.21.15.52:0/1666954299 conn(0x7f0f8008cf50 msgr2=0x7f0f800d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 shutdown_connections 2024-06-02T16:46:02.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:02.857+0000 7f0f87600640 1 -- 172.21.15.52:0/1666954299 wait complete. 2024-06-02T16:46:02.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T16:46:03.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.072+0000 7fef0f000640 1 Processor -- start 2024-06-02T16:46:03.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.072+0000 7fef0f000640 1 -- start start 2024-06-02T16:46:03.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0f000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef0815f420 0x7fef080d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef080d3e20 con 0x7fef080d0830 2024-06-02T16:46:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0f000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef080d4100 con 0x7fef080badc0 2024-06-02T16:46:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0f000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fef080d4a30 con 0x7fef0815f420 2024-06-02T16:46:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0e600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fef080d0830 0x7fef080b84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48016/0 (socket says 172.21.15.52:48016) 2024-06-02T16:46:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.074+0000 7fef0e600640 1 -- 172.21.15.52:0/1540984787 learned_addr learned my addr 172.21.15.52:0/1540984787 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef0dc00640 1 --2- 172.21.15.52:0/1540984787 >> v2:172.21.15.114:3300/0 conn(0x7fef0815f420 0x7fef080d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781610399 0 0) 0x7fef080d3e20 con 0x7fef080d0830 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeec003520 con 0x7fef080d0830 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4182120463 0 0) 0x7feeec003520 con 0x7fef080d0830 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 >> v2:172.21.15.114:3300/0 conn(0x7fef0815f420 msgr2=0x7fef080d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 --2- 172.21.15.52:0/1540984787 >> v2:172.21.15.114:3300/0 conn(0x7fef0815f420 0x7fef080d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 >> v1:172.21.15.114:6789/0 conn(0x7fef080badc0 legacy=0x7fef080d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef080d43e0 con 0x7fef080d0830 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fef00001a70 con 0x7fef080d0830 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef0dc00640 1 --2- 172.21.15.52:0/1540984787 >> v2:172.21.15.114:3300/0 conn(0x7fef0815f420 0x7fef080d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 >> v1:172.21.15.52:6789/0 conn(0x7fef080d0830 legacy=0x7fef080b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec003a50 0x7feeec003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 0x7feeec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.075+0000 7fef07e00640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0052e0 0x7feeec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef080d4a30 con 0x7feeec004800 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feeec00c1e0 con 0x7feeec0052e0 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feeec00c3e0 con 0x7feeec003a50 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 0x7feeec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0e600640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0052e0 0x7feeec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0dc00640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec003a50 0x7feeec003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 -- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec003a50 msgr2=0x7feeec003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec003a50 0x7feeec003e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 -- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0052e0 msgr2=0x7feeec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0052e0 0x7feeec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0e600640 1 -- 172.21.15.52:0/1540984787 reap_dead start 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.076+0000 7fef0d200640 1 -- 172.21.15.52:0/1540984787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec003520 con 0x7feeec004800 2024-06-02T16:46:03.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.077+0000 7fef0d200640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 0x7feeec004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fef080cc260 tx=0x7feeec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec160aab860955a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:03.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef40013b0 con 0x7feeec004800 2024-06-02T16:46:03.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef40052d0 con 0x7feeec004800 2024-06-02T16:46:03.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef07e00640 1 -- 172.21.15.52:0/1540984787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef402a9e0 con 0x7feeec004800 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 -- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 msgr2=0x7feeec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 0x7feeec004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fef080cc260 tx=0x7feeec005830 comp rx=0 tx=0).stop 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 -- 172.21.15.52:0/1540984787 shutdown_connections 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 --2- 172.21.15.52:0/1540984787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeec004800 0x7feeec004c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 -- 172.21.15.52:0/1540984787 >> 172.21.15.52:0/1540984787 conn(0x7fef080740e0 msgr2=0x7fef0806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.078+0000 7fef0f000640 1 -- 172.21.15.52:0/1540984787 shutdown_connections 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.079+0000 7fef0f000640 1 -- 172.21.15.52:0/1540984787 wait complete. 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.080+0000 7fef0f000640 1 Processor -- start 2024-06-02T16:46:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.080+0000 7fef0f000640 1 -- start start 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec004800 0x7fef08153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef081f5a80 0x7fef080b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef080d4ec0 con 0x7fef080b71d0 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef0815f800 con 0x7fef081f5a80 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.081+0000 7fef0f000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fef080b61f0 con 0x7feeec004800 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36322/0 (socket says 172.21.15.52:36322) 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 -- 172.21.15.52:0/4080874217 learned_addr learned my addr 172.21.15.52:0/4080874217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 -- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec004800 msgr2=0x7fef08153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0d200640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef081f5a80 0x7fef080b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec004800 0x7fef08153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 -- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef081f5a80 msgr2=0x7fef080b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef081f5a80 0x7fef080b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 -- 172.21.15.52:0/4080874217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef08153690 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.082+0000 7fef0e600640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef00001330 tx=0x7fef00007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.083+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0000eb00 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.083+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef00018070 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.083+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef080b5150 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.083+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00013420 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.083+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef080b5710 con 0x7fef080b71d0 2024-06-02T16:46:03.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.084+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef080507e0 con 0x7fef080b71d0 2024-06-02T16:46:03.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.086+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef000135c0 con 0x7fef080b71d0 2024-06-02T16:46:03.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.087+0000 7fef05600640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 0x7feee8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:03.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.087+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7fef00098300 con 0x7fef080b71d0 2024-06-02T16:46:03.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.088+0000 7fef0dc00640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 0x7feee8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:03.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.089+0000 7fef0dc00640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 0x7feee8078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feef8006e80 tx=0x7feef8006df0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:03.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.093+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef00061d30 con 0x7fef080b71d0 2024-06-02T16:46:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.339+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fef080cbae0 con 0x7fef080b71d0 2024-06-02T16:46:03.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.885+0000 7fef05600640 1 -- 172.21.15.52:0/4080874217 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fef00061630 con 0x7fef080b71d0 2024-06-02T16:46:03.886 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 4 and data pool 5 2024-06-02T16:46:03.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.902+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 msgr2=0x7feee8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.903+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 0x7feee8078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feef8006e80 tx=0x7feef8006df0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.903+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 msgr2=0x7fef08159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:03.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.903+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef00001330 tx=0x7fef00007bc0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 shutdown_connections 2024-06-02T16:46:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feee80762d0 0x7feee8078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef080b71d0 0x7fef08159450 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef081f5a80 0x7fef080b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 --2- 172.21.15.52:0/4080874217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feeec004800 0x7fef08153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 >> 172.21.15.52:0/4080874217 conn(0x7fef080740e0 msgr2=0x7fef0815a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 shutdown_connections 2024-06-02T16:46:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:03.905+0000 7fef0f000640 1 -- 172.21.15.52:0/4080874217 wait complete. 2024-06-02T16:46:03.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:46:04.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.108+0000 7f4792000640 1 Processor -- start 2024-06-02T16:46:04.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.108+0000 7f4792000640 1 -- start start 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.109+0000 7f4792000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.109+0000 7f4792000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f478c073fb0 0x7f478c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.109+0000 7f4792000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478c160c80 con 0x7f478c06e670 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.109+0000 7f4792000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f478c06ead0 con 0x7f478c073fb0 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.109+0000 7f4792000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f478c073350 con 0x7f478c1577f0 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.110+0000 7f478be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f478c073fb0 0x7f478c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.110+0000 7f478be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f478c073fb0 0x7f478c06e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:37044/0 (socket says 172.21.15.52:37044) 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.110+0000 7f478be00640 1 -- 172.21.15.52:0/1461869678 learned_addr learned my addr 172.21.15.52:0/1461869678 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.110+0000 7f4790c00640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.111+0000 7f478be00640 1 -- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 msgr2=0x7f478c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.111+0000 7f478be00640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.111+0000 7f478be00640 1 -- 172.21.15.52:0/1461869678 >> v1:172.21.15.114:6789/0 conn(0x7f478c06e670 legacy=0x7f478c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.111+0000 7f478be00640 1 -- 172.21.15.52:0/1461869678 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c160f60 con 0x7f478c073fb0 2024-06-02T16:46:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.112+0000 7f478be00640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c073fb0 0x7f478c06e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c462ef4968937e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.113+0000 7f478b400640 1 -- 172.21.15.52:0/1461869678 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037070 con 0x7f478c073fb0 2024-06-02T16:46:04.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.113+0000 7f478b400640 1 -- 172.21.15.52:0/1461869678 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778032440 con 0x7f478c073fb0 2024-06-02T16:46:04.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.113+0000 7f478b400640 1 -- 172.21.15.52:0/1461869678 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778032810 con 0x7f478c073fb0 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.113+0000 7f4792000640 1 -- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c073fb0 msgr2=0x7f478c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.113+0000 7f4792000640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c073fb0 0x7f478c06e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802a270 comp rx=0 tx=0).stop 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 -- 172.21.15.52:0/1461869678 shutdown_connections 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c073fb0 0x7f478c06e130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 --2- 172.21.15.52:0/1461869678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 -- 172.21.15.52:0/1461869678 >> 172.21.15.52:0/1461869678 conn(0x7f478c06c380 msgr2=0x7f478c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 -- 172.21.15.52:0/1461869678 shutdown_connections 2024-06-02T16:46:04.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.114+0000 7f4792000640 1 -- 172.21.15.52:0/1461869678 wait complete. 2024-06-02T16:46:04.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.115+0000 7f4792000640 1 Processor -- start 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.115+0000 7f4792000640 1 -- start start 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 0x7f478c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f478c15e510 con 0x7f478c073fb0 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f478c161520 con 0x7f478c06e670 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.116+0000 7f4792000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f478c161a40 con 0x7f478c1577f0 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36324/0 (socket says 172.21.15.52:36324) 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 -- 172.21.15.52:0/3165100921 learned_addr learned my addr 172.21.15.52:0/3165100921 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:04.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f4791600640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f4790c00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 0x7f478c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 -- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 msgr2=0x7f478c1f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c1f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 -- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 msgr2=0x7f478c0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 0x7f478c0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f478be00640 1 -- 172.21.15.52:0/3165100921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c1f9d00 con 0x7f478c073fb0 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f4791600640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.117+0000 7f4790c00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 0x7f478c0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f478be00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4778000c00 tx=0x7f47780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037040 con 0x7f478c073fb0 2024-06-02T16:46:04.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778042070 con 0x7f478c073fb0 2024-06-02T16:46:04.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778030880 con 0x7f478c073fb0 2024-06-02T16:46:04.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c0b0930 con 0x7f478c073fb0 2024-06-02T16:46:04.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.118+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1f9220 con 0x7f478c073fb0 2024-06-02T16:46:04.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.119+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c075ea0 con 0x7f478c073fb0 2024-06-02T16:46:04.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.120+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4778030a20 con 0x7f478c073fb0 2024-06-02T16:46:04.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.121+0000 7f4788c00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 0x7f476c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.121+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f47780b7ec0 con 0x7f478c073fb0 2024-06-02T16:46:04.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.122+0000 7f4790c00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 0x7f476c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.123+0000 7f4790c00640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 0x7f476c078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4780009a20 tx=0x7f4780008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.126+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4778081810 con 0x7f478c073fb0 2024-06-02T16:46:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.336+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f478c0507e0 con 0x7f478c073fb0 2024-06-02T16:46:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.339+0000 7f4788c00640 1 -- 172.21.15.52:0/3165100921 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16682 (secure 0 0 0) 0x7f4778081110 con 0x7f478c073fb0 2024-06-02T16:46:04.338 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:04.339 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:46:03.341076+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:46:01.311582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-06-02T16:46:02.318550+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 msgr2=0x7f476c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 0x7f476c078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4780009a20 tx=0x7f4780008040 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 msgr2=0x7f478c14ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4778000c00 tx=0x7f47780046c0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 shutdown_connections 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f476c0762d0 0x7f476c078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f478c1577f0 0x7f478c1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f478c073fb0 0x7f478c14ad60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 --2- 172.21.15.52:0/3165100921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f478c06e670 0x7f478c0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 >> 172.21.15.52:0/3165100921 conn(0x7f478c06c380 msgr2=0x7f478c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 shutdown_connections 2024-06-02T16:46:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.342+0000 7f4792000640 1 -- 172.21.15.52:0/3165100921 wait complete. 2024-06-02T16:46:04.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:46:04.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.573+0000 7f7387e00640 1 Processor -- start 2024-06-02T16:46:04.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.574+0000 7f7387e00640 1 -- start start 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.575+0000 7f7387e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f73880ce760 0x7f738806e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.575+0000 7f7387e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73880cebc0 0x7f738806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.575+0000 7f7387e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7388073bf0 con 0x7f738814cf30 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.575+0000 7f7387e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f73880b4370 con 0x7f73880ce760 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.575+0000 7f7387e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f73880b4650 con 0x7f73880cebc0 2024-06-02T16:46:04.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.576+0000 7f7386a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f738814cf30 0x7f7388167ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48026/0 (socket says 172.21.15.52:48026) 2024-06-02T16:46:04.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.576+0000 7f7386a00640 1 -- 172.21.15.52:0/2982563654 learned_addr learned my addr 172.21.15.52:0/2982563654 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:04.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.576+0000 7f7386000640 1 --2- 172.21.15.52:0/2982563654 >> v2:172.21.15.114:3300/0 conn(0x7f73880ce760 0x7f738806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.576+0000 7f7387400640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73880cebc0 0x7f738806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.576+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544404380 0 0) 0x7f7388073bf0 con 0x7f738814cf30 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f736c003520 con 0x7f738814cf30 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 759377801 0 0) 0x7f736c003520 con 0x7f738814cf30 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7386000640 1 -- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73880cebc0 msgr2=0x7f738806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7386000640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73880cebc0 0x7f738806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7386000640 1 -- 172.21.15.52:0/2982563654 >> v1:172.21.15.52:6789/0 conn(0x7f738814cf30 legacy=0x7f7388167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.577+0000 7f7386000640 1 -- 172.21.15.52:0/2982563654 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73880b4930 con 0x7f73880ce760 2024-06-02T16:46:04.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.578+0000 7f7386000640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880ce760 0x7f738806e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f73740097a0 tx=0x7f737402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00830a99349193 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374037070 con 0x7f73880ce760 2024-06-02T16:46:04.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737402aba0 con 0x7f73880ce760 2024-06-02T16:46:04.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7385600640 1 -- 172.21.15.52:0/2982563654 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378001a70 con 0x7f73880ce760 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 -- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880ce760 msgr2=0x7f738806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880ce760 0x7f738806e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f73740097a0 tx=0x7f737402a110 comp rx=0 tx=0).stop 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 -- 172.21.15.52:0/2982563654 shutdown_connections 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73880cebc0 0x7f738806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 --2- 172.21.15.52:0/2982563654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880ce760 0x7f738806e130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 -- 172.21.15.52:0/2982563654 >> 172.21.15.52:0/2982563654 conn(0x7f738806c380 msgr2=0x7f738806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:04.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 -- 172.21.15.52:0/2982563654 shutdown_connections 2024-06-02T16:46:04.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.579+0000 7f7387e00640 1 -- 172.21.15.52:0/2982563654 wait complete. 2024-06-02T16:46:04.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.581+0000 7f7387e00640 1 Processor -- start 2024-06-02T16:46:04.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.581+0000 7f7387e00640 1 -- start start 2024-06-02T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 0x7f73881f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 0x7f73881f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f738814d310 con 0x7f73880ce760 2024-06-02T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b4ef0 con 0x7f73880cebc0 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7387e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f738814d490 con 0x7f738814cf30 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.582+0000 7f7386a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36328/0 (socket says 172.21.15.52:36328) 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 -- 172.21.15.52:0/363764606 learned_addr learned my addr 172.21.15.52:0/363764606 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7387400640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 0x7f73881f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386000640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 0x7f73881f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 -- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 msgr2=0x7f73881f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 0x7f73881f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 -- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 msgr2=0x7f73881f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 0x7f73881f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 -- 172.21.15.52:0/363764606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73881463e0 con 0x7f73880ce760 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7387400640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 0x7f73881f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:04.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386000640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 0x7f73881f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.583+0000 7f7386a00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f737800cc80 tx=0x7f737800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.584+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f73880ce760 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.584+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7378012400 con 0x7f73880ce760 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.584+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780127f0 con 0x7f73880ce760 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.584+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7388146680 con 0x7f73880ce760 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.584+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7388148340 con 0x7f73880ce760 2024-06-02T16:46:04.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.585+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7388075ea0 con 0x7f73880ce760 2024-06-02T16:46:04.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.587+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f737801a070 con 0x7f73880ce760 2024-06-02T16:46:04.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.587+0000 7f737ea00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 0x7f7368078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:04.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.588+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f73780975d0 con 0x7f73880ce760 2024-06-02T16:46:04.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.588+0000 7f7386000640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 0x7f7368078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:04.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.589+0000 7f7386000640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 0x7f7368078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7374034000 tx=0x7f737402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:04.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.592+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7378060e90 con 0x7f73880ce760 2024-06-02T16:46:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.806+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f738806f210 con 0x7f73880ce760 2024-06-02T16:46:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.808+0000 7f737ea00640 1 -- 172.21.15.52:0/363764606 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16682 (secure 0 0 0) 0x7f7378060790 con 0x7f73880ce760 2024-06-02T16:46:04.807 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:04.807 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:46:03.341076+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:46:01.311582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-06-02T16:46:02.318550+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 msgr2=0x7f7368078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 0x7f7368078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7374034000 tx=0x7f737402e000 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 msgr2=0x7f7388147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f737800cc80 tx=0x7f737800a430 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 shutdown_connections 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f73680762d0 0x7f7368078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f738814cf30 0x7f73881f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73880cebc0 0x7f73881f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 --2- 172.21.15.52:0/363764606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73880ce760 0x7f7388147cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 >> 172.21.15.52:0/363764606 conn(0x7f738806c380 msgr2=0x7f7388166890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:04.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 shutdown_connections 2024-06-02T16:46:04.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:04.811+0000 7f7387e00640 1 -- 172.21.15.52:0/363764606 wait complete. 2024-06-02T16:46:04.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T16:46:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.038+0000 7fb2d0a00640 1 Processor -- start 2024-06-02T16:46:05.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.038+0000 7fb2d0a00640 1 -- start start 2024-06-02T16:46:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.039+0000 7fb2d0a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2cc15d330 0x7fb2cc073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.039+0000 7fb2d0a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2cc070650 con 0x7fb2cc0ae550 2024-06-02T16:46:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.039+0000 7fb2d0a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2cc072450 con 0x7fb2cc0734f0 2024-06-02T16:46:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.039+0000 7fb2d0a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb2cc072730 con 0x7fb2cc15d330 2024-06-02T16:46:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.040+0000 7fb2cb200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2cc0ae550 0x7fb2cc06e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48030/0 (socket says 172.21.15.52:48030) 2024-06-02T16:46:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.040+0000 7fb2cb200640 1 -- 172.21.15.52:0/3973712410 learned_addr learned my addr 172.21.15.52:0/3973712410 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.040+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3973712410 >> v2:172.21.15.114:3300/0 conn(0x7fb2cc15d330 0x7fb2cc073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.040+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458026051 0 0) 0x7fb2cc070650 con 0x7fb2cc0ae550 2024-06-02T16:46:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.040+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b0003520 con 0x7fb2cc0ae550 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4124170264 0 0) 0x7fb2b0003520 con 0x7fb2cc0ae550 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 >> v2:172.21.15.114:3300/0 conn(0x7fb2cc15d330 msgr2=0x7fb2cc073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 --2- 172.21.15.52:0/3973712410 >> v2:172.21.15.114:3300/0 conn(0x7fb2cc15d330 0x7fb2cc073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 >> v1:172.21.15.114:6789/0 conn(0x7fb2cc0734f0 legacy=0x7fb2cc0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc072a10 con 0x7fb2cc0ae550 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fb2c40016f0 con 0x7fb2cc0ae550 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 >> v1:172.21.15.52:6789/0 conn(0x7fb2cc0ae550 legacy=0x7fb2cc06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b0003a50 0x7fb2b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b0004800 0x7fb2b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 0x7fb2b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc072730 con 0x7fb2b00051c0 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b000c160 con 0x7fb2b0004800 2024-06-02T16:46:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b000c360 con 0x7fb2b0003a50 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.041+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 0x7fb2b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2c1e00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b0004800 0x7fb2b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b0003a50 0x7fb2b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2cb200640 1 -- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b0003a50 msgr2=0x7fb2b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b0003a50 0x7fb2b0003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2cb200640 1 -- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b0004800 msgr2=0x7fb2b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b0004800 0x7fb2b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2cb200640 1 -- 172.21.15.52:0/3973712410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b0003520 con 0x7fb2b00051c0 2024-06-02T16:46:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.042+0000 7fb2c1e00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b0004800 0x7fb2b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.043+0000 7fb2cb200640 1 -- 172.21.15.52:0/3973712410 reap_dead start 2024-06-02T16:46:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.043+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 0x7fb2b000b9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c290 tx=0x7fb2b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8638ff1377030b5c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.043+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4007d50 con 0x7fb2b00051c0 2024-06-02T16:46:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.043+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c4005af0 con 0x7fb2b00051c0 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.043+0000 7fb2c9e00640 1 -- 172.21.15.52:0/3973712410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4007070 con 0x7fb2b00051c0 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 msgr2=0x7fb2b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 0x7fb2b000b9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c290 tx=0x7fb2b0005830 comp rx=0 tx=0).stop 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3973712410 shutdown_connections 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3973712410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b00051c0 0x7fb2b000b9c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3973712410 >> 172.21.15.52:0/3973712410 conn(0x7fb2cc0b2b60 msgr2=0x7fb2cc0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3973712410 shutdown_connections 2024-06-02T16:46:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.044+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3973712410 wait complete. 2024-06-02T16:46:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.046+0000 7fb2d0a00640 1 Processor -- start 2024-06-02T16:46:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.046+0000 7fb2d0a00640 1 -- start start 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 0x7fb2cc14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2cc09bf60 0x7fb2cc09c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc0ade40 con 0x7fb2cc15c210 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc072fd0 con 0x7fb2b00051c0 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2d0a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc0adfc0 con 0x7fb2cc09bf60 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2cb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2cb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36354/0 (socket says 172.21.15.52:36354) 2024-06-02T16:46:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.047+0000 7fb2cb200640 1 -- 172.21.15.52:0/3819872661 learned_addr learned my addr 172.21.15.52:0/3819872661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 0x7fb2cc14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2c1e00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2cc09bf60 0x7fb2cc09c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 -- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2cc09bf60 msgr2=0x7fb2cc09c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2cc09bf60 0x7fb2cc09c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 -- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 msgr2=0x7fb2cc14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 0x7fb2cc14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 -- 172.21.15.52:0/3819872661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc14d4c0 con 0x7fb2cc15c210 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 0x7fb2cc14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2cb200640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009000 tx=0x7fb2cc0b0a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.048+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4001600 con 0x7fb2cc15c210 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.049+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c40047e0 con 0x7fb2cc15c210 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.049+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4004bd0 con 0x7fb2cc15c210 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.049+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc14f320 con 0x7fb2cc15c210 2024-06-02T16:46:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.049+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc14f8e0 con 0x7fb2cc15c210 2024-06-02T16:46:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.050+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2cc09c9e0 con 0x7fb2cc15c210 2024-06-02T16:46:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.051+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2c4043060 con 0x7fb2cc15c210 2024-06-02T16:46:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.052+0000 7fb2c3400640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 0x7fb2a80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.052+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb2c40b6480 con 0x7fb2cc15c210 2024-06-02T16:46:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.053+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 0x7fb2a80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.054+0000 7fb2ca800640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 0x7fb2a80787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007460 tx=0x7fb2bc00d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.057+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2cc14d4c0 con 0x7fb2cc15c210 2024-06-02T16:46:05.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:46:05.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:46:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.302+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb2cc0507e0 con 0x7fb2cc15c210 2024-06-02T16:46:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.896+0000 7fb2c3400640 1 -- 172.21.15.52:0/3819872661 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fb2c407fcb0 con 0x7fb2cc15c210 2024-06-02T16:46:05.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 msgr2=0x7fb2a80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 0x7fb2a80787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007460 tx=0x7fb2bc00d040 comp rx=0 tx=0).stop 2024-06-02T16:46:05.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 msgr2=0x7fb2cc15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:05.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009000 tx=0x7fb2cc0b0a60 comp rx=0 tx=0).stop 2024-06-02T16:46:05.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 shutdown_connections 2024-06-02T16:46:05.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2a8076300 0x7fb2a80787c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc15c210 0x7fb2cc15c690 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2cc09bf60 0x7fb2cc09c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 --2- 172.21.15.52:0/3819872661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b00051c0 0x7fb2cc14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 >> 172.21.15.52:0/3819872661 conn(0x7fb2cc0b2b60 msgr2=0x7fb2cc06f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 shutdown_connections 2024-06-02T16:46:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:05.900+0000 7fb2d0a00640 1 -- 172.21.15.52:0/3819872661 wait complete. 2024-06-02T16:46:05.925 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T16:46:05.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T16:46:06.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.145+0000 7f3bc7200640 1 Processor -- start 2024-06-02T16:46:06.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.146+0000 7f3bc7200640 1 -- start start 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.147+0000 7f3bc7200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3bc8072860 0x7f3bc80b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.147+0000 7f3bc7200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc806e710 con 0x7f3bc81636d0 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.147+0000 7f3bc7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc80ade40 con 0x7f3bc80723b0 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.147+0000 7f3bc7200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc80b4360 con 0x7f3bc8072860 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc5e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3bc81636d0 0x7f3bc806f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48042/0 (socket says 172.21.15.52:48042) 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc5e00640 1 -- 172.21.15.52:0/40072950 learned_addr learned my addr 172.21.15.52:0/40072950 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:06.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc6800640 1 --2- 172.21.15.52:0/40072950 >> v2:172.21.15.52:3300/0 conn(0x7f3bc8072860 0x7f3bc80b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc4a00640 1 -- 172.21.15.52:0/40072950 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228300550 0 0) 0x7f3bc806e710 con 0x7f3bc81636d0 2024-06-02T16:46:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc4a00640 1 -- 172.21.15.52:0/40072950 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bac003520 con 0x7f3bc81636d0 2024-06-02T16:46:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc6800640 1 -- 172.21.15.52:0/40072950 >> v1:172.21.15.114:6789/0 conn(0x7f3bc80723b0 legacy=0x7f3bc80b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc6800640 1 -- 172.21.15.52:0/40072950 >> v1:172.21.15.52:6789/0 conn(0x7f3bc81636d0 legacy=0x7f3bc806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.148+0000 7f3bc6800640 1 -- 172.21.15.52:0/40072950 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc806fea0 con 0x7f3bc8072860 2024-06-02T16:46:06.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.149+0000 7f3bc6800640 1 --2- 172.21.15.52:0/40072950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc8072860 0x7f3bc80b57a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097a0 tx=0x7f3bc002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f3ce7ff128edfc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:06.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.150+0000 7f3bc4a00640 1 -- 172.21.15.52:0/40072950 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0037070 con 0x7f3bc8072860 2024-06-02T16:46:06.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.150+0000 7f3bc4a00640 1 -- 172.21.15.52:0/40072950 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0032440 con 0x7f3bc8072860 2024-06-02T16:46:06.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.150+0000 7f3bc4a00640 1 -- 172.21.15.52:0/40072950 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0032810 con 0x7f3bc8072860 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.150+0000 7f3bc7200640 1 -- 172.21.15.52:0/40072950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc8072860 msgr2=0x7f3bc80b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.150+0000 7f3bc7200640 1 --2- 172.21.15.52:0/40072950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc8072860 0x7f3bc80b57a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097a0 tx=0x7f3bc002a180 comp rx=0 tx=0).stop 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.151+0000 7f3bc7200640 1 -- 172.21.15.52:0/40072950 shutdown_connections 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.151+0000 7f3bc7200640 1 --2- 172.21.15.52:0/40072950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc8072860 0x7f3bc80b57a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.151+0000 7f3bc7200640 1 -- 172.21.15.52:0/40072950 >> 172.21.15.52:0/40072950 conn(0x7f3bc80b2b60 msgr2=0x7f3bc80b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.151+0000 7f3bc7200640 1 -- 172.21.15.52:0/40072950 shutdown_connections 2024-06-02T16:46:06.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.151+0000 7f3bc7200640 1 -- 172.21.15.52:0/40072950 wait complete. 2024-06-02T16:46:06.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.152+0000 7f3bc7200640 1 Processor -- start 2024-06-02T16:46:06.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.153+0000 7f3bc7200640 1 -- start start 2024-06-02T16:46:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bc80723b0 0x7f3bc80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 0x7f3bc814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80b4b70 con 0x7f3bc81636d0 2024-06-02T16:46:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80b4890 con 0x7f3bc8072860 2024-06-02T16:46:06.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc7200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc8072c70 con 0x7f3bc80723b0 2024-06-02T16:46:06.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:06.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36380/0 (socket says 172.21.15.52:36380) 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 -- 172.21.15.52:0/1112458485 learned_addr learned my addr 172.21.15.52:0/1112458485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc5400640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 0x7f3bc814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 -- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bc80723b0 msgr2=0x7f3bc80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bc80723b0 0x7f3bc80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 -- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 msgr2=0x7f3bc814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 0x7f3bc814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc6800640 1 -- 172.21.15.52:0/1112458485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc814b800 con 0x7f3bc81636d0 2024-06-02T16:46:06.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.154+0000 7f3bc5400640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 0x7f3bc814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:06.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bc6800640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00098c0 tx=0x7f3bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:06.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0041020 con 0x7f3bc81636d0 2024-06-02T16:46:06.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc003d620 con 0x7f3bc81636d0 2024-06-02T16:46:06.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0037040 con 0x7f3bc81636d0 2024-06-02T16:46:06.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc80af470 con 0x7f3bc81636d0 2024-06-02T16:46:06.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.155+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc80afa30 con 0x7f3bc81636d0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.156+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc8073d80 con 0x7f3bc81636d0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.157+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3bc0044020 con 0x7f3bc81636d0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.158+0000 7f3bbe000640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 0x7f3ba4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.159+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3bc00b7d90 con 0x7f3bc81636d0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.159+0000 7f3bc5e00640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 0x7f3ba4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.160+0000 7f3bc5e00640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 0x7f3ba4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80015a0 tx=0x7f3bb80015f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:06.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.163+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3bc8073d80 con 0x7f3bc81636d0 2024-06-02T16:46:06.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.419+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3bc80507e0 con 0x7f3bc81636d0 2024-06-02T16:46:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.907+0000 7f3bbe000640 1 -- 172.21.15.52:0/1112458485 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f3bc004b030 con 0x7f3bc81636d0 2024-06-02T16:46:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 msgr2=0x7f3ba4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 0x7f3ba4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80015a0 tx=0x7f3bb80015f0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 msgr2=0x7f3bc809b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00098c0 tx=0x7f3bc00046c0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 shutdown_connections 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3ba40762d0 0x7f3ba4078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc81636d0 0x7f3bc809b9c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc8072860 0x7f3bc814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 --2- 172.21.15.52:0/1112458485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bc80723b0 0x7f3bc80b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.911+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 >> 172.21.15.52:0/1112458485 conn(0x7f3bc80b2b60 msgr2=0x7f3bc8160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.912+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 shutdown_connections 2024-06-02T16:46:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:06.912+0000 7f3bc7200640 1 -- 172.21.15.52:0/1112458485 wait complete. 2024-06-02T16:46:06.932 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T16:46:06.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:46:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.148+0000 7f78b5200640 1 Processor -- start 2024-06-02T16:46:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.148+0000 7f78b5200640 1 -- start start 2024-06-02T16:46:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.150+0000 7f78b5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78b015cce0 0x7f78b006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.150+0000 7f78b5200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 0x7f78b006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.150+0000 7f78b5200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b015fa10 con 0x7f78b01604d0 2024-06-02T16:46:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.150+0000 7f78b5200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f78b0163ab0 con 0x7f78b015cce0 2024-06-02T16:46:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.150+0000 7f78b5200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f78b015fcd0 con 0x7f78b0163520 2024-06-02T16:46:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78a7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f78b01604d0 0x7f78b0162e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48052/0 (socket says 172.21.15.52:48052) 2024-06-02T16:46:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78a7e00640 1 -- 172.21.15.52:0/537355054 learned_addr learned my addr 172.21.15.52:0/537355054 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78afe00640 1 --2- 172.21.15.52:0/537355054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 0x7f78b006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78af400640 1 --2- 172.21.15.52:0/537355054 >> v2:172.21.15.114:3300/0 conn(0x7f78b015cce0 0x7f78b006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78aea00640 1 -- 172.21.15.52:0/537355054 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967754171 0 0) 0x7f78b015fa10 con 0x7f78b01604d0 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78aea00640 1 -- 172.21.15.52:0/537355054 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7894003520 con 0x7f78b01604d0 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78afe00640 1 -- 172.21.15.52:0/537355054 >> v2:172.21.15.114:3300/0 conn(0x7f78b015cce0 msgr2=0x7f78b006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78afe00640 1 --2- 172.21.15.52:0/537355054 >> v2:172.21.15.114:3300/0 conn(0x7f78b015cce0 0x7f78b006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78afe00640 1 -- 172.21.15.52:0/537355054 >> v1:172.21.15.52:6789/0 conn(0x7f78b01604d0 legacy=0x7f78b0162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.151+0000 7f78afe00640 1 -- 172.21.15.52:0/537355054 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b015ffb0 con 0x7f78b0163520 2024-06-02T16:46:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.153+0000 7f78afe00640 1 --2- 172.21.15.52:0/537355054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 0x7f78b006e670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009d90 tx=0x7f78a802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbdf5ca2db2cdeb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.153+0000 7f78aea00640 1 -- 172.21.15.52:0/537355054 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8007740 con 0x7f78b0163520 2024-06-02T16:46:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.153+0000 7f78aea00640 1 -- 172.21.15.52:0/537355054 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a80078e0 con 0x7f78b0163520 2024-06-02T16:46:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.153+0000 7f78aea00640 1 -- 172.21.15.52:0/537355054 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8007c90 con 0x7f78b0163520 2024-06-02T16:46:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 -- 172.21.15.52:0/537355054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 msgr2=0x7f78b006e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 --2- 172.21.15.52:0/537355054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 0x7f78b006e670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009d90 tx=0x7f78a802a660 comp rx=0 tx=0).stop 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 -- 172.21.15.52:0/537355054 shutdown_connections 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 --2- 172.21.15.52:0/537355054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b0163520 0x7f78b006e670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 --2- 172.21.15.52:0/537355054 >> v2:172.21.15.114:3300/0 conn(0x7f78b015cce0 0x7f78b006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 -- 172.21.15.52:0/537355054 >> 172.21.15.52:0/537355054 conn(0x7f78b006c380 msgr2=0x7f78b006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 -- 172.21.15.52:0/537355054 shutdown_connections 2024-06-02T16:46:07.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.154+0000 7f78b5200640 1 -- 172.21.15.52:0/537355054 wait complete. 2024-06-02T16:46:07.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.156+0000 7f78b5200640 1 Processor -- start 2024-06-02T16:46:07.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.156+0000 7f78b5200640 1 -- start start 2024-06-02T16:46:07.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b015cce0 0x7f78b00b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 0x7f78b00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00b5390 con 0x7f78b01604d0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00b5210 con 0x7f78b0163520 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78b5200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00b5510 con 0x7f78b015cce0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36392/0 (socket says 172.21.15.52:36392) 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78a7e00640 1 -- 172.21.15.52:0/4198747485 learned_addr learned my addr 172.21.15.52:0/4198747485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78af400640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b015cce0 0x7f78b00b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 -- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b015cce0 msgr2=0x7f78b00b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b015cce0 0x7f78b00b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 -- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 msgr2=0x7f78b00b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.157+0000 7f78afe00640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 0x7f78b00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 0x7f78b00b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 -- 172.21.15.52:0/4198747485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00b1500 con 0x7f78b01604d0 2024-06-02T16:46:07.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78afe00640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 0x7f78b00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:07.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7e00640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f789800c530 tx=0x7f789800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898017070 con 0x7f78b01604d0 2024-06-02T16:46:07.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898005ce0 con 0x7f78b01604d0 2024-06-02T16:46:07.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898007270 con 0x7f78b01604d0 2024-06-02T16:46:07.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.158+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b00b1840 con 0x7f78b01604d0 2024-06-02T16:46:07.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.159+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b00b2080 con 0x7f78b01604d0 2024-06-02T16:46:07.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.160+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b0075ea0 con 0x7f78b01604d0 2024-06-02T16:46:07.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.161+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f789801a070 con 0x7f78b01604d0 2024-06-02T16:46:07.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.162+0000 7f78a7400640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 0x7f788c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.162+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7898096940 con 0x7f78b01604d0 2024-06-02T16:46:07.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.163+0000 7f78af400640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 0x7f788c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.164+0000 7f78af400640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 0x7f788c078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009ad0 tx=0x7f78a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.167+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f78b00b1840 con 0x7f78b01604d0 2024-06-02T16:46:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.414+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78b00507e0 con 0x7f78b01604d0 2024-06-02T16:46:07.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.415+0000 7f78a7400640 1 -- 172.21.15.52:0/4198747485 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f789805fbb0 con 0x7f78b01604d0 2024-06-02T16:46:07.414 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:07.414 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:06.420731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:46:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-06-02T16:46:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 msgr2=0x7f788c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 0x7f788c078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009ad0 tx=0x7f78a0008040 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 msgr2=0x7f78b0145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f789800c530 tx=0x7f789800c9f0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 shutdown_connections 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f788c0762d0 0x7f788c078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b0163520 0x7f78b00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b01604d0 0x7f78b0145a70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 --2- 172.21.15.52:0/4198747485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78b015cce0 0x7f78b00b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 >> 172.21.15.52:0/4198747485 conn(0x7f78b006c380 msgr2=0x7f78b006e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 shutdown_connections 2024-06-02T16:46:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.418+0000 7f78b5200640 1 -- 172.21.15.52:0/4198747485 wait complete. 2024-06-02T16:46:07.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:46:07.585 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-06-02T16:46:07.586+0000 7ff4ac400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T16:46:07.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.641+0000 7fe014e00640 1 Processor -- start 2024-06-02T16:46:07.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.641+0000 7fe014e00640 1 -- start start 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 0x7fe0100ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 0x7fe01006f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0100d1450 0x7fe0100d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe01015d6b0 con 0x7fe0100d1450 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe01006ed90 con 0x7fe01015d2d0 2024-06-02T16:46:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe014e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe0100ae8e0 con 0x7fe01006fed0 2024-06-02T16:46:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe00e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0100d1450 0x7fe0100d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe00e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0100d1450 0x7fe0100d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36402/0 (socket says 172.21.15.52:36402) 2024-06-02T16:46:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.643+0000 7fe00e800640 1 -- 172.21.15.52:0/2147379009 learned_addr learned my addr 172.21.15.52:0/2147379009 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00d400640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 0x7fe01006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00de00640 1 --2- 172.21.15.52:0/2147379009 >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 0x7fe0100ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00e800640 1 -- 172.21.15.52:0/2147379009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 msgr2=0x7fe01006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00e800640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 0x7fe01006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00e800640 1 -- 172.21.15.52:0/2147379009 >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 msgr2=0x7fe0100ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00e800640 1 --2- 172.21.15.52:0/2147379009 >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 0x7fe0100ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00e800640 1 -- 172.21.15.52:0/2147379009 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0100ae600 con 0x7fe0100d1450 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00d400640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 0x7fe01006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.644+0000 7fe00de00640 1 --2- 172.21.15.52:0/2147379009 >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 0x7fe0100ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:46:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.645+0000 7fe00e800640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100d18e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0100b6440 tx=0x7fe00802a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c3979bff206b36 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe00ca00640 1 -- 172.21.15.52:0/2147379009 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008036070 con 0x7fe0100d1450 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe00ca00640 1 -- 172.21.15.52:0/2147379009 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe008031600 con 0x7fe0100d1450 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe00ca00640 1 -- 172.21.15.52:0/2147379009 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0080319d0 con 0x7fe0100d1450 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe014e00640 1 -- 172.21.15.52:0/2147379009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 msgr2=0x7fe0100d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe014e00640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100d18e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0100b6440 tx=0x7fe00802a690 comp rx=0 tx=0).stop 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.646+0000 7fe014e00640 1 -- 172.21.15.52:0/2147379009 shutdown_connections 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01006fed0 0x7fe01006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 --2- 172.21.15.52:0/2147379009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100d18e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 --2- 172.21.15.52:0/2147379009 >> v2:172.21.15.114:3300/0 conn(0x7fe01015d2d0 0x7fe0100ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 -- 172.21.15.52:0/2147379009 >> 172.21.15.52:0/2147379009 conn(0x7fe01006c7a0 msgr2=0x7fe01006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 -- 172.21.15.52:0/2147379009 shutdown_connections 2024-06-02T16:46:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.647+0000 7fe014e00640 1 -- 172.21.15.52:0/2147379009 wait complete. 2024-06-02T16:46:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.648+0000 7fe014e00640 1 Processor -- start 2024-06-02T16:46:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.648+0000 7fe014e00640 1 -- start start 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe01006fed0 0x7fe010153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015d2d0 0x7fe0101f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0100741b0 con 0x7fe0100d1450 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe01006ea20 con 0x7fe01006fed0 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.649+0000 7fe014e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe0101f52e0 con 0x7fe01015d2d0 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36406/0 (socket says 172.21.15.52:36406) 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 -- 172.21.15.52:0/889579928 learned_addr learned my addr 172.21.15.52:0/889579928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00e800640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015d2d0 0x7fe0101f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00de00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe01006fed0 0x7fe010153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 -- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015d2d0 msgr2=0x7fe0101f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015d2d0 0x7fe0101f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 -- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe01006fed0 msgr2=0x7fe010153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe01006fed0 0x7fe010153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 -- 172.21.15.52:0/889579928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe010158e70 con 0x7fe0100d1450 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.650+0000 7fe00d400640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e810 tx=0x7fdffc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.651+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00f040 con 0x7fe0100d1450 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.651+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdffc004030 con 0x7fe0100d1450 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.651+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc004400 con 0x7fe0100d1450 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.651+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe010159150 con 0x7fe0100d1450 2024-06-02T16:46:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.651+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe010158790 con 0x7fe0100d1450 2024-06-02T16:46:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.652+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe010069520 con 0x7fe0100d1450 2024-06-02T16:46:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.653+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdffc00c6d0 con 0x7fe0100d1450 2024-06-02T16:46:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.654+0000 7fe006000640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 0x7fdff00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.654+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fdffc097330 con 0x7fe0100d1450 2024-06-02T16:46:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.655+0000 7fe00de00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 0x7fdff00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:07.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.656+0000 7fe00de00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 0x7fdff00787c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.661+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdffc017020 con 0x7fe0100d1450 2024-06-02T16:46:07.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.873+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe01015aeb0 con 0x7fe0100d1450 2024-06-02T16:46:07.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.875+0000 7fe006000640 1 -- 172.21.15.52:0/889579928 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16669 (secure 0 0 0) 0x7fdffc060bf0 con 0x7fe0100d1450 2024-06-02T16:46:07.874 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:07.874 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":35,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:46:04.857659+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:46:01.311582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-06-02T16:46:02.318550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 msgr2=0x7fdff00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 0x7fdff00787c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000008040 comp rx=0 tx=0).stop 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 msgr2=0x7fe0100b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e810 tx=0x7fdffc00ecd0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 shutdown_connections 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdff0076300 0x7fdff00787c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015d2d0 0x7fe0101f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0100d1450 0x7fe0100b18e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 --2- 172.21.15.52:0/889579928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe01006fed0 0x7fe010153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 >> 172.21.15.52:0/889579928 conn(0x7fe01006c7a0 msgr2=0x7fe0100b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 shutdown_connections 2024-06-02T16:46:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:07.878+0000 7fe014e00640 1 -- 172.21.15.52:0/889579928 wait complete. 2024-06-02T16:46:07.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T16:46:07.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:46:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.105+0000 7f7afd600640 1 Processor -- start 2024-06-02T16:46:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.106+0000 7f7afd600640 1 -- start start 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afd600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7af815d060 0x7f7af80d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afd600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80d06b0 0x7f7af80b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afd600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af81607c0 con 0x7f7af80b71c0 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afd600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7af80b7620 con 0x7f7af815d060 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afd600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7af8163c50 con 0x7f7af80d06b0 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7af7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7af815d060 0x7f7af80d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7af7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7af815d060 0x7f7af80d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36414/0 (socket says 172.21.15.52:36414) 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7af7e00640 1 -- 172.21.15.52:0/2192707636 learned_addr learned my addr 172.21.15.52:0/2192707636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.107+0000 7f7afcc00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7af80b71c0 0x7f7af80ba430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48058/0 (socket says 172.21.15.52:48058) 2024-06-02T16:46:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.108+0000 7f7af7400640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80d06b0 0x7f7af80b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.108+0000 7f7af7e00640 1 -- 172.21.15.52:0/2192707636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80d06b0 msgr2=0x7f7af80b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.108+0000 7f7af7e00640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80d06b0 0x7f7af80b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.108+0000 7f7af7e00640 1 -- 172.21.15.52:0/2192707636 >> v1:172.21.15.52:6789/0 conn(0x7f7af80b71c0 legacy=0x7f7af80ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.108+0000 7f7af7e00640 1 -- 172.21.15.52:0/2192707636 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af8163040 con 0x7f7af815d060 2024-06-02T16:46:08.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.109+0000 7f7af7e00640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af815d060 0x7f7af80d0170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009870 tx=0x7f7ae002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ff9a5fcfe42942 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.109+0000 7f7af6a00640 1 -- 172.21.15.52:0/2192707636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0037070 con 0x7f7af815d060 2024-06-02T16:46:08.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.109+0000 7f7af6a00640 1 -- 172.21.15.52:0/2192707636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae0032440 con 0x7f7af815d060 2024-06-02T16:46:08.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.109+0000 7f7af6a00640 1 -- 172.21.15.52:0/2192707636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0032810 con 0x7f7af815d060 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 -- 172.21.15.52:0/2192707636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af815d060 msgr2=0x7f7af80d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af815d060 0x7f7af80d0170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009870 tx=0x7f7ae002a250 comp rx=0 tx=0).stop 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 -- 172.21.15.52:0/2192707636 shutdown_connections 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80d06b0 0x7f7af80b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 --2- 172.21.15.52:0/2192707636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af815d060 0x7f7af80d0170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 -- 172.21.15.52:0/2192707636 >> 172.21.15.52:0/2192707636 conn(0x7f7af80740e0 msgr2=0x7f7af80d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 -- 172.21.15.52:0/2192707636 shutdown_connections 2024-06-02T16:46:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.110+0000 7f7afd600640 1 -- 172.21.15.52:0/2192707636 wait complete. 2024-06-02T16:46:08.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.112+0000 7f7afd600640 1 Processor -- start 2024-06-02T16:46:08.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.112+0000 7f7afd600640 1 -- start start 2024-06-02T16:46:08.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80b71c0 0x7f7af80b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af815d060 0x7f7af81f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7af81638e0 con 0x7f7af80d06b0 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8163600 con 0x7f7af815d060 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7afd600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7af80bab40 con 0x7f7af80b71c0 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7af7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7af7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36426/0 (socket says 172.21.15.52:36426) 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.113+0000 7f7af7400640 1 -- 172.21.15.52:0/1004230130 learned_addr learned my addr 172.21.15.52:0/1004230130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7e00640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80b71c0 0x7f7af80b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 -- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80b71c0 msgr2=0x7f7af80b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80b71c0 0x7f7af80b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 -- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af815d060 msgr2=0x7f7af81f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7afcc00640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af815d060 0x7f7af81f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af815d060 0x7f7af81f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 -- 172.21.15.52:0/1004230130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af80ce370 con 0x7f7af80d06b0 2024-06-02T16:46:08.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7af7400640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d800 tx=0x7f7ae800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800b6c0 con 0x7f7af80d06b0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae8019070 con 0x7f7af80d06b0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800ba80 con 0x7f7af80d06b0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.114+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af80ce650 con 0x7f7af80d06b0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.115+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af80cec10 con 0x7f7af80d06b0 2024-06-02T16:46:08.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.116+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af80507e0 con 0x7f7af80d06b0 2024-06-02T16:46:08.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.117+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ae800bc20 con 0x7f7af80d06b0 2024-06-02T16:46:08.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.118+0000 7f7aefe00640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 0x7f7ad4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.118+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7ae8097b70 con 0x7f7af80d06b0 2024-06-02T16:46:08.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.118+0000 7f7af7e00640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 0x7f7ad4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.119+0000 7f7af7e00640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 0x7f7ad4078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0034000 tx=0x7f7ae002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.122+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ae8061430 con 0x7f7af80d06b0 2024-06-02T16:46:08.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.329+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7af8160e60 con 0x7f7ad40762d0 2024-06-02T16:46:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.349+0000 7f7aefe00640 1 -- 172.21.15.52:0/1004230130 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251224 (secure 0 0 0) 0x7f7af8160e60 con 0x7f7ad40762d0 2024-06-02T16:46:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 msgr2=0x7f7ad4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 0x7f7ad4078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0034000 tx=0x7f7ae002e000 comp rx=0 tx=0).stop 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 msgr2=0x7f7af81f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d800 tx=0x7f7ae800dcc0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 shutdown_connections 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7ad40762d0 0x7f7ad4078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af815d060 0x7f7af81f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af80d06b0 0x7f7af81f7c70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 --2- 172.21.15.52:0/1004230130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7af80b71c0 0x7f7af80b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.355+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 >> 172.21.15.52:0/1004230130 conn(0x7f7af80740e0 msgr2=0x7f7af815e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.356+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 shutdown_connections 2024-06-02T16:46:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.356+0000 7f7afd600640 1 -- 172.21.15.52:0/1004230130 wait complete. 2024-06-02T16:46:08.373 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-06-02T16:46:08.012009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236848,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737872,"statfs":{"total":773094113280,"available":772851580928,"internally_reserved":0,"allocated":4136960,"data_stored":2296203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002273"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902594+0000","last_change":"2024-06-02T16:46:03.899601+0000","last_active":"2024-06-02T16:46:03.902594+0000","last_peered":"2024-06-02T16:46:03.902594+0000","last_clean":"2024-06-02T16:46:03.902594+0000","last_became_active":"2024-06-02T16:46:03.899249+0000","last_became_peered":"2024-06-02T16:46:03.899249+0000","last_unstale":"2024-06-02T16:46:03.902594+0000","last_undegraded":"2024-06-02T16:46:03.902594+0000","last_fullsized":"2024-06-02T16:46:03.902594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.896339+0000","last_change":"2024-06-02T16:46:03.893509+0000","last_active":"2024-06-02T16:46:03.896339+0000","last_peered":"2024-06-02T16:46:03.896339+0000","last_clean":"2024-06-02T16:46:03.896339+0000","last_became_active":"2024-06-02T16:46:03.893090+0000","last_became_peered":"2024-06-02T16:46:03.893090+0000","last_unstale":"2024-06-02T16:46:03.896339+0000","last_undegraded":"2024-06-02T16:46:03.896339+0000","last_fullsized":"2024-06-02T16:46:03.896339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910086+0000","last_change":"2024-06-02T16:46:03.906471+0000","last_active":"2024-06-02T16:46:03.910086+0000","last_peered":"2024-06-02T16:46:03.910086+0000","last_clean":"2024-06-02T16:46:03.910086+0000","last_became_active":"2024-06-02T16:46:03.904044+0000","last_became_peered":"2024-06-02T16:46:03.904044+0000","last_unstale":"2024-06-02T16:46:03.910086+0000","last_undegraded":"2024-06-02T16:46:03.910086+0000","last_fullsized":"2024-06-02T16:46:03.910086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.870067+0000","last_change":"2024-06-02T16:46:02.870067+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.870067+0000","last_undegraded":"2024-06-02T16:46:02.870067+0000","last_fullsized":"2024-06-02T16:46:02.870067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891945+0000","last_change":"2024-06-02T16:46:03.886231+0000","last_active":"2024-06-02T16:46:03.891945+0000","last_peered":"2024-06-02T16:46:03.891945+0000","last_clean":"2024-06-02T16:46:03.891945+0000","last_became_active":"2024-06-02T16:46:03.884590+0000","last_became_peered":"2024-06-02T16:46:03.884590+0000","last_unstale":"2024-06-02T16:46:03.891945+0000","last_undegraded":"2024-06-02T16:46:03.891945+0000","last_fullsized":"2024-06-02T16:46:03.891945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:22.800808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.893794+0000","last_change":"2024-06-02T16:46:03.890058+0000","last_active":"2024-06-02T16:46:03.893794+0000","last_peered":"2024-06-02T16:46:03.893794+0000","last_clean":"2024-06-02T16:46:03.893794+0000","last_became_active":"2024-06-02T16:46:03.889655+0000","last_became_peered":"2024-06-02T16:46:03.889655+0000","last_unstale":"2024-06-02T16:46:03.893794+0000","last_undegraded":"2024-06-02T16:46:03.893794+0000","last_fullsized":"2024-06-02T16:46:03.893794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867638+0000","last_change":"2024-06-02T16:46:03.900580+0000","last_active":"2024-06-02T16:46:04.867638+0000","last_peered":"2024-06-02T16:46:04.867638+0000","last_clean":"2024-06-02T16:46:04.867638+0000","last_became_active":"2024-06-02T16:46:03.899640+0000","last_became_peered":"2024-06-02T16:46:03.899640+0000","last_unstale":"2024-06-02T16:46:04.867638+0000","last_undegraded":"2024-06-02T16:46:04.867638+0000","last_fullsized":"2024-06-02T16:46:04.867638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867223+0000","last_change":"2024-06-02T16:46:03.908391+0000","last_active":"2024-06-02T16:46:04.867223+0000","last_peered":"2024-06-02T16:46:04.867223+0000","last_clean":"2024-06-02T16:46:04.867223+0000","last_became_active":"2024-06-02T16:46:03.907935+0000","last_became_peered":"2024-06-02T16:46:03.907935+0000","last_unstale":"2024-06-02T16:46:04.867223+0000","last_undegraded":"2024-06-02T16:46:04.867223+0000","last_fullsized":"2024-06-02T16:46:04.867223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913926+0000","last_change":"2024-06-02T16:46:03.909678+0000","last_active":"2024-06-02T16:46:03.913926+0000","last_peered":"2024-06-02T16:46:03.913926+0000","last_clean":"2024-06-02T16:46:03.913926+0000","last_became_active":"2024-06-02T16:46:03.905007+0000","last_became_peered":"2024-06-02T16:46:03.905007+0000","last_unstale":"2024-06-02T16:46:03.913926+0000","last_undegraded":"2024-06-02T16:46:03.913926+0000","last_fullsized":"2024-06-02T16:46:03.913926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865396+0000","last_change":"2024-06-02T16:46:02.865396+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865396+0000","last_undegraded":"2024-06-02T16:46:02.865396+0000","last_fullsized":"2024-06-02T16:46:02.865396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868493+0000","last_change":"2024-06-02T16:46:03.897768+0000","last_active":"2024-06-02T16:46:04.868493+0000","last_peered":"2024-06-02T16:46:04.868493+0000","last_clean":"2024-06-02T16:46:04.868493+0000","last_became_active":"2024-06-02T16:46:03.897473+0000","last_became_peered":"2024-06-02T16:46:03.897473+0000","last_unstale":"2024-06-02T16:46:04.868493+0000","last_undegraded":"2024-06-02T16:46:04.868493+0000","last_fullsized":"2024-06-02T16:46:04.868493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900481+0000","last_change":"2024-06-02T16:46:03.893747+0000","last_active":"2024-06-02T16:46:03.900481+0000","last_peered":"2024-06-02T16:46:03.900481+0000","last_clean":"2024-06-02T16:46:03.900481+0000","last_became_active":"2024-06-02T16:46:03.893457+0000","last_became_peered":"2024-06-02T16:46:03.893457+0000","last_unstale":"2024-06-02T16:46:03.900481+0000","last_undegraded":"2024-06-02T16:46:03.900481+0000","last_fullsized":"2024-06-02T16:46:03.900481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906034+0000","last_change":"2024-06-02T16:46:03.904170+0000","last_active":"2024-06-02T16:46:03.906034+0000","last_peered":"2024-06-02T16:46:03.906034+0000","last_clean":"2024-06-02T16:46:03.906034+0000","last_became_active":"2024-06-02T16:46:03.903910+0000","last_became_peered":"2024-06-02T16:46:03.903910+0000","last_unstale":"2024-06-02T16:46:03.906034+0000","last_undegraded":"2024-06-02T16:46:03.906034+0000","last_fullsized":"2024-06-02T16:46:03.906034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:03.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.889930+0000","last_change":"2024-06-02T16:46:03.881096+0000","last_active":"2024-06-02T16:46:03.889930+0000","last_peered":"2024-06-02T16:46:03.889930+0000","last_clean":"2024-06-02T16:46:03.889930+0000","last_became_active":"2024-06-02T16:46:03.880588+0000","last_became_peered":"2024-06-02T16:46:03.880588+0000","last_unstale":"2024-06-02T16:46:03.889930+0000","last_undegraded":"2024-06-02T16:46:03.889930+0000","last_fullsized":"2024-06-02T16:46:03.889930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903548+0000","last_change":"2024-06-02T16:46:03.898043+0000","last_active":"2024-06-02T16:46:03.903548+0000","last_peered":"2024-06-02T16:46:03.903548+0000","last_clean":"2024-06-02T16:46:03.903548+0000","last_became_active":"2024-06-02T16:46:03.897729+0000","last_became_peered":"2024-06-02T16:46:03.897729+0000","last_unstale":"2024-06-02T16:46:03.903548+0000","last_undegraded":"2024-06-02T16:46:03.903548+0000","last_fullsized":"2024-06-02T16:46:03.903548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:19.601796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867980+0000","last_change":"2024-06-02T16:46:03.901353+0000","last_active":"2024-06-02T16:46:04.867980+0000","last_peered":"2024-06-02T16:46:04.867980+0000","last_clean":"2024-06-02T16:46:04.867980+0000","last_became_active":"2024-06-02T16:46:03.901086+0000","last_became_peered":"2024-06-02T16:46:03.901086+0000","last_unstale":"2024-06-02T16:46:04.867980+0000","last_undegraded":"2024-06-02T16:46:04.867980+0000","last_fullsized":"2024-06-02T16:46:04.867980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868905+0000","last_change":"2024-06-02T16:46:03.903426+0000","last_active":"2024-06-02T16:46:04.868905+0000","last_peered":"2024-06-02T16:46:04.868905+0000","last_clean":"2024-06-02T16:46:04.868905+0000","last_became_active":"2024-06-02T16:46:03.903109+0000","last_became_peered":"2024-06-02T16:46:03.903109+0000","last_unstale":"2024-06-02T16:46:04.868905+0000","last_undegraded":"2024-06-02T16:46:04.868905+0000","last_fullsized":"2024-06-02T16:46:04.868905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.912003+0000","last_change":"2024-06-02T16:46:03.908555+0000","last_active":"2024-06-02T16:46:03.912003+0000","last_peered":"2024-06-02T16:46:03.912003+0000","last_clean":"2024-06-02T16:46:03.912003+0000","last_became_active":"2024-06-02T16:46:03.908205+0000","last_became_peered":"2024-06-02T16:46:03.908205+0000","last_unstale":"2024-06-02T16:46:03.912003+0000","last_undegraded":"2024-06-02T16:46:03.912003+0000","last_fullsized":"2024-06-02T16:46:03.912003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903376+0000","last_change":"2024-06-02T16:46:03.897750+0000","last_active":"2024-06-02T16:46:03.903376+0000","last_peered":"2024-06-02T16:46:03.903376+0000","last_clean":"2024-06-02T16:46:03.903376+0000","last_became_active":"2024-06-02T16:46:03.897419+0000","last_became_peered":"2024-06-02T16:46:03.897419+0000","last_unstale":"2024-06-02T16:46:03.903376+0000","last_undegraded":"2024-06-02T16:46:03.903376+0000","last_fullsized":"2024-06-02T16:46:03.903376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907778+0000","last_change":"2024-06-02T16:46:03.899325+0000","last_active":"2024-06-02T16:46:03.907778+0000","last_peered":"2024-06-02T16:46:03.907778+0000","last_clean":"2024-06-02T16:46:03.907778+0000","last_became_active":"2024-06-02T16:46:03.899055+0000","last_became_peered":"2024-06-02T16:46:03.899055+0000","last_unstale":"2024-06-02T16:46:03.907778+0000","last_undegraded":"2024-06-02T16:46:03.907778+0000","last_fullsized":"2024-06-02T16:46:03.907778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:17.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914066+0000","last_change":"2024-06-02T16:46:03.906474+0000","last_active":"2024-06-02T16:46:03.914066+0000","last_peered":"2024-06-02T16:46:03.914066+0000","last_clean":"2024-06-02T16:46:03.914066+0000","last_became_active":"2024-06-02T16:46:03.906146+0000","last_became_peered":"2024-06-02T16:46:03.906146+0000","last_unstale":"2024-06-02T16:46:03.914066+0000","last_undegraded":"2024-06-02T16:46:03.914066+0000","last_fullsized":"2024-06-02T16:46:03.914066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914317+0000","last_change":"2024-06-02T16:46:03.910134+0000","last_active":"2024-06-02T16:46:03.914317+0000","last_peered":"2024-06-02T16:46:03.914317+0000","last_clean":"2024-06-02T16:46:03.914317+0000","last_became_active":"2024-06-02T16:46:03.909544+0000","last_became_peered":"2024-06-02T16:46:03.909544+0000","last_unstale":"2024-06-02T16:46:03.914317+0000","last_undegraded":"2024-06-02T16:46:03.914317+0000","last_fullsized":"2024-06-02T16:46:03.914317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908187+0000","last_change":"2024-06-02T16:46:03.895902+0000","last_active":"2024-06-02T16:46:03.908187+0000","last_peered":"2024-06-02T16:46:03.908187+0000","last_clean":"2024-06-02T16:46:03.908187+0000","last_became_active":"2024-06-02T16:46:03.895533+0000","last_became_peered":"2024-06-02T16:46:03.895533+0000","last_unstale":"2024-06-02T16:46:03.908187+0000","last_undegraded":"2024-06-02T16:46:03.908187+0000","last_fullsized":"2024-06-02T16:46:03.908187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891820+0000","last_change":"2024-06-02T16:46:03.889132+0000","last_active":"2024-06-02T16:46:03.891820+0000","last_peered":"2024-06-02T16:46:03.891820+0000","last_clean":"2024-06-02T16:46:03.891820+0000","last_became_active":"2024-06-02T16:46:03.888335+0000","last_became_peered":"2024-06-02T16:46:03.888335+0000","last_unstale":"2024-06-02T16:46:03.891820+0000","last_undegraded":"2024-06-02T16:46:03.891820+0000","last_fullsized":"2024-06-02T16:46:03.891820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899970+0000","last_change":"2024-06-02T16:46:03.894665+0000","last_active":"2024-06-02T16:46:03.899970+0000","last_peered":"2024-06-02T16:46:03.899970+0000","last_clean":"2024-06-02T16:46:03.899970+0000","last_became_active":"2024-06-02T16:46:03.894317+0000","last_became_peered":"2024-06-02T16:46:03.894317+0000","last_unstale":"2024-06-02T16:46:03.899970+0000","last_undegraded":"2024-06-02T16:46:03.899970+0000","last_fullsized":"2024-06-02T16:46:03.899970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866006+0000","last_change":"2024-06-02T16:46:02.866006+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866006+0000","last_undegraded":"2024-06-02T16:46:02.866006+0000","last_fullsized":"2024-06-02T16:46:02.866006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902707+0000","last_change":"2024-06-02T16:46:03.896638+0000","last_active":"2024-06-02T16:46:03.902707+0000","last_peered":"2024-06-02T16:46:03.902707+0000","last_clean":"2024-06-02T16:46:03.902707+0000","last_became_active":"2024-06-02T16:46:03.896360+0000","last_became_peered":"2024-06-02T16:46:03.896360+0000","last_unstale":"2024-06-02T16:46:03.902707+0000","last_undegraded":"2024-06-02T16:46:03.902707+0000","last_fullsized":"2024-06-02T16:46:03.902707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914044+0000","last_change":"2024-06-02T16:46:03.904596+0000","last_active":"2024-06-02T16:46:03.914044+0000","last_peered":"2024-06-02T16:46:03.914044+0000","last_clean":"2024-06-02T16:46:03.914044+0000","last_became_active":"2024-06-02T16:46:03.901408+0000","last_became_peered":"2024-06-02T16:46:03.901408+0000","last_unstale":"2024-06-02T16:46:03.914044+0000","last_undegraded":"2024-06-02T16:46:03.914044+0000","last_fullsized":"2024-06-02T16:46:03.914044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868136+0000","last_change":"2024-06-02T16:46:03.903410+0000","last_active":"2024-06-02T16:46:04.868136+0000","last_peered":"2024-06-02T16:46:04.868136+0000","last_clean":"2024-06-02T16:46:04.868136+0000","last_became_active":"2024-06-02T16:46:03.903107+0000","last_became_peered":"2024-06-02T16:46:03.903107+0000","last_unstale":"2024-06-02T16:46:04.868136+0000","last_undegraded":"2024-06-02T16:46:04.868136+0000","last_fullsized":"2024-06-02T16:46:04.868136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901736+0000","last_change":"2024-06-02T16:46:03.895116+0000","last_active":"2024-06-02T16:46:03.901736+0000","last_peered":"2024-06-02T16:46:03.901736+0000","last_clean":"2024-06-02T16:46:03.901736+0000","last_became_active":"2024-06-02T16:46:03.894743+0000","last_became_peered":"2024-06-02T16:46:03.894743+0000","last_unstale":"2024-06-02T16:46:03.901736+0000","last_undegraded":"2024-06-02T16:46:03.901736+0000","last_fullsized":"2024-06-02T16:46:03.901736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867072+0000","last_change":"2024-06-02T16:46:03.914694+0000","last_active":"2024-06-02T16:46:04.867072+0000","last_peered":"2024-06-02T16:46:04.867072+0000","last_clean":"2024-06-02T16:46:04.867072+0000","last_became_active":"2024-06-02T16:46:03.914442+0000","last_became_peered":"2024-06-02T16:46:03.914442+0000","last_unstale":"2024-06-02T16:46:04.867072+0000","last_undegraded":"2024-06-02T16:46:04.867072+0000","last_fullsized":"2024-06-02T16:46:04.867072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.905385+0000","last_change":"2024-06-02T16:46:03.896326+0000","last_active":"2024-06-02T16:46:03.905385+0000","last_peered":"2024-06-02T16:46:03.905385+0000","last_clean":"2024-06-02T16:46:03.905385+0000","last_became_active":"2024-06-02T16:46:03.896032+0000","last_became_peered":"2024-06-02T16:46:03.896032+0000","last_unstale":"2024-06-02T16:46:03.905385+0000","last_undegraded":"2024-06-02T16:46:03.905385+0000","last_fullsized":"2024-06-02T16:46:03.905385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917653+0000","last_change":"2024-06-02T16:46:02.888949+0000","last_active":"2024-06-02T16:46:03.917653+0000","last_peered":"2024-06-02T16:46:03.917653+0000","last_clean":"2024-06-02T16:46:03.917653+0000","last_became_active":"2024-06-02T16:46:02.888543+0000","last_became_peered":"2024-06-02T16:46:02.888543+0000","last_unstale":"2024-06-02T16:46:03.917653+0000","last_undegraded":"2024-06-02T16:46:03.917653+0000","last_fullsized":"2024-06-02T16:46:03.917653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902214+0000","last_change":"2024-06-02T16:46:03.897726+0000","last_active":"2024-06-02T16:46:03.902214+0000","last_peered":"2024-06-02T16:46:03.902214+0000","last_clean":"2024-06-02T16:46:03.902214+0000","last_became_active":"2024-06-02T16:46:03.897418+0000","last_became_peered":"2024-06-02T16:46:03.897418+0000","last_unstale":"2024-06-02T16:46:03.902214+0000","last_undegraded":"2024-06-02T16:46:03.902214+0000","last_fullsized":"2024-06-02T16:46:03.902214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919454+0000","last_change":"2024-06-02T16:46:02.893537+0000","last_active":"2024-06-02T16:46:03.919454+0000","last_peered":"2024-06-02T16:46:03.919454+0000","last_clean":"2024-06-02T16:46:03.919454+0000","last_became_active":"2024-06-02T16:46:02.892005+0000","last_became_peered":"2024-06-02T16:46:02.892005+0000","last_unstale":"2024-06-02T16:46:03.919454+0000","last_undegraded":"2024-06-02T16:46:03.919454+0000","last_fullsized":"2024-06-02T16:46:03.919454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911432+0000","last_change":"2024-06-02T16:46:03.901369+0000","last_active":"2024-06-02T16:46:03.911432+0000","last_peered":"2024-06-02T16:46:03.911432+0000","last_clean":"2024-06-02T16:46:03.911432+0000","last_became_active":"2024-06-02T16:46:03.901096+0000","last_became_peered":"2024-06-02T16:46:03.901096+0000","last_unstale":"2024-06-02T16:46:03.911432+0000","last_undegraded":"2024-06-02T16:46:03.911432+0000","last_fullsized":"2024-06-02T16:46:03.911432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.922973+0000","last_change":"2024-06-02T16:46:02.885969+0000","last_active":"2024-06-02T16:46:03.922973+0000","last_peered":"2024-06-02T16:46:03.922973+0000","last_clean":"2024-06-02T16:46:03.922973+0000","last_became_active":"2024-06-02T16:46:02.885069+0000","last_became_peered":"2024-06-02T16:46:02.885069+0000","last_unstale":"2024-06-02T16:46:03.922973+0000","last_undegraded":"2024-06-02T16:46:03.922973+0000","last_fullsized":"2024-06-02T16:46:03.922973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:18.595331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.864965+0000","last_change":"2024-06-02T16:46:02.864965+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.864965+0000","last_undegraded":"2024-06-02T16:46:02.864965+0000","last_fullsized":"2024-06-02T16:46:02.864965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919597+0000","last_change":"2024-06-02T16:46:02.884689+0000","last_active":"2024-06-02T16:46:03.919597+0000","last_peered":"2024-06-02T16:46:03.919597+0000","last_clean":"2024-06-02T16:46:03.919597+0000","last_became_active":"2024-06-02T16:46:02.884375+0000","last_became_peered":"2024-06-02T16:46:02.884375+0000","last_unstale":"2024-06-02T16:46:03.919597+0000","last_undegraded":"2024-06-02T16:46:03.919597+0000","last_fullsized":"2024-06-02T16:46:03.919597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:55.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868244+0000","last_change":"2024-06-02T16:46:03.915192+0000","last_active":"2024-06-02T16:46:04.868244+0000","last_peered":"2024-06-02T16:46:04.868244+0000","last_clean":"2024-06-02T16:46:04.868244+0000","last_became_active":"2024-06-02T16:46:03.914914+0000","last_became_peered":"2024-06-02T16:46:03.914914+0000","last_unstale":"2024-06-02T16:46:04.868244+0000","last_undegraded":"2024-06-02T16:46:04.868244+0000","last_fullsized":"2024-06-02T16:46:04.868244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920894+0000","last_change":"2024-06-02T16:46:02.890589+0000","last_active":"2024-06-02T16:46:03.920894+0000","last_peered":"2024-06-02T16:46:03.920894+0000","last_clean":"2024-06-02T16:46:03.920894+0000","last_became_active":"2024-06-02T16:46:02.890352+0000","last_became_peered":"2024-06-02T16:46:02.890352+0000","last_unstale":"2024-06-02T16:46:03.920894+0000","last_undegraded":"2024-06-02T16:46:03.920894+0000","last_fullsized":"2024-06-02T16:46:03.920894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903653+0000","last_change":"2024-06-02T16:46:03.897804+0000","last_active":"2024-06-02T16:46:03.903653+0000","last_peered":"2024-06-02T16:46:03.903653+0000","last_clean":"2024-06-02T16:46:03.903653+0000","last_became_active":"2024-06-02T16:46:03.896250+0000","last_became_peered":"2024-06-02T16:46:03.896250+0000","last_unstale":"2024-06-02T16:46:03.903653+0000","last_undegraded":"2024-06-02T16:46:03.903653+0000","last_fullsized":"2024-06-02T16:46:03.903653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:23.137749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920927+0000","last_change":"2024-06-02T16:46:02.887796+0000","last_active":"2024-06-02T16:46:03.920927+0000","last_peered":"2024-06-02T16:46:03.920927+0000","last_clean":"2024-06-02T16:46:03.920927+0000","last_became_active":"2024-06-02T16:46:02.887447+0000","last_became_peered":"2024-06-02T16:46:02.887447+0000","last_unstale":"2024-06-02T16:46:03.920927+0000","last_undegraded":"2024-06-02T16:46:03.920927+0000","last_fullsized":"2024-06-02T16:46:03.920927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:13.404538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913883+0000","last_change":"2024-06-02T16:46:03.906099+0000","last_active":"2024-06-02T16:46:03.913883+0000","last_peered":"2024-06-02T16:46:03.913883+0000","last_clean":"2024-06-02T16:46:03.913883+0000","last_became_active":"2024-06-02T16:46:03.905768+0000","last_became_peered":"2024-06-02T16:46:03.905768+0000","last_unstale":"2024-06-02T16:46:03.913883+0000","last_undegraded":"2024-06-02T16:46:03.913883+0000","last_fullsized":"2024-06-02T16:46:03.913883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863774+0000","last_change":"2024-06-02T16:46:02.881438+0000","last_active":"2024-06-02T16:46:03.863774+0000","last_peered":"2024-06-02T16:46:03.863774+0000","last_clean":"2024-06-02T16:46:03.863774+0000","last_became_active":"2024-06-02T16:46:02.881163+0000","last_became_peered":"2024-06-02T16:46:02.881163+0000","last_unstale":"2024-06-02T16:46:03.863774+0000","last_undegraded":"2024-06-02T16:46:03.863774+0000","last_fullsized":"2024-06-02T16:46:03.863774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:45.683326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883516+0000","last_change":"2024-06-02T16:46:02.887974+0000","last_active":"2024-06-02T16:46:03.883516+0000","last_peered":"2024-06-02T16:46:03.883516+0000","last_clean":"2024-06-02T16:46:03.883516+0000","last_became_active":"2024-06-02T16:46:02.887518+0000","last_became_peered":"2024-06-02T16:46:02.887518+0000","last_unstale":"2024-06-02T16:46:03.883516+0000","last_undegraded":"2024-06-02T16:46:03.883516+0000","last_fullsized":"2024-06-02T16:46:03.883516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:41.542744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.892984+0000","last_change":"2024-06-02T16:46:03.889252+0000","last_active":"2024-06-02T16:46:03.892984+0000","last_peered":"2024-06-02T16:46:03.892984+0000","last_clean":"2024-06-02T16:46:03.892984+0000","last_became_active":"2024-06-02T16:46:03.888930+0000","last_became_peered":"2024-06-02T16:46:03.888930+0000","last_unstale":"2024-06-02T16:46:03.892984+0000","last_undegraded":"2024-06-02T16:46:03.892984+0000","last_fullsized":"2024-06-02T16:46:03.892984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.867354+0000","last_change":"2024-06-02T16:46:02.893885+0000","last_active":"2024-06-02T16:46:03.867354+0000","last_peered":"2024-06-02T16:46:03.867354+0000","last_clean":"2024-06-02T16:46:03.867354+0000","last_became_active":"2024-06-02T16:46:02.893025+0000","last_became_peered":"2024-06-02T16:46:02.893025+0000","last_unstale":"2024-06-02T16:46:03.867354+0000","last_undegraded":"2024-06-02T16:46:03.867354+0000","last_fullsized":"2024-06-02T16:46:03.867354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:22.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902602+0000","last_change":"2024-06-02T16:46:03.899191+0000","last_active":"2024-06-02T16:46:03.902602+0000","last_peered":"2024-06-02T16:46:03.902602+0000","last_clean":"2024-06-02T16:46:03.902602+0000","last_became_active":"2024-06-02T16:46:03.898870+0000","last_became_peered":"2024-06-02T16:46:03.898870+0000","last_unstale":"2024-06-02T16:46:03.902602+0000","last_undegraded":"2024-06-02T16:46:03.902602+0000","last_fullsized":"2024-06-02T16:46:03.902602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883777+0000","last_change":"2024-06-02T16:46:02.891514+0000","last_active":"2024-06-02T16:46:03.883777+0000","last_peered":"2024-06-02T16:46:03.883777+0000","last_clean":"2024-06-02T16:46:03.883777+0000","last_became_active":"2024-06-02T16:46:02.890402+0000","last_became_peered":"2024-06-02T16:46:02.890402+0000","last_unstale":"2024-06-02T16:46:03.883777+0000","last_undegraded":"2024-06-02T16:46:03.883777+0000","last_fullsized":"2024-06-02T16:46:03.883777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:43.161036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900457+0000","last_change":"2024-06-02T16:46:03.894968+0000","last_active":"2024-06-02T16:46:03.900457+0000","last_peered":"2024-06-02T16:46:03.900457+0000","last_clean":"2024-06-02T16:46:03.900457+0000","last_became_active":"2024-06-02T16:46:03.894677+0000","last_became_peered":"2024-06-02T16:46:03.894677+0000","last_unstale":"2024-06-02T16:46:03.900457+0000","last_undegraded":"2024-06-02T16:46:03.900457+0000","last_fullsized":"2024-06-02T16:46:03.900457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924967+0000","last_change":"2024-06-02T16:46:02.891663+0000","last_active":"2024-06-02T16:46:03.924967+0000","last_peered":"2024-06-02T16:46:03.924967+0000","last_clean":"2024-06-02T16:46:03.924967+0000","last_became_active":"2024-06-02T16:46:02.891289+0000","last_became_peered":"2024-06-02T16:46:02.891289+0000","last_unstale":"2024-06-02T16:46:03.924967+0000","last_undegraded":"2024-06-02T16:46:03.924967+0000","last_fullsized":"2024-06-02T16:46:03.924967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:50.505687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910059+0000","last_change":"2024-06-02T16:46:03.905722+0000","last_active":"2024-06-02T16:46:03.910059+0000","last_peered":"2024-06-02T16:46:03.910059+0000","last_clean":"2024-06-02T16:46:03.910059+0000","last_became_active":"2024-06-02T16:46:03.904804+0000","last_became_peered":"2024-06-02T16:46:03.904804+0000","last_unstale":"2024-06-02T16:46:03.910059+0000","last_undegraded":"2024-06-02T16:46:03.910059+0000","last_fullsized":"2024-06-02T16:46:03.910059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.927116+0000","last_change":"2024-06-02T16:46:02.891914+0000","last_active":"2024-06-02T16:46:03.927116+0000","last_peered":"2024-06-02T16:46:03.927116+0000","last_clean":"2024-06-02T16:46:03.927116+0000","last_became_active":"2024-06-02T16:46:02.891501+0000","last_became_peered":"2024-06-02T16:46:02.891501+0000","last_unstale":"2024-06-02T16:46:03.927116+0000","last_undegraded":"2024-06-02T16:46:03.927116+0000","last_fullsized":"2024-06-02T16:46:03.927116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:02.020123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865668+0000","last_change":"2024-06-02T16:46:02.865668+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865668+0000","last_undegraded":"2024-06-02T16:46:02.865668+0000","last_fullsized":"2024-06-02T16:46:02.865668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917306+0000","last_change":"2024-06-02T16:46:02.884664+0000","last_active":"2024-06-02T16:46:03.917306+0000","last_peered":"2024-06-02T16:46:03.917306+0000","last_clean":"2024-06-02T16:46:03.917306+0000","last_became_active":"2024-06-02T16:46:02.884222+0000","last_became_peered":"2024-06-02T16:46:02.884222+0000","last_unstale":"2024-06-02T16:46:03.917306+0000","last_undegraded":"2024-06-02T16:46:03.917306+0000","last_fullsized":"2024-06-02T16:46:03.917306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899256+0000","last_change":"2024-06-02T16:46:03.894341+0000","last_active":"2024-06-02T16:46:03.899256+0000","last_peered":"2024-06-02T16:46:03.899256+0000","last_clean":"2024-06-02T16:46:03.899256+0000","last_became_active":"2024-06-02T16:46:03.894036+0000","last_became_peered":"2024-06-02T16:46:03.894036+0000","last_unstale":"2024-06-02T16:46:03.899256+0000","last_undegraded":"2024-06-02T16:46:03.899256+0000","last_fullsized":"2024-06-02T16:46:03.899256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892720+0000","last_change":"2024-06-02T16:46:02.882333+0000","last_active":"2024-06-02T16:46:02.892720+0000","last_peered":"2024-06-02T16:46:02.892720+0000","last_clean":"2024-06-02T16:46:02.892720+0000","last_became_active":"2024-06-02T16:46:02.882046+0000","last_became_peered":"2024-06-02T16:46:02.882046+0000","last_unstale":"2024-06-02T16:46:02.892720+0000","last_undegraded":"2024-06-02T16:46:02.892720+0000","last_fullsized":"2024-06-02T16:46:02.892720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:23:58.943787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867524+0000","last_change":"2024-06-02T16:46:03.905599+0000","last_active":"2024-06-02T16:46:04.867524+0000","last_peered":"2024-06-02T16:46:04.867524+0000","last_clean":"2024-06-02T16:46:04.867524+0000","last_became_active":"2024-06-02T16:46:03.905288+0000","last_became_peered":"2024-06-02T16:46:03.905288+0000","last_unstale":"2024-06-02T16:46:04.867524+0000","last_undegraded":"2024-06-02T16:46:04.867524+0000","last_fullsized":"2024-06-02T16:46:04.867524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.864228+0000","last_change":"2024-06-02T16:46:02.891190+0000","last_active":"2024-06-02T16:46:03.864228+0000","last_peered":"2024-06-02T16:46:03.864228+0000","last_clean":"2024-06-02T16:46:03.864228+0000","last_became_active":"2024-06-02T16:46:02.890783+0000","last_became_peered":"2024-06-02T16:46:02.890783+0000","last_unstale":"2024-06-02T16:46:03.864228+0000","last_undegraded":"2024-06-02T16:46:03.864228+0000","last_fullsized":"2024-06-02T16:46:03.864228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:18.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901713+0000","last_change":"2024-06-02T16:46:03.894216+0000","last_active":"2024-06-02T16:46:03.901713+0000","last_peered":"2024-06-02T16:46:03.901713+0000","last_clean":"2024-06-02T16:46:03.901713+0000","last_became_active":"2024-06-02T16:46:03.893381+0000","last_became_peered":"2024-06-02T16:46:03.893381+0000","last_unstale":"2024-06-02T16:46:03.901713+0000","last_undegraded":"2024-06-02T16:46:03.901713+0000","last_fullsized":"2024-06-02T16:46:03.901713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924708+0000","last_change":"2024-06-02T16:46:02.885194+0000","last_active":"2024-06-02T16:46:03.924708+0000","last_peered":"2024-06-02T16:46:03.924708+0000","last_clean":"2024-06-02T16:46:03.924708+0000","last_became_active":"2024-06-02T16:46:02.884879+0000","last_became_peered":"2024-06-02T16:46:02.884879+0000","last_unstale":"2024-06-02T16:46:03.924708+0000","last_undegraded":"2024-06-02T16:46:03.924708+0000","last_fullsized":"2024-06-02T16:46:03.924708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:51.294201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914109+0000","last_change":"2024-06-02T16:46:03.909612+0000","last_active":"2024-06-02T16:46:03.914109+0000","last_peered":"2024-06-02T16:46:03.914109+0000","last_clean":"2024-06-02T16:46:03.914109+0000","last_became_active":"2024-06-02T16:46:03.909152+0000","last_became_peered":"2024-06-02T16:46:03.909152+0000","last_unstale":"2024-06-02T16:46:03.914109+0000","last_undegraded":"2024-06-02T16:46:03.914109+0000","last_fullsized":"2024-06-02T16:46:03.914109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894265+0000","last_change":"2024-06-02T16:46:02.888602+0000","last_active":"2024-06-02T16:46:02.894265+0000","last_peered":"2024-06-02T16:46:02.894265+0000","last_clean":"2024-06-02T16:46:02.894265+0000","last_became_active":"2024-06-02T16:46:02.887961+0000","last_became_peered":"2024-06-02T16:46:02.887961+0000","last_unstale":"2024-06-02T16:46:02.894265+0000","last_undegraded":"2024-06-02T16:46:02.894265+0000","last_fullsized":"2024-06-02T16:46:02.894265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:05:36.795302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900369+0000","last_change":"2024-06-02T16:46:03.893517+0000","last_active":"2024-06-02T16:46:03.900369+0000","last_peered":"2024-06-02T16:46:03.900369+0000","last_clean":"2024-06-02T16:46:03.900369+0000","last_became_active":"2024-06-02T16:46:03.893145+0000","last_became_peered":"2024-06-02T16:46:03.893145+0000","last_unstale":"2024-06-02T16:46:03.900369+0000","last_undegraded":"2024-06-02T16:46:03.900369+0000","last_fullsized":"2024-06-02T16:46:03.900369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917502+0000","last_change":"2024-06-02T16:46:02.887086+0000","last_active":"2024-06-02T16:46:03.917502+0000","last_peered":"2024-06-02T16:46:03.917502+0000","last_clean":"2024-06-02T16:46:03.917502+0000","last_became_active":"2024-06-02T16:46:02.886357+0000","last_became_peered":"2024-06-02T16:46:02.886357+0000","last_unstale":"2024-06-02T16:46:03.917502+0000","last_undegraded":"2024-06-02T16:46:03.917502+0000","last_fullsized":"2024-06-02T16:46:03.917502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:20.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866864+0000","last_change":"2024-06-02T16:46:02.866864+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866864+0000","last_undegraded":"2024-06-02T16:46:02.866864+0000","last_fullsized":"2024-06-02T16:46:02.866864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.918801+0000","last_change":"2024-06-02T16:46:02.888288+0000","last_active":"2024-06-02T16:46:03.918801+0000","last_peered":"2024-06-02T16:46:03.918801+0000","last_clean":"2024-06-02T16:46:03.918801+0000","last_became_active":"2024-06-02T16:46:02.883890+0000","last_became_peered":"2024-06-02T16:46:02.883890+0000","last_unstale":"2024-06-02T16:46:03.918801+0000","last_undegraded":"2024-06-02T16:46:03.918801+0000","last_fullsized":"2024-06-02T16:46:03.918801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913731+0000","last_change":"2024-06-02T16:46:03.906699+0000","last_active":"2024-06-02T16:46:03.913731+0000","last_peered":"2024-06-02T16:46:03.913731+0000","last_clean":"2024-06-02T16:46:03.913731+0000","last_became_active":"2024-06-02T16:46:03.906415+0000","last_became_peered":"2024-06-02T16:46:03.906415+0000","last_unstale":"2024-06-02T16:46:03.913731+0000","last_undegraded":"2024-06-02T16:46:03.913731+0000","last_fullsized":"2024-06-02T16:46:03.913731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:50.238477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.887537+0000","last_change":"2024-06-02T16:46:02.886711+0000","last_active":"2024-06-02T16:46:03.887537+0000","last_peered":"2024-06-02T16:46:03.887537+0000","last_clean":"2024-06-02T16:46:03.887537+0000","last_became_active":"2024-06-02T16:46:02.886377+0000","last_became_peered":"2024-06-02T16:46:02.886377+0000","last_unstale":"2024-06-02T16:46:03.887537+0000","last_undegraded":"2024-06-02T16:46:03.887537+0000","last_fullsized":"2024-06-02T16:46:03.887537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:38.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.916407+0000","last_change":"2024-06-02T16:46:03.910758+0000","last_active":"2024-06-02T16:46:03.916407+0000","last_peered":"2024-06-02T16:46:03.916407+0000","last_clean":"2024-06-02T16:46:03.916407+0000","last_became_active":"2024-06-02T16:46:03.910435+0000","last_became_peered":"2024-06-02T16:46:03.910435+0000","last_unstale":"2024-06-02T16:46:03.916407+0000","last_undegraded":"2024-06-02T16:46:03.916407+0000","last_fullsized":"2024-06-02T16:46:03.916407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:21.623342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920139+0000","last_change":"2024-06-02T16:46:02.883493+0000","last_active":"2024-06-02T16:46:03.920139+0000","last_peered":"2024-06-02T16:46:03.920139+0000","last_clean":"2024-06-02T16:46:03.920139+0000","last_became_active":"2024-06-02T16:46:02.880100+0000","last_became_peered":"2024-06-02T16:46:02.880100+0000","last_unstale":"2024-06-02T16:46:03.920139+0000","last_undegraded":"2024-06-02T16:46:03.920139+0000","last_fullsized":"2024-06-02T16:46:03.920139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:02.344035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914028+0000","last_change":"2024-06-02T16:46:03.907359+0000","last_active":"2024-06-02T16:46:03.914028+0000","last_peered":"2024-06-02T16:46:03.914028+0000","last_clean":"2024-06-02T16:46:03.914028+0000","last_became_active":"2024-06-02T16:46:03.906700+0000","last_became_peered":"2024-06-02T16:46:03.906700+0000","last_unstale":"2024-06-02T16:46:03.914028+0000","last_undegraded":"2024-06-02T16:46:03.914028+0000","last_fullsized":"2024-06-02T16:46:03.914028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:39.424200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.877454+0000","last_change":"2024-06-02T16:46:02.895540+0000","last_active":"2024-06-02T16:46:03.877454+0000","last_peered":"2024-06-02T16:46:03.877454+0000","last_clean":"2024-06-02T16:46:03.877454+0000","last_became_active":"2024-06-02T16:46:02.895129+0000","last_became_peered":"2024-06-02T16:46:02.895129+0000","last_unstale":"2024-06-02T16:46:03.877454+0000","last_undegraded":"2024-06-02T16:46:03.877454+0000","last_fullsized":"2024-06-02T16:46:03.877454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904670+0000","last_change":"2024-06-02T16:46:03.895347+0000","last_active":"2024-06-02T16:46:03.904670+0000","last_peered":"2024-06-02T16:46:03.904670+0000","last_clean":"2024-06-02T16:46:03.904670+0000","last_became_active":"2024-06-02T16:46:03.894742+0000","last_became_peered":"2024-06-02T16:46:03.894742+0000","last_unstale":"2024-06-02T16:46:03.904670+0000","last_undegraded":"2024-06-02T16:46:03.904670+0000","last_fullsized":"2024-06-02T16:46:03.904670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:16.294203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883547+0000","last_change":"2024-06-02T16:46:02.882260+0000","last_active":"2024-06-02T16:46:03.883547+0000","last_peered":"2024-06-02T16:46:03.883547+0000","last_clean":"2024-06-02T16:46:03.883547+0000","last_became_active":"2024-06-02T16:46:02.875091+0000","last_became_peered":"2024-06-02T16:46:02.875091+0000","last_unstale":"2024-06-02T16:46:03.883547+0000","last_undegraded":"2024-06-02T16:46:03.883547+0000","last_fullsized":"2024-06-02T16:46:03.883547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:02.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867216+0000","last_change":"2024-06-02T16:46:03.899743+0000","last_active":"2024-06-02T16:46:04.867216+0000","last_peered":"2024-06-02T16:46:04.867216+0000","last_clean":"2024-06-02T16:46:04.867216+0000","last_became_active":"2024-06-02T16:46:03.899449+0000","last_became_peered":"2024-06-02T16:46:03.899449+0000","last_unstale":"2024-06-02T16:46:04.867216+0000","last_undegraded":"2024-06-02T16:46:04.867216+0000","last_fullsized":"2024-06-02T16:46:04.867216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.874810+0000","last_change":"2024-06-02T16:46:02.890214+0000","last_active":"2024-06-02T16:46:03.874810+0000","last_peered":"2024-06-02T16:46:03.874810+0000","last_clean":"2024-06-02T16:46:03.874810+0000","last_became_active":"2024-06-02T16:46:02.889874+0000","last_became_peered":"2024-06-02T16:46:02.889874+0000","last_unstale":"2024-06-02T16:46:03.874810+0000","last_undegraded":"2024-06-02T16:46:03.874810+0000","last_fullsized":"2024-06-02T16:46:03.874810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:01.204300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906101+0000","last_change":"2024-06-02T16:46:03.901073+0000","last_active":"2024-06-02T16:46:03.906101+0000","last_peered":"2024-06-02T16:46:03.906101+0000","last_clean":"2024-06-02T16:46:03.906101+0000","last_became_active":"2024-06-02T16:46:03.890045+0000","last_became_peered":"2024-06-02T16:46:03.890045+0000","last_unstale":"2024-06-02T16:46:03.906101+0000","last_undegraded":"2024-06-02T16:46:03.906101+0000","last_fullsized":"2024-06-02T16:46:03.906101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:42.549209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.888570+0000","last_change":"2024-06-02T16:46:02.883504+0000","last_active":"2024-06-02T16:46:02.888570+0000","last_peered":"2024-06-02T16:46:02.888570+0000","last_clean":"2024-06-02T16:46:02.888570+0000","last_became_active":"2024-06-02T16:46:02.883177+0000","last_became_peered":"2024-06-02T16:46:02.883177+0000","last_unstale":"2024-06-02T16:46:02.888570+0000","last_undegraded":"2024-06-02T16:46:02.888570+0000","last_fullsized":"2024-06-02T16:46:02.888570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:42:21.241624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907648+0000","last_change":"2024-06-02T16:46:03.903394+0000","last_active":"2024-06-02T16:46:03.907648+0000","last_peered":"2024-06-02T16:46:03.907648+0000","last_clean":"2024-06-02T16:46:03.907648+0000","last_became_active":"2024-06-02T16:46:03.902987+0000","last_became_peered":"2024-06-02T16:46:03.902987+0000","last_unstale":"2024-06-02T16:46:03.907648+0000","last_undegraded":"2024-06-02T16:46:03.907648+0000","last_fullsized":"2024-06-02T16:46:03.907648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883295+0000","last_change":"2024-06-02T16:46:02.890382+0000","last_active":"2024-06-02T16:46:03.883295+0000","last_peered":"2024-06-02T16:46:03.883295+0000","last_clean":"2024-06-02T16:46:03.883295+0000","last_became_active":"2024-06-02T16:46:02.890074+0000","last_became_peered":"2024-06-02T16:46:02.890074+0000","last_unstale":"2024-06-02T16:46:03.883295+0000","last_undegraded":"2024-06-02T16:46:03.883295+0000","last_fullsized":"2024-06-02T16:46:03.883295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906250+0000","last_change":"2024-06-02T16:46:03.899253+0000","last_active":"2024-06-02T16:46:03.906250+0000","last_peered":"2024-06-02T16:46:03.906250+0000","last_clean":"2024-06-02T16:46:03.906250+0000","last_became_active":"2024-06-02T16:46:03.898932+0000","last_became_peered":"2024-06-02T16:46:03.898932+0000","last_unstale":"2024-06-02T16:46:03.906250+0000","last_undegraded":"2024-06-02T16:46:03.906250+0000","last_fullsized":"2024-06-02T16:46:03.906250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892087+0000","last_change":"2024-06-02T16:46:02.885176+0000","last_active":"2024-06-02T16:46:02.892087+0000","last_peered":"2024-06-02T16:46:02.892087+0000","last_clean":"2024-06-02T16:46:02.892087+0000","last_became_active":"2024-06-02T16:46:02.884863+0000","last_became_peered":"2024-06-02T16:46:02.884863+0000","last_unstale":"2024-06-02T16:46:02.892087+0000","last_undegraded":"2024-06-02T16:46:02.892087+0000","last_fullsized":"2024-06-02T16:46:02.892087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:34.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901094+0000","last_change":"2024-06-02T16:46:03.896244+0000","last_active":"2024-06-02T16:46:03.901094+0000","last_peered":"2024-06-02T16:46:03.901094+0000","last_clean":"2024-06-02T16:46:03.901094+0000","last_became_active":"2024-06-02T16:46:03.895899+0000","last_became_peered":"2024-06-02T16:46:03.895899+0000","last_unstale":"2024-06-02T16:46:03.901094+0000","last_undegraded":"2024-06-02T16:46:03.901094+0000","last_fullsized":"2024-06-02T16:46:03.901094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.886144+0000","last_change":"2024-06-02T16:46:02.882808+0000","last_active":"2024-06-02T16:46:03.886144+0000","last_peered":"2024-06-02T16:46:03.886144+0000","last_clean":"2024-06-02T16:46:03.886144+0000","last_became_active":"2024-06-02T16:46:02.882515+0000","last_became_peered":"2024-06-02T16:46:02.882515+0000","last_unstale":"2024-06-02T16:46:03.886144+0000","last_undegraded":"2024-06-02T16:46:03.886144+0000","last_fullsized":"2024-06-02T16:46:03.886144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:05.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908603+0000","last_change":"2024-06-02T16:46:03.902214+0000","last_active":"2024-06-02T16:46:03.908603+0000","last_peered":"2024-06-02T16:46:03.908603+0000","last_clean":"2024-06-02T16:46:03.908603+0000","last_became_active":"2024-06-02T16:46:03.901873+0000","last_became_peered":"2024-06-02T16:46:03.901873+0000","last_unstale":"2024-06-02T16:46:03.908603+0000","last_undegraded":"2024-06-02T16:46:03.908603+0000","last_fullsized":"2024-06-02T16:46:03.908603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894545+0000","last_change":"2024-06-02T16:46:02.890723+0000","last_active":"2024-06-02T16:46:02.894545+0000","last_peered":"2024-06-02T16:46:02.894545+0000","last_clean":"2024-06-02T16:46:02.894545+0000","last_became_active":"2024-06-02T16:46:02.889856+0000","last_became_peered":"2024-06-02T16:46:02.889856+0000","last_unstale":"2024-06-02T16:46:02.894545+0000","last_undegraded":"2024-06-02T16:46:02.894545+0000","last_fullsized":"2024-06-02T16:46:02.894545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:31.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904734+0000","last_change":"2024-06-02T16:46:03.902323+0000","last_active":"2024-06-02T16:46:03.904734+0000","last_peered":"2024-06-02T16:46:03.904734+0000","last_clean":"2024-06-02T16:46:03.904734+0000","last_became_active":"2024-06-02T16:46:03.901882+0000","last_became_peered":"2024-06-02T16:46:03.901882+0000","last_unstale":"2024-06-02T16:46:03.904734+0000","last_undegraded":"2024-06-02T16:46:03.904734+0000","last_fullsized":"2024-06-02T16:46:03.904734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.885236+0000","last_change":"2024-06-02T16:46:02.884578+0000","last_active":"2024-06-02T16:46:03.885236+0000","last_peered":"2024-06-02T16:46:03.885236+0000","last_clean":"2024-06-02T16:46:03.885236+0000","last_became_active":"2024-06-02T16:46:02.882715+0000","last_became_peered":"2024-06-02T16:46:02.882715+0000","last_unstale":"2024-06-02T16:46:03.885236+0000","last_undegraded":"2024-06-02T16:46:03.885236+0000","last_fullsized":"2024-06-02T16:46:03.885236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:49.232011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911131+0000","last_change":"2024-06-02T16:46:03.892141+0000","last_active":"2024-06-02T16:46:03.911131+0000","last_peered":"2024-06-02T16:46:03.911131+0000","last_clean":"2024-06-02T16:46:03.911131+0000","last_became_active":"2024-06-02T16:46:03.891420+0000","last_became_peered":"2024-06-02T16:46:03.891420+0000","last_unstale":"2024-06-02T16:46:03.911131+0000","last_undegraded":"2024-06-02T16:46:03.911131+0000","last_fullsized":"2024-06-02T16:46:03.911131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863684+0000","last_change":"2024-06-02T16:46:02.892674+0000","last_active":"2024-06-02T16:46:03.863684+0000","last_peered":"2024-06-02T16:46:03.863684+0000","last_clean":"2024-06-02T16:46:03.863684+0000","last_became_active":"2024-06-02T16:46:02.890747+0000","last_became_peered":"2024-06-02T16:46:02.890747+0000","last_unstale":"2024-06-02T16:46:03.863684+0000","last_undegraded":"2024-06-02T16:46:03.863684+0000","last_fullsized":"2024-06-02T16:46:03.863684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:10.440456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868386+0000","last_change":"2024-06-02T16:46:03.916186+0000","last_active":"2024-06-02T16:46:04.868386+0000","last_peered":"2024-06-02T16:46:04.868386+0000","last_clean":"2024-06-02T16:46:04.868386+0000","last_became_active":"2024-06-02T16:46:03.915623+0000","last_became_peered":"2024-06-02T16:46:03.915623+0000","last_unstale":"2024-06-02T16:46:04.868386+0000","last_undegraded":"2024-06-02T16:46:04.868386+0000","last_fullsized":"2024-06-02T16:46:04.868386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.876609+0000","last_change":"2024-06-02T16:46:02.892101+0000","last_active":"2024-06-02T16:46:03.876609+0000","last_peered":"2024-06-02T16:46:03.876609+0000","last_clean":"2024-06-02T16:46:03.876609+0000","last_became_active":"2024-06-02T16:46:02.891745+0000","last_became_peered":"2024-06-02T16:46:02.891745+0000","last_unstale":"2024-06-02T16:46:03.876609+0000","last_undegraded":"2024-06-02T16:46:03.876609+0000","last_fullsized":"2024-06-02T16:46:03.876609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867868+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:46:04.867868+0000","last_peered":"2024-06-02T16:46:04.867868+0000","last_clean":"2024-06-02T16:46:04.867868+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:46:04.867868+0000","last_undegraded":"2024-06-02T16:46:04.867868+0000","last_fullsized":"2024-06-02T16:46:04.867868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":733877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":143523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":727012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":130377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:46:08.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:46:08.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.633+0000 7f356f200640 1 Processor -- start 2024-06-02T16:46:08.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.633+0000 7f356f200640 1 -- start start 2024-06-02T16:46:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.634+0000 7f356f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35680b06a0 0x7f356815c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.634+0000 7f356f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35680b0a80 con 0x7f35680d1580 2024-06-02T16:46:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f356f200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356815d020 con 0x7f35680b5c60 2024-06-02T16:46:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f356f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f35681600e0 con 0x7f35680b06a0 2024-06-02T16:46:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f356d200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f35680d1580 0x7f35680b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48072/0 (socket says 172.21.15.52:48072) 2024-06-02T16:46:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f356d200640 1 -- 172.21.15.52:0/4148708710 learned_addr learned my addr 172.21.15.52:0/4148708710 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f3567e00640 1 --2- 172.21.15.52:0/4148708710 >> v2:172.21.15.114:3300/0 conn(0x7f35680b06a0 0x7f356815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532693992 0 0) 0x7f35680b0a80 con 0x7f35680d1580 2024-06-02T16:46:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.635+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f354c003520 con 0x7f35680d1580 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 683088067 0 0) 0x7f354c003520 con 0x7f35680d1580 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 >> v2:172.21.15.114:3300/0 conn(0x7f35680b06a0 msgr2=0x7f356815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 --2- 172.21.15.52:0/4148708710 >> v2:172.21.15.114:3300/0 conn(0x7f35680b06a0 0x7f356815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 >> v1:172.21.15.114:6789/0 conn(0x7f35680b5c60 legacy=0x7f3568160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356815d300 con 0x7f35680d1580 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f3560001a70 con 0x7f35680d1580 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 >> v1:172.21.15.52:6789/0 conn(0x7f35680d1580 legacy=0x7f35680b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c003aa0 0x7f354c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f354c004800 0x7f354c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 0x7f354c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35681600e0 con 0x7f354c005210 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f354c00c160 con 0x7f354c004800 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f354c00c360 con 0x7f354c003aa0 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.636+0000 7f356d200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 0x7f354c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f355fe00640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f354c004800 0x7f354c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f3567e00640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c003aa0 0x7f354c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f356d200640 1 -- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c003aa0 msgr2=0x7f354c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f356d200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c003aa0 0x7f354c003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f356d200640 1 -- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f354c004800 msgr2=0x7f354c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f356d200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f354c004800 0x7f354c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.637+0000 7f356d200640 1 -- 172.21.15.52:0/4148708710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c003520 con 0x7f354c005210 2024-06-02T16:46:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.638+0000 7f356d200640 1 -- 172.21.15.52:0/4148708710 reap_dead start 2024-06-02T16:46:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.638+0000 7f356d200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 0x7f354c00b9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f356000a7c0 tx=0x7f354c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a03ffac70fe7fe2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.638+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356000a410 con 0x7f354c005210 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.638+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356002f070 con 0x7f354c005210 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.638+0000 7f3567400640 1 -- 172.21.15.52:0/4148708710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356002bb30 con 0x7f354c005210 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 -- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 msgr2=0x7f354c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 0x7f354c00b9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f356000a7c0 tx=0x7f354c005830 comp rx=0 tx=0).stop 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 -- 172.21.15.52:0/4148708710 shutdown_connections 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 --2- 172.21.15.52:0/4148708710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f354c005210 0x7f354c00b9c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 -- 172.21.15.52:0/4148708710 >> 172.21.15.52:0/4148708710 conn(0x7f356806c7a0 msgr2=0x7f356806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 -- 172.21.15.52:0/4148708710 shutdown_connections 2024-06-02T16:46:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.639+0000 7f356f200640 1 -- 172.21.15.52:0/4148708710 wait complete. 2024-06-02T16:46:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.641+0000 7f356f200640 1 Processor -- start 2024-06-02T16:46:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.641+0000 7f356f200640 1 -- start start 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c005210 0x7f35681527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35680af860 0x7f356814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35680d19e0 con 0x7f35680af3e0 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f356815fd70 con 0x7f35680af860 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f356f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f35680d1b60 con 0x7f354c005210 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.642+0000 7f355fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36442/0 (socket says 172.21.15.52:36442) 2024-06-02T16:46:08.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 -- 172.21.15.52:0/908826933 learned_addr learned my addr 172.21.15.52:0/908826933 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f3567e00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c005210 0x7f35681527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f356d200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35680af860 0x7f356814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 -- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c005210 msgr2=0x7f35681527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c005210 0x7f35681527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 -- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35680af860 msgr2=0x7f356814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35680af860 0x7f356814e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 -- 172.21.15.52:0/908826933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35681f4ba0 con 0x7f35680af3e0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.643+0000 7f355fe00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f355000e440 tx=0x7f355000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.644+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35500052e0 con 0x7f35680af3e0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.644+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550018070 con 0x7f35680af3e0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.644+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550003810 con 0x7f35680af3e0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.644+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35681f4e80 con 0x7f35680af3e0 2024-06-02T16:46:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.644+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35681f5440 con 0x7f35680af3e0 2024-06-02T16:46:08.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.645+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3568069520 con 0x7f35680af3e0 2024-06-02T16:46:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.646+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35500039b0 con 0x7f35680af3e0 2024-06-02T16:46:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.647+0000 7f3564c00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 0x7f3544078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.648+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3550097310 con 0x7f35680af3e0 2024-06-02T16:46:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.648+0000 7f3567e00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 0x7f3544078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.649+0000 7f3567e00640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 0x7f3544078730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3558009910 tx=0x7f3558008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.652+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3550060bd0 con 0x7f35680af3e0 2024-06-02T16:46:08.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.856+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3568069c30 con 0x7f3544076270 2024-06-02T16:46:08.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.874+0000 7f3564c00640 1 -- 172.21.15.52:0/908826933 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251224 (secure 0 0 0) 0x7f3568069c30 con 0x7f3544076270 2024-06-02T16:46:08.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:46:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 msgr2=0x7f3544078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 0x7f3544078730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3558009910 tx=0x7f3558008040 comp rx=0 tx=0).stop 2024-06-02T16:46:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 msgr2=0x7f356814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f355000e440 tx=0x7f355000e900 comp rx=0 tx=0).stop 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 shutdown_connections 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3544076270 0x7f3544078730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35680af860 0x7f356814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35680af3e0 0x7f356814e0e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 --2- 172.21.15.52:0/908826933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f354c005210 0x7f35681527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 >> 172.21.15.52:0/908826933 conn(0x7f356806c7a0 msgr2=0x7f35680b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 shutdown_connections 2024-06-02T16:46:08.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:08.880+0000 7f356f200640 1 -- 172.21.15.52:0/908826933 wait complete. 2024-06-02T16:46:08.897 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-06-02T16:46:08.012009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236848,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737872,"statfs":{"total":773094113280,"available":772851580928,"internally_reserved":0,"allocated":4136960,"data_stored":2296203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002273"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902594+0000","last_change":"2024-06-02T16:46:03.899601+0000","last_active":"2024-06-02T16:46:03.902594+0000","last_peered":"2024-06-02T16:46:03.902594+0000","last_clean":"2024-06-02T16:46:03.902594+0000","last_became_active":"2024-06-02T16:46:03.899249+0000","last_became_peered":"2024-06-02T16:46:03.899249+0000","last_unstale":"2024-06-02T16:46:03.902594+0000","last_undegraded":"2024-06-02T16:46:03.902594+0000","last_fullsized":"2024-06-02T16:46:03.902594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.896339+0000","last_change":"2024-06-02T16:46:03.893509+0000","last_active":"2024-06-02T16:46:03.896339+0000","last_peered":"2024-06-02T16:46:03.896339+0000","last_clean":"2024-06-02T16:46:03.896339+0000","last_became_active":"2024-06-02T16:46:03.893090+0000","last_became_peered":"2024-06-02T16:46:03.893090+0000","last_unstale":"2024-06-02T16:46:03.896339+0000","last_undegraded":"2024-06-02T16:46:03.896339+0000","last_fullsized":"2024-06-02T16:46:03.896339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910086+0000","last_change":"2024-06-02T16:46:03.906471+0000","last_active":"2024-06-02T16:46:03.910086+0000","last_peered":"2024-06-02T16:46:03.910086+0000","last_clean":"2024-06-02T16:46:03.910086+0000","last_became_active":"2024-06-02T16:46:03.904044+0000","last_became_peered":"2024-06-02T16:46:03.904044+0000","last_unstale":"2024-06-02T16:46:03.910086+0000","last_undegraded":"2024-06-02T16:46:03.910086+0000","last_fullsized":"2024-06-02T16:46:03.910086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.870067+0000","last_change":"2024-06-02T16:46:02.870067+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.870067+0000","last_undegraded":"2024-06-02T16:46:02.870067+0000","last_fullsized":"2024-06-02T16:46:02.870067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891945+0000","last_change":"2024-06-02T16:46:03.886231+0000","last_active":"2024-06-02T16:46:03.891945+0000","last_peered":"2024-06-02T16:46:03.891945+0000","last_clean":"2024-06-02T16:46:03.891945+0000","last_became_active":"2024-06-02T16:46:03.884590+0000","last_became_peered":"2024-06-02T16:46:03.884590+0000","last_unstale":"2024-06-02T16:46:03.891945+0000","last_undegraded":"2024-06-02T16:46:03.891945+0000","last_fullsized":"2024-06-02T16:46:03.891945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:22.800808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.893794+0000","last_change":"2024-06-02T16:46:03.890058+0000","last_active":"2024-06-02T16:46:03.893794+0000","last_peered":"2024-06-02T16:46:03.893794+0000","last_clean":"2024-06-02T16:46:03.893794+0000","last_became_active":"2024-06-02T16:46:03.889655+0000","last_became_peered":"2024-06-02T16:46:03.889655+0000","last_unstale":"2024-06-02T16:46:03.893794+0000","last_undegraded":"2024-06-02T16:46:03.893794+0000","last_fullsized":"2024-06-02T16:46:03.893794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867638+0000","last_change":"2024-06-02T16:46:03.900580+0000","last_active":"2024-06-02T16:46:04.867638+0000","last_peered":"2024-06-02T16:46:04.867638+0000","last_clean":"2024-06-02T16:46:04.867638+0000","last_became_active":"2024-06-02T16:46:03.899640+0000","last_became_peered":"2024-06-02T16:46:03.899640+0000","last_unstale":"2024-06-02T16:46:04.867638+0000","last_undegraded":"2024-06-02T16:46:04.867638+0000","last_fullsized":"2024-06-02T16:46:04.867638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867223+0000","last_change":"2024-06-02T16:46:03.908391+0000","last_active":"2024-06-02T16:46:04.867223+0000","last_peered":"2024-06-02T16:46:04.867223+0000","last_clean":"2024-06-02T16:46:04.867223+0000","last_became_active":"2024-06-02T16:46:03.907935+0000","last_became_peered":"2024-06-02T16:46:03.907935+0000","last_unstale":"2024-06-02T16:46:04.867223+0000","last_undegraded":"2024-06-02T16:46:04.867223+0000","last_fullsized":"2024-06-02T16:46:04.867223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913926+0000","last_change":"2024-06-02T16:46:03.909678+0000","last_active":"2024-06-02T16:46:03.913926+0000","last_peered":"2024-06-02T16:46:03.913926+0000","last_clean":"2024-06-02T16:46:03.913926+0000","last_became_active":"2024-06-02T16:46:03.905007+0000","last_became_peered":"2024-06-02T16:46:03.905007+0000","last_unstale":"2024-06-02T16:46:03.913926+0000","last_undegraded":"2024-06-02T16:46:03.913926+0000","last_fullsized":"2024-06-02T16:46:03.913926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865396+0000","last_change":"2024-06-02T16:46:02.865396+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865396+0000","last_undegraded":"2024-06-02T16:46:02.865396+0000","last_fullsized":"2024-06-02T16:46:02.865396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868493+0000","last_change":"2024-06-02T16:46:03.897768+0000","last_active":"2024-06-02T16:46:04.868493+0000","last_peered":"2024-06-02T16:46:04.868493+0000","last_clean":"2024-06-02T16:46:04.868493+0000","last_became_active":"2024-06-02T16:46:03.897473+0000","last_became_peered":"2024-06-02T16:46:03.897473+0000","last_unstale":"2024-06-02T16:46:04.868493+0000","last_undegraded":"2024-06-02T16:46:04.868493+0000","last_fullsized":"2024-06-02T16:46:04.868493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900481+0000","last_change":"2024-06-02T16:46:03.893747+0000","last_active":"2024-06-02T16:46:03.900481+0000","last_peered":"2024-06-02T16:46:03.900481+0000","last_clean":"2024-06-02T16:46:03.900481+0000","last_became_active":"2024-06-02T16:46:03.893457+0000","last_became_peered":"2024-06-02T16:46:03.893457+0000","last_unstale":"2024-06-02T16:46:03.900481+0000","last_undegraded":"2024-06-02T16:46:03.900481+0000","last_fullsized":"2024-06-02T16:46:03.900481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906034+0000","last_change":"2024-06-02T16:46:03.904170+0000","last_active":"2024-06-02T16:46:03.906034+0000","last_peered":"2024-06-02T16:46:03.906034+0000","last_clean":"2024-06-02T16:46:03.906034+0000","last_became_active":"2024-06-02T16:46:03.903910+0000","last_became_peered":"2024-06-02T16:46:03.903910+0000","last_unstale":"2024-06-02T16:46:03.906034+0000","last_undegraded":"2024-06-02T16:46:03.906034+0000","last_fullsized":"2024-06-02T16:46:03.906034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:03.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.889930+0000","last_change":"2024-06-02T16:46:03.881096+0000","last_active":"2024-06-02T16:46:03.889930+0000","last_peered":"2024-06-02T16:46:03.889930+0000","last_clean":"2024-06-02T16:46:03.889930+0000","last_became_active":"2024-06-02T16:46:03.880588+0000","last_became_peered":"2024-06-02T16:46:03.880588+0000","last_unstale":"2024-06-02T16:46:03.889930+0000","last_undegraded":"2024-06-02T16:46:03.889930+0000","last_fullsized":"2024-06-02T16:46:03.889930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903548+0000","last_change":"2024-06-02T16:46:03.898043+0000","last_active":"2024-06-02T16:46:03.903548+0000","last_peered":"2024-06-02T16:46:03.903548+0000","last_clean":"2024-06-02T16:46:03.903548+0000","last_became_active":"2024-06-02T16:46:03.897729+0000","last_became_peered":"2024-06-02T16:46:03.897729+0000","last_unstale":"2024-06-02T16:46:03.903548+0000","last_undegraded":"2024-06-02T16:46:03.903548+0000","last_fullsized":"2024-06-02T16:46:03.903548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:19.601796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867980+0000","last_change":"2024-06-02T16:46:03.901353+0000","last_active":"2024-06-02T16:46:04.867980+0000","last_peered":"2024-06-02T16:46:04.867980+0000","last_clean":"2024-06-02T16:46:04.867980+0000","last_became_active":"2024-06-02T16:46:03.901086+0000","last_became_peered":"2024-06-02T16:46:03.901086+0000","last_unstale":"2024-06-02T16:46:04.867980+0000","last_undegraded":"2024-06-02T16:46:04.867980+0000","last_fullsized":"2024-06-02T16:46:04.867980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868905+0000","last_change":"2024-06-02T16:46:03.903426+0000","last_active":"2024-06-02T16:46:04.868905+0000","last_peered":"2024-06-02T16:46:04.868905+0000","last_clean":"2024-06-02T16:46:04.868905+0000","last_became_active":"2024-06-02T16:46:03.903109+0000","last_became_peered":"2024-06-02T16:46:03.903109+0000","last_unstale":"2024-06-02T16:46:04.868905+0000","last_undegraded":"2024-06-02T16:46:04.868905+0000","last_fullsized":"2024-06-02T16:46:04.868905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.912003+0000","last_change":"2024-06-02T16:46:03.908555+0000","last_active":"2024-06-02T16:46:03.912003+0000","last_peered":"2024-06-02T16:46:03.912003+0000","last_clean":"2024-06-02T16:46:03.912003+0000","last_became_active":"2024-06-02T16:46:03.908205+0000","last_became_peered":"2024-06-02T16:46:03.908205+0000","last_unstale":"2024-06-02T16:46:03.912003+0000","last_undegraded":"2024-06-02T16:46:03.912003+0000","last_fullsized":"2024-06-02T16:46:03.912003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903376+0000","last_change":"2024-06-02T16:46:03.897750+0000","last_active":"2024-06-02T16:46:03.903376+0000","last_peered":"2024-06-02T16:46:03.903376+0000","last_clean":"2024-06-02T16:46:03.903376+0000","last_became_active":"2024-06-02T16:46:03.897419+0000","last_became_peered":"2024-06-02T16:46:03.897419+0000","last_unstale":"2024-06-02T16:46:03.903376+0000","last_undegraded":"2024-06-02T16:46:03.903376+0000","last_fullsized":"2024-06-02T16:46:03.903376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907778+0000","last_change":"2024-06-02T16:46:03.899325+0000","last_active":"2024-06-02T16:46:03.907778+0000","last_peered":"2024-06-02T16:46:03.907778+0000","last_clean":"2024-06-02T16:46:03.907778+0000","last_became_active":"2024-06-02T16:46:03.899055+0000","last_became_peered":"2024-06-02T16:46:03.899055+0000","last_unstale":"2024-06-02T16:46:03.907778+0000","last_undegraded":"2024-06-02T16:46:03.907778+0000","last_fullsized":"2024-06-02T16:46:03.907778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:17.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914066+0000","last_change":"2024-06-02T16:46:03.906474+0000","last_active":"2024-06-02T16:46:03.914066+0000","last_peered":"2024-06-02T16:46:03.914066+0000","last_clean":"2024-06-02T16:46:03.914066+0000","last_became_active":"2024-06-02T16:46:03.906146+0000","last_became_peered":"2024-06-02T16:46:03.906146+0000","last_unstale":"2024-06-02T16:46:03.914066+0000","last_undegraded":"2024-06-02T16:46:03.914066+0000","last_fullsized":"2024-06-02T16:46:03.914066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914317+0000","last_change":"2024-06-02T16:46:03.910134+0000","last_active":"2024-06-02T16:46:03.914317+0000","last_peered":"2024-06-02T16:46:03.914317+0000","last_clean":"2024-06-02T16:46:03.914317+0000","last_became_active":"2024-06-02T16:46:03.909544+0000","last_became_peered":"2024-06-02T16:46:03.909544+0000","last_unstale":"2024-06-02T16:46:03.914317+0000","last_undegraded":"2024-06-02T16:46:03.914317+0000","last_fullsized":"2024-06-02T16:46:03.914317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908187+0000","last_change":"2024-06-02T16:46:03.895902+0000","last_active":"2024-06-02T16:46:03.908187+0000","last_peered":"2024-06-02T16:46:03.908187+0000","last_clean":"2024-06-02T16:46:03.908187+0000","last_became_active":"2024-06-02T16:46:03.895533+0000","last_became_peered":"2024-06-02T16:46:03.895533+0000","last_unstale":"2024-06-02T16:46:03.908187+0000","last_undegraded":"2024-06-02T16:46:03.908187+0000","last_fullsized":"2024-06-02T16:46:03.908187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891820+0000","last_change":"2024-06-02T16:46:03.889132+0000","last_active":"2024-06-02T16:46:03.891820+0000","last_peered":"2024-06-02T16:46:03.891820+0000","last_clean":"2024-06-02T16:46:03.891820+0000","last_became_active":"2024-06-02T16:46:03.888335+0000","last_became_peered":"2024-06-02T16:46:03.888335+0000","last_unstale":"2024-06-02T16:46:03.891820+0000","last_undegraded":"2024-06-02T16:46:03.891820+0000","last_fullsized":"2024-06-02T16:46:03.891820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899970+0000","last_change":"2024-06-02T16:46:03.894665+0000","last_active":"2024-06-02T16:46:03.899970+0000","last_peered":"2024-06-02T16:46:03.899970+0000","last_clean":"2024-06-02T16:46:03.899970+0000","last_became_active":"2024-06-02T16:46:03.894317+0000","last_became_peered":"2024-06-02T16:46:03.894317+0000","last_unstale":"2024-06-02T16:46:03.899970+0000","last_undegraded":"2024-06-02T16:46:03.899970+0000","last_fullsized":"2024-06-02T16:46:03.899970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866006+0000","last_change":"2024-06-02T16:46:02.866006+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866006+0000","last_undegraded":"2024-06-02T16:46:02.866006+0000","last_fullsized":"2024-06-02T16:46:02.866006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902707+0000","last_change":"2024-06-02T16:46:03.896638+0000","last_active":"2024-06-02T16:46:03.902707+0000","last_peered":"2024-06-02T16:46:03.902707+0000","last_clean":"2024-06-02T16:46:03.902707+0000","last_became_active":"2024-06-02T16:46:03.896360+0000","last_became_peered":"2024-06-02T16:46:03.896360+0000","last_unstale":"2024-06-02T16:46:03.902707+0000","last_undegraded":"2024-06-02T16:46:03.902707+0000","last_fullsized":"2024-06-02T16:46:03.902707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914044+0000","last_change":"2024-06-02T16:46:03.904596+0000","last_active":"2024-06-02T16:46:03.914044+0000","last_peered":"2024-06-02T16:46:03.914044+0000","last_clean":"2024-06-02T16:46:03.914044+0000","last_became_active":"2024-06-02T16:46:03.901408+0000","last_became_peered":"2024-06-02T16:46:03.901408+0000","last_unstale":"2024-06-02T16:46:03.914044+0000","last_undegraded":"2024-06-02T16:46:03.914044+0000","last_fullsized":"2024-06-02T16:46:03.914044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868136+0000","last_change":"2024-06-02T16:46:03.903410+0000","last_active":"2024-06-02T16:46:04.868136+0000","last_peered":"2024-06-02T16:46:04.868136+0000","last_clean":"2024-06-02T16:46:04.868136+0000","last_became_active":"2024-06-02T16:46:03.903107+0000","last_became_peered":"2024-06-02T16:46:03.903107+0000","last_unstale":"2024-06-02T16:46:04.868136+0000","last_undegraded":"2024-06-02T16:46:04.868136+0000","last_fullsized":"2024-06-02T16:46:04.868136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901736+0000","last_change":"2024-06-02T16:46:03.895116+0000","last_active":"2024-06-02T16:46:03.901736+0000","last_peered":"2024-06-02T16:46:03.901736+0000","last_clean":"2024-06-02T16:46:03.901736+0000","last_became_active":"2024-06-02T16:46:03.894743+0000","last_became_peered":"2024-06-02T16:46:03.894743+0000","last_unstale":"2024-06-02T16:46:03.901736+0000","last_undegraded":"2024-06-02T16:46:03.901736+0000","last_fullsized":"2024-06-02T16:46:03.901736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867072+0000","last_change":"2024-06-02T16:46:03.914694+0000","last_active":"2024-06-02T16:46:04.867072+0000","last_peered":"2024-06-02T16:46:04.867072+0000","last_clean":"2024-06-02T16:46:04.867072+0000","last_became_active":"2024-06-02T16:46:03.914442+0000","last_became_peered":"2024-06-02T16:46:03.914442+0000","last_unstale":"2024-06-02T16:46:04.867072+0000","last_undegraded":"2024-06-02T16:46:04.867072+0000","last_fullsized":"2024-06-02T16:46:04.867072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.905385+0000","last_change":"2024-06-02T16:46:03.896326+0000","last_active":"2024-06-02T16:46:03.905385+0000","last_peered":"2024-06-02T16:46:03.905385+0000","last_clean":"2024-06-02T16:46:03.905385+0000","last_became_active":"2024-06-02T16:46:03.896032+0000","last_became_peered":"2024-06-02T16:46:03.896032+0000","last_unstale":"2024-06-02T16:46:03.905385+0000","last_undegraded":"2024-06-02T16:46:03.905385+0000","last_fullsized":"2024-06-02T16:46:03.905385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917653+0000","last_change":"2024-06-02T16:46:02.888949+0000","last_active":"2024-06-02T16:46:03.917653+0000","last_peered":"2024-06-02T16:46:03.917653+0000","last_clean":"2024-06-02T16:46:03.917653+0000","last_became_active":"2024-06-02T16:46:02.888543+0000","last_became_peered":"2024-06-02T16:46:02.888543+0000","last_unstale":"2024-06-02T16:46:03.917653+0000","last_undegraded":"2024-06-02T16:46:03.917653+0000","last_fullsized":"2024-06-02T16:46:03.917653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902214+0000","last_change":"2024-06-02T16:46:03.897726+0000","last_active":"2024-06-02T16:46:03.902214+0000","last_peered":"2024-06-02T16:46:03.902214+0000","last_clean":"2024-06-02T16:46:03.902214+0000","last_became_active":"2024-06-02T16:46:03.897418+0000","last_became_peered":"2024-06-02T16:46:03.897418+0000","last_unstale":"2024-06-02T16:46:03.902214+0000","last_undegraded":"2024-06-02T16:46:03.902214+0000","last_fullsized":"2024-06-02T16:46:03.902214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919454+0000","last_change":"2024-06-02T16:46:02.893537+0000","last_active":"2024-06-02T16:46:03.919454+0000","last_peered":"2024-06-02T16:46:03.919454+0000","last_clean":"2024-06-02T16:46:03.919454+0000","last_became_active":"2024-06-02T16:46:02.892005+0000","last_became_peered":"2024-06-02T16:46:02.892005+0000","last_unstale":"2024-06-02T16:46:03.919454+0000","last_undegraded":"2024-06-02T16:46:03.919454+0000","last_fullsized":"2024-06-02T16:46:03.919454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911432+0000","last_change":"2024-06-02T16:46:03.901369+0000","last_active":"2024-06-02T16:46:03.911432+0000","last_peered":"2024-06-02T16:46:03.911432+0000","last_clean":"2024-06-02T16:46:03.911432+0000","last_became_active":"2024-06-02T16:46:03.901096+0000","last_became_peered":"2024-06-02T16:46:03.901096+0000","last_unstale":"2024-06-02T16:46:03.911432+0000","last_undegraded":"2024-06-02T16:46:03.911432+0000","last_fullsized":"2024-06-02T16:46:03.911432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.922973+0000","last_change":"2024-06-02T16:46:02.885969+0000","last_active":"2024-06-02T16:46:03.922973+0000","last_peered":"2024-06-02T16:46:03.922973+0000","last_clean":"2024-06-02T16:46:03.922973+0000","last_became_active":"2024-06-02T16:46:02.885069+0000","last_became_peered":"2024-06-02T16:46:02.885069+0000","last_unstale":"2024-06-02T16:46:03.922973+0000","last_undegraded":"2024-06-02T16:46:03.922973+0000","last_fullsized":"2024-06-02T16:46:03.922973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:18.595331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.864965+0000","last_change":"2024-06-02T16:46:02.864965+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.864965+0000","last_undegraded":"2024-06-02T16:46:02.864965+0000","last_fullsized":"2024-06-02T16:46:02.864965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919597+0000","last_change":"2024-06-02T16:46:02.884689+0000","last_active":"2024-06-02T16:46:03.919597+0000","last_peered":"2024-06-02T16:46:03.919597+0000","last_clean":"2024-06-02T16:46:03.919597+0000","last_became_active":"2024-06-02T16:46:02.884375+0000","last_became_peered":"2024-06-02T16:46:02.884375+0000","last_unstale":"2024-06-02T16:46:03.919597+0000","last_undegraded":"2024-06-02T16:46:03.919597+0000","last_fullsized":"2024-06-02T16:46:03.919597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:55.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868244+0000","last_change":"2024-06-02T16:46:03.915192+0000","last_active":"2024-06-02T16:46:04.868244+0000","last_peered":"2024-06-02T16:46:04.868244+0000","last_clean":"2024-06-02T16:46:04.868244+0000","last_became_active":"2024-06-02T16:46:03.914914+0000","last_became_peered":"2024-06-02T16:46:03.914914+0000","last_unstale":"2024-06-02T16:46:04.868244+0000","last_undegraded":"2024-06-02T16:46:04.868244+0000","last_fullsized":"2024-06-02T16:46:04.868244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920894+0000","last_change":"2024-06-02T16:46:02.890589+0000","last_active":"2024-06-02T16:46:03.920894+0000","last_peered":"2024-06-02T16:46:03.920894+0000","last_clean":"2024-06-02T16:46:03.920894+0000","last_became_active":"2024-06-02T16:46:02.890352+0000","last_became_peered":"2024-06-02T16:46:02.890352+0000","last_unstale":"2024-06-02T16:46:03.920894+0000","last_undegraded":"2024-06-02T16:46:03.920894+0000","last_fullsized":"2024-06-02T16:46:03.920894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903653+0000","last_change":"2024-06-02T16:46:03.897804+0000","last_active":"2024-06-02T16:46:03.903653+0000","last_peered":"2024-06-02T16:46:03.903653+0000","last_clean":"2024-06-02T16:46:03.903653+0000","last_became_active":"2024-06-02T16:46:03.896250+0000","last_became_peered":"2024-06-02T16:46:03.896250+0000","last_unstale":"2024-06-02T16:46:03.903653+0000","last_undegraded":"2024-06-02T16:46:03.903653+0000","last_fullsized":"2024-06-02T16:46:03.903653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:23.137749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920927+0000","last_change":"2024-06-02T16:46:02.887796+0000","last_active":"2024-06-02T16:46:03.920927+0000","last_peered":"2024-06-02T16:46:03.920927+0000","last_clean":"2024-06-02T16:46:03.920927+0000","last_became_active":"2024-06-02T16:46:02.887447+0000","last_became_peered":"2024-06-02T16:46:02.887447+0000","last_unstale":"2024-06-02T16:46:03.920927+0000","last_undegraded":"2024-06-02T16:46:03.920927+0000","last_fullsized":"2024-06-02T16:46:03.920927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:13.404538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913883+0000","last_change":"2024-06-02T16:46:03.906099+0000","last_active":"2024-06-02T16:46:03.913883+0000","last_peered":"2024-06-02T16:46:03.913883+0000","last_clean":"2024-06-02T16:46:03.913883+0000","last_became_active":"2024-06-02T16:46:03.905768+0000","last_became_peered":"2024-06-02T16:46:03.905768+0000","last_unstale":"2024-06-02T16:46:03.913883+0000","last_undegraded":"2024-06-02T16:46:03.913883+0000","last_fullsized":"2024-06-02T16:46:03.913883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863774+0000","last_change":"2024-06-02T16:46:02.881438+0000","last_active":"2024-06-02T16:46:03.863774+0000","last_peered":"2024-06-02T16:46:03.863774+0000","last_clean":"2024-06-02T16:46:03.863774+0000","last_became_active":"2024-06-02T16:46:02.881163+0000","last_became_peered":"2024-06-02T16:46:02.881163+0000","last_unstale":"2024-06-02T16:46:03.863774+0000","last_undegraded":"2024-06-02T16:46:03.863774+0000","last_fullsized":"2024-06-02T16:46:03.863774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:45.683326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883516+0000","last_change":"2024-06-02T16:46:02.887974+0000","last_active":"2024-06-02T16:46:03.883516+0000","last_peered":"2024-06-02T16:46:03.883516+0000","last_clean":"2024-06-02T16:46:03.883516+0000","last_became_active":"2024-06-02T16:46:02.887518+0000","last_became_peered":"2024-06-02T16:46:02.887518+0000","last_unstale":"2024-06-02T16:46:03.883516+0000","last_undegraded":"2024-06-02T16:46:03.883516+0000","last_fullsized":"2024-06-02T16:46:03.883516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:41.542744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.892984+0000","last_change":"2024-06-02T16:46:03.889252+0000","last_active":"2024-06-02T16:46:03.892984+0000","last_peered":"2024-06-02T16:46:03.892984+0000","last_clean":"2024-06-02T16:46:03.892984+0000","last_became_active":"2024-06-02T16:46:03.888930+0000","last_became_peered":"2024-06-02T16:46:03.888930+0000","last_unstale":"2024-06-02T16:46:03.892984+0000","last_undegraded":"2024-06-02T16:46:03.892984+0000","last_fullsized":"2024-06-02T16:46:03.892984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.867354+0000","last_change":"2024-06-02T16:46:02.893885+0000","last_active":"2024-06-02T16:46:03.867354+0000","last_peered":"2024-06-02T16:46:03.867354+0000","last_clean":"2024-06-02T16:46:03.867354+0000","last_became_active":"2024-06-02T16:46:02.893025+0000","last_became_peered":"2024-06-02T16:46:02.893025+0000","last_unstale":"2024-06-02T16:46:03.867354+0000","last_undegraded":"2024-06-02T16:46:03.867354+0000","last_fullsized":"2024-06-02T16:46:03.867354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:22.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902602+0000","last_change":"2024-06-02T16:46:03.899191+0000","last_active":"2024-06-02T16:46:03.902602+0000","last_peered":"2024-06-02T16:46:03.902602+0000","last_clean":"2024-06-02T16:46:03.902602+0000","last_became_active":"2024-06-02T16:46:03.898870+0000","last_became_peered":"2024-06-02T16:46:03.898870+0000","last_unstale":"2024-06-02T16:46:03.902602+0000","last_undegraded":"2024-06-02T16:46:03.902602+0000","last_fullsized":"2024-06-02T16:46:03.902602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883777+0000","last_change":"2024-06-02T16:46:02.891514+0000","last_active":"2024-06-02T16:46:03.883777+0000","last_peered":"2024-06-02T16:46:03.883777+0000","last_clean":"2024-06-02T16:46:03.883777+0000","last_became_active":"2024-06-02T16:46:02.890402+0000","last_became_peered":"2024-06-02T16:46:02.890402+0000","last_unstale":"2024-06-02T16:46:03.883777+0000","last_undegraded":"2024-06-02T16:46:03.883777+0000","last_fullsized":"2024-06-02T16:46:03.883777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:43.161036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900457+0000","last_change":"2024-06-02T16:46:03.894968+0000","last_active":"2024-06-02T16:46:03.900457+0000","last_peered":"2024-06-02T16:46:03.900457+0000","last_clean":"2024-06-02T16:46:03.900457+0000","last_became_active":"2024-06-02T16:46:03.894677+0000","last_became_peered":"2024-06-02T16:46:03.894677+0000","last_unstale":"2024-06-02T16:46:03.900457+0000","last_undegraded":"2024-06-02T16:46:03.900457+0000","last_fullsized":"2024-06-02T16:46:03.900457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924967+0000","last_change":"2024-06-02T16:46:02.891663+0000","last_active":"2024-06-02T16:46:03.924967+0000","last_peered":"2024-06-02T16:46:03.924967+0000","last_clean":"2024-06-02T16:46:03.924967+0000","last_became_active":"2024-06-02T16:46:02.891289+0000","last_became_peered":"2024-06-02T16:46:02.891289+0000","last_unstale":"2024-06-02T16:46:03.924967+0000","last_undegraded":"2024-06-02T16:46:03.924967+0000","last_fullsized":"2024-06-02T16:46:03.924967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:50.505687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910059+0000","last_change":"2024-06-02T16:46:03.905722+0000","last_active":"2024-06-02T16:46:03.910059+0000","last_peered":"2024-06-02T16:46:03.910059+0000","last_clean":"2024-06-02T16:46:03.910059+0000","last_became_active":"2024-06-02T16:46:03.904804+0000","last_became_peered":"2024-06-02T16:46:03.904804+0000","last_unstale":"2024-06-02T16:46:03.910059+0000","last_undegraded":"2024-06-02T16:46:03.910059+0000","last_fullsized":"2024-06-02T16:46:03.910059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.927116+0000","last_change":"2024-06-02T16:46:02.891914+0000","last_active":"2024-06-02T16:46:03.927116+0000","last_peered":"2024-06-02T16:46:03.927116+0000","last_clean":"2024-06-02T16:46:03.927116+0000","last_became_active":"2024-06-02T16:46:02.891501+0000","last_became_peered":"2024-06-02T16:46:02.891501+0000","last_unstale":"2024-06-02T16:46:03.927116+0000","last_undegraded":"2024-06-02T16:46:03.927116+0000","last_fullsized":"2024-06-02T16:46:03.927116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:02.020123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865668+0000","last_change":"2024-06-02T16:46:02.865668+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865668+0000","last_undegraded":"2024-06-02T16:46:02.865668+0000","last_fullsized":"2024-06-02T16:46:02.865668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917306+0000","last_change":"2024-06-02T16:46:02.884664+0000","last_active":"2024-06-02T16:46:03.917306+0000","last_peered":"2024-06-02T16:46:03.917306+0000","last_clean":"2024-06-02T16:46:03.917306+0000","last_became_active":"2024-06-02T16:46:02.884222+0000","last_became_peered":"2024-06-02T16:46:02.884222+0000","last_unstale":"2024-06-02T16:46:03.917306+0000","last_undegraded":"2024-06-02T16:46:03.917306+0000","last_fullsized":"2024-06-02T16:46:03.917306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899256+0000","last_change":"2024-06-02T16:46:03.894341+0000","last_active":"2024-06-02T16:46:03.899256+0000","last_peered":"2024-06-02T16:46:03.899256+0000","last_clean":"2024-06-02T16:46:03.899256+0000","last_became_active":"2024-06-02T16:46:03.894036+0000","last_became_peered":"2024-06-02T16:46:03.894036+0000","last_unstale":"2024-06-02T16:46:03.899256+0000","last_undegraded":"2024-06-02T16:46:03.899256+0000","last_fullsized":"2024-06-02T16:46:03.899256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892720+0000","last_change":"2024-06-02T16:46:02.882333+0000","last_active":"2024-06-02T16:46:02.892720+0000","last_peered":"2024-06-02T16:46:02.892720+0000","last_clean":"2024-06-02T16:46:02.892720+0000","last_became_active":"2024-06-02T16:46:02.882046+0000","last_became_peered":"2024-06-02T16:46:02.882046+0000","last_unstale":"2024-06-02T16:46:02.892720+0000","last_undegraded":"2024-06-02T16:46:02.892720+0000","last_fullsized":"2024-06-02T16:46:02.892720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:23:58.943787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867524+0000","last_change":"2024-06-02T16:46:03.905599+0000","last_active":"2024-06-02T16:46:04.867524+0000","last_peered":"2024-06-02T16:46:04.867524+0000","last_clean":"2024-06-02T16:46:04.867524+0000","last_became_active":"2024-06-02T16:46:03.905288+0000","last_became_peered":"2024-06-02T16:46:03.905288+0000","last_unstale":"2024-06-02T16:46:04.867524+0000","last_undegraded":"2024-06-02T16:46:04.867524+0000","last_fullsized":"2024-06-02T16:46:04.867524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.864228+0000","last_change":"2024-06-02T16:46:02.891190+0000","last_active":"2024-06-02T16:46:03.864228+0000","last_peered":"2024-06-02T16:46:03.864228+0000","last_clean":"2024-06-02T16:46:03.864228+0000","last_became_active":"2024-06-02T16:46:02.890783+0000","last_became_peered":"2024-06-02T16:46:02.890783+0000","last_unstale":"2024-06-02T16:46:03.864228+0000","last_undegraded":"2024-06-02T16:46:03.864228+0000","last_fullsized":"2024-06-02T16:46:03.864228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:18.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901713+0000","last_change":"2024-06-02T16:46:03.894216+0000","last_active":"2024-06-02T16:46:03.901713+0000","last_peered":"2024-06-02T16:46:03.901713+0000","last_clean":"2024-06-02T16:46:03.901713+0000","last_became_active":"2024-06-02T16:46:03.893381+0000","last_became_peered":"2024-06-02T16:46:03.893381+0000","last_unstale":"2024-06-02T16:46:03.901713+0000","last_undegraded":"2024-06-02T16:46:03.901713+0000","last_fullsized":"2024-06-02T16:46:03.901713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924708+0000","last_change":"2024-06-02T16:46:02.885194+0000","last_active":"2024-06-02T16:46:03.924708+0000","last_peered":"2024-06-02T16:46:03.924708+0000","last_clean":"2024-06-02T16:46:03.924708+0000","last_became_active":"2024-06-02T16:46:02.884879+0000","last_became_peered":"2024-06-02T16:46:02.884879+0000","last_unstale":"2024-06-02T16:46:03.924708+0000","last_undegraded":"2024-06-02T16:46:03.924708+0000","last_fullsized":"2024-06-02T16:46:03.924708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:51.294201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914109+0000","last_change":"2024-06-02T16:46:03.909612+0000","last_active":"2024-06-02T16:46:03.914109+0000","last_peered":"2024-06-02T16:46:03.914109+0000","last_clean":"2024-06-02T16:46:03.914109+0000","last_became_active":"2024-06-02T16:46:03.909152+0000","last_became_peered":"2024-06-02T16:46:03.909152+0000","last_unstale":"2024-06-02T16:46:03.914109+0000","last_undegraded":"2024-06-02T16:46:03.914109+0000","last_fullsized":"2024-06-02T16:46:03.914109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894265+0000","last_change":"2024-06-02T16:46:02.888602+0000","last_active":"2024-06-02T16:46:02.894265+0000","last_peered":"2024-06-02T16:46:02.894265+0000","last_clean":"2024-06-02T16:46:02.894265+0000","last_became_active":"2024-06-02T16:46:02.887961+0000","last_became_peered":"2024-06-02T16:46:02.887961+0000","last_unstale":"2024-06-02T16:46:02.894265+0000","last_undegraded":"2024-06-02T16:46:02.894265+0000","last_fullsized":"2024-06-02T16:46:02.894265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:05:36.795302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900369+0000","last_change":"2024-06-02T16:46:03.893517+0000","last_active":"2024-06-02T16:46:03.900369+0000","last_peered":"2024-06-02T16:46:03.900369+0000","last_clean":"2024-06-02T16:46:03.900369+0000","last_became_active":"2024-06-02T16:46:03.893145+0000","last_became_peered":"2024-06-02T16:46:03.893145+0000","last_unstale":"2024-06-02T16:46:03.900369+0000","last_undegraded":"2024-06-02T16:46:03.900369+0000","last_fullsized":"2024-06-02T16:46:03.900369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917502+0000","last_change":"2024-06-02T16:46:02.887086+0000","last_active":"2024-06-02T16:46:03.917502+0000","last_peered":"2024-06-02T16:46:03.917502+0000","last_clean":"2024-06-02T16:46:03.917502+0000","last_became_active":"2024-06-02T16:46:02.886357+0000","last_became_peered":"2024-06-02T16:46:02.886357+0000","last_unstale":"2024-06-02T16:46:03.917502+0000","last_undegraded":"2024-06-02T16:46:03.917502+0000","last_fullsized":"2024-06-02T16:46:03.917502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:20.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866864+0000","last_change":"2024-06-02T16:46:02.866864+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866864+0000","last_undegraded":"2024-06-02T16:46:02.866864+0000","last_fullsized":"2024-06-02T16:46:02.866864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.918801+0000","last_change":"2024-06-02T16:46:02.888288+0000","last_active":"2024-06-02T16:46:03.918801+0000","last_peered":"2024-06-02T16:46:03.918801+0000","last_clean":"2024-06-02T16:46:03.918801+0000","last_became_active":"2024-06-02T16:46:02.883890+0000","last_became_peered":"2024-06-02T16:46:02.883890+0000","last_unstale":"2024-06-02T16:46:03.918801+0000","last_undegraded":"2024-06-02T16:46:03.918801+0000","last_fullsized":"2024-06-02T16:46:03.918801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913731+0000","last_change":"2024-06-02T16:46:03.906699+0000","last_active":"2024-06-02T16:46:03.913731+0000","last_peered":"2024-06-02T16:46:03.913731+0000","last_clean":"2024-06-02T16:46:03.913731+0000","last_became_active":"2024-06-02T16:46:03.906415+0000","last_became_peered":"2024-06-02T16:46:03.906415+0000","last_unstale":"2024-06-02T16:46:03.913731+0000","last_undegraded":"2024-06-02T16:46:03.913731+0000","last_fullsized":"2024-06-02T16:46:03.913731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:50.238477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.887537+0000","last_change":"2024-06-02T16:46:02.886711+0000","last_active":"2024-06-02T16:46:03.887537+0000","last_peered":"2024-06-02T16:46:03.887537+0000","last_clean":"2024-06-02T16:46:03.887537+0000","last_became_active":"2024-06-02T16:46:02.886377+0000","last_became_peered":"2024-06-02T16:46:02.886377+0000","last_unstale":"2024-06-02T16:46:03.887537+0000","last_undegraded":"2024-06-02T16:46:03.887537+0000","last_fullsized":"2024-06-02T16:46:03.887537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:38.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.916407+0000","last_change":"2024-06-02T16:46:03.910758+0000","last_active":"2024-06-02T16:46:03.916407+0000","last_peered":"2024-06-02T16:46:03.916407+0000","last_clean":"2024-06-02T16:46:03.916407+0000","last_became_active":"2024-06-02T16:46:03.910435+0000","last_became_peered":"2024-06-02T16:46:03.910435+0000","last_unstale":"2024-06-02T16:46:03.916407+0000","last_undegraded":"2024-06-02T16:46:03.916407+0000","last_fullsized":"2024-06-02T16:46:03.916407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:21.623342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920139+0000","last_change":"2024-06-02T16:46:02.883493+0000","last_active":"2024-06-02T16:46:03.920139+0000","last_peered":"2024-06-02T16:46:03.920139+0000","last_clean":"2024-06-02T16:46:03.920139+0000","last_became_active":"2024-06-02T16:46:02.880100+0000","last_became_peered":"2024-06-02T16:46:02.880100+0000","last_unstale":"2024-06-02T16:46:03.920139+0000","last_undegraded":"2024-06-02T16:46:03.920139+0000","last_fullsized":"2024-06-02T16:46:03.920139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:02.344035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914028+0000","last_change":"2024-06-02T16:46:03.907359+0000","last_active":"2024-06-02T16:46:03.914028+0000","last_peered":"2024-06-02T16:46:03.914028+0000","last_clean":"2024-06-02T16:46:03.914028+0000","last_became_active":"2024-06-02T16:46:03.906700+0000","last_became_peered":"2024-06-02T16:46:03.906700+0000","last_unstale":"2024-06-02T16:46:03.914028+0000","last_undegraded":"2024-06-02T16:46:03.914028+0000","last_fullsized":"2024-06-02T16:46:03.914028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:39.424200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.877454+0000","last_change":"2024-06-02T16:46:02.895540+0000","last_active":"2024-06-02T16:46:03.877454+0000","last_peered":"2024-06-02T16:46:03.877454+0000","last_clean":"2024-06-02T16:46:03.877454+0000","last_became_active":"2024-06-02T16:46:02.895129+0000","last_became_peered":"2024-06-02T16:46:02.895129+0000","last_unstale":"2024-06-02T16:46:03.877454+0000","last_undegraded":"2024-06-02T16:46:03.877454+0000","last_fullsized":"2024-06-02T16:46:03.877454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904670+0000","last_change":"2024-06-02T16:46:03.895347+0000","last_active":"2024-06-02T16:46:03.904670+0000","last_peered":"2024-06-02T16:46:03.904670+0000","last_clean":"2024-06-02T16:46:03.904670+0000","last_became_active":"2024-06-02T16:46:03.894742+0000","last_became_peered":"2024-06-02T16:46:03.894742+0000","last_unstale":"2024-06-02T16:46:03.904670+0000","last_undegraded":"2024-06-02T16:46:03.904670+0000","last_fullsized":"2024-06-02T16:46:03.904670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:16.294203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883547+0000","last_change":"2024-06-02T16:46:02.882260+0000","last_active":"2024-06-02T16:46:03.883547+0000","last_peered":"2024-06-02T16:46:03.883547+0000","last_clean":"2024-06-02T16:46:03.883547+0000","last_became_active":"2024-06-02T16:46:02.875091+0000","last_became_peered":"2024-06-02T16:46:02.875091+0000","last_unstale":"2024-06-02T16:46:03.883547+0000","last_undegraded":"2024-06-02T16:46:03.883547+0000","last_fullsized":"2024-06-02T16:46:03.883547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:02.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867216+0000","last_change":"2024-06-02T16:46:03.899743+0000","last_active":"2024-06-02T16:46:04.867216+0000","last_peered":"2024-06-02T16:46:04.867216+0000","last_clean":"2024-06-02T16:46:04.867216+0000","last_became_active":"2024-06-02T16:46:03.899449+0000","last_became_peered":"2024-06-02T16:46:03.899449+0000","last_unstale":"2024-06-02T16:46:04.867216+0000","last_undegraded":"2024-06-02T16:46:04.867216+0000","last_fullsized":"2024-06-02T16:46:04.867216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.874810+0000","last_change":"2024-06-02T16:46:02.890214+0000","last_active":"2024-06-02T16:46:03.874810+0000","last_peered":"2024-06-02T16:46:03.874810+0000","last_clean":"2024-06-02T16:46:03.874810+0000","last_became_active":"2024-06-02T16:46:02.889874+0000","last_became_peered":"2024-06-02T16:46:02.889874+0000","last_unstale":"2024-06-02T16:46:03.874810+0000","last_undegraded":"2024-06-02T16:46:03.874810+0000","last_fullsized":"2024-06-02T16:46:03.874810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:01.204300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906101+0000","last_change":"2024-06-02T16:46:03.901073+0000","last_active":"2024-06-02T16:46:03.906101+0000","last_peered":"2024-06-02T16:46:03.906101+0000","last_clean":"2024-06-02T16:46:03.906101+0000","last_became_active":"2024-06-02T16:46:03.890045+0000","last_became_peered":"2024-06-02T16:46:03.890045+0000","last_unstale":"2024-06-02T16:46:03.906101+0000","last_undegraded":"2024-06-02T16:46:03.906101+0000","last_fullsized":"2024-06-02T16:46:03.906101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:42.549209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.888570+0000","last_change":"2024-06-02T16:46:02.883504+0000","last_active":"2024-06-02T16:46:02.888570+0000","last_peered":"2024-06-02T16:46:02.888570+0000","last_clean":"2024-06-02T16:46:02.888570+0000","last_became_active":"2024-06-02T16:46:02.883177+0000","last_became_peered":"2024-06-02T16:46:02.883177+0000","last_unstale":"2024-06-02T16:46:02.888570+0000","last_undegraded":"2024-06-02T16:46:02.888570+0000","last_fullsized":"2024-06-02T16:46:02.888570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:42:21.241624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907648+0000","last_change":"2024-06-02T16:46:03.903394+0000","last_active":"2024-06-02T16:46:03.907648+0000","last_peered":"2024-06-02T16:46:03.907648+0000","last_clean":"2024-06-02T16:46:03.907648+0000","last_became_active":"2024-06-02T16:46:03.902987+0000","last_became_peered":"2024-06-02T16:46:03.902987+0000","last_unstale":"2024-06-02T16:46:03.907648+0000","last_undegraded":"2024-06-02T16:46:03.907648+0000","last_fullsized":"2024-06-02T16:46:03.907648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883295+0000","last_change":"2024-06-02T16:46:02.890382+0000","last_active":"2024-06-02T16:46:03.883295+0000","last_peered":"2024-06-02T16:46:03.883295+0000","last_clean":"2024-06-02T16:46:03.883295+0000","last_became_active":"2024-06-02T16:46:02.890074+0000","last_became_peered":"2024-06-02T16:46:02.890074+0000","last_unstale":"2024-06-02T16:46:03.883295+0000","last_undegraded":"2024-06-02T16:46:03.883295+0000","last_fullsized":"2024-06-02T16:46:03.883295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906250+0000","last_change":"2024-06-02T16:46:03.899253+0000","last_active":"2024-06-02T16:46:03.906250+0000","last_peered":"2024-06-02T16:46:03.906250+0000","last_clean":"2024-06-02T16:46:03.906250+0000","last_became_active":"2024-06-02T16:46:03.898932+0000","last_became_peered":"2024-06-02T16:46:03.898932+0000","last_unstale":"2024-06-02T16:46:03.906250+0000","last_undegraded":"2024-06-02T16:46:03.906250+0000","last_fullsized":"2024-06-02T16:46:03.906250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892087+0000","last_change":"2024-06-02T16:46:02.885176+0000","last_active":"2024-06-02T16:46:02.892087+0000","last_peered":"2024-06-02T16:46:02.892087+0000","last_clean":"2024-06-02T16:46:02.892087+0000","last_became_active":"2024-06-02T16:46:02.884863+0000","last_became_peered":"2024-06-02T16:46:02.884863+0000","last_unstale":"2024-06-02T16:46:02.892087+0000","last_undegraded":"2024-06-02T16:46:02.892087+0000","last_fullsized":"2024-06-02T16:46:02.892087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:34.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901094+0000","last_change":"2024-06-02T16:46:03.896244+0000","last_active":"2024-06-02T16:46:03.901094+0000","last_peered":"2024-06-02T16:46:03.901094+0000","last_clean":"2024-06-02T16:46:03.901094+0000","last_became_active":"2024-06-02T16:46:03.895899+0000","last_became_peered":"2024-06-02T16:46:03.895899+0000","last_unstale":"2024-06-02T16:46:03.901094+0000","last_undegraded":"2024-06-02T16:46:03.901094+0000","last_fullsized":"2024-06-02T16:46:03.901094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.886144+0000","last_change":"2024-06-02T16:46:02.882808+0000","last_active":"2024-06-02T16:46:03.886144+0000","last_peered":"2024-06-02T16:46:03.886144+0000","last_clean":"2024-06-02T16:46:03.886144+0000","last_became_active":"2024-06-02T16:46:02.882515+0000","last_became_peered":"2024-06-02T16:46:02.882515+0000","last_unstale":"2024-06-02T16:46:03.886144+0000","last_undegraded":"2024-06-02T16:46:03.886144+0000","last_fullsized":"2024-06-02T16:46:03.886144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:05.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908603+0000","last_change":"2024-06-02T16:46:03.902214+0000","last_active":"2024-06-02T16:46:03.908603+0000","last_peered":"2024-06-02T16:46:03.908603+0000","last_clean":"2024-06-02T16:46:03.908603+0000","last_became_active":"2024-06-02T16:46:03.901873+0000","last_became_peered":"2024-06-02T16:46:03.901873+0000","last_unstale":"2024-06-02T16:46:03.908603+0000","last_undegraded":"2024-06-02T16:46:03.908603+0000","last_fullsized":"2024-06-02T16:46:03.908603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894545+0000","last_change":"2024-06-02T16:46:02.890723+0000","last_active":"2024-06-02T16:46:02.894545+0000","last_peered":"2024-06-02T16:46:02.894545+0000","last_clean":"2024-06-02T16:46:02.894545+0000","last_became_active":"2024-06-02T16:46:02.889856+0000","last_became_peered":"2024-06-02T16:46:02.889856+0000","last_unstale":"2024-06-02T16:46:02.894545+0000","last_undegraded":"2024-06-02T16:46:02.894545+0000","last_fullsized":"2024-06-02T16:46:02.894545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:31.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904734+0000","last_change":"2024-06-02T16:46:03.902323+0000","last_active":"2024-06-02T16:46:03.904734+0000","last_peered":"2024-06-02T16:46:03.904734+0000","last_clean":"2024-06-02T16:46:03.904734+0000","last_became_active":"2024-06-02T16:46:03.901882+0000","last_became_peered":"2024-06-02T16:46:03.901882+0000","last_unstale":"2024-06-02T16:46:03.904734+0000","last_undegraded":"2024-06-02T16:46:03.904734+0000","last_fullsized":"2024-06-02T16:46:03.904734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.885236+0000","last_change":"2024-06-02T16:46:02.884578+0000","last_active":"2024-06-02T16:46:03.885236+0000","last_peered":"2024-06-02T16:46:03.885236+0000","last_clean":"2024-06-02T16:46:03.885236+0000","last_became_active":"2024-06-02T16:46:02.882715+0000","last_became_peered":"2024-06-02T16:46:02.882715+0000","last_unstale":"2024-06-02T16:46:03.885236+0000","last_undegraded":"2024-06-02T16:46:03.885236+0000","last_fullsized":"2024-06-02T16:46:03.885236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:49.232011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911131+0000","last_change":"2024-06-02T16:46:03.892141+0000","last_active":"2024-06-02T16:46:03.911131+0000","last_peered":"2024-06-02T16:46:03.911131+0000","last_clean":"2024-06-02T16:46:03.911131+0000","last_became_active":"2024-06-02T16:46:03.891420+0000","last_became_peered":"2024-06-02T16:46:03.891420+0000","last_unstale":"2024-06-02T16:46:03.911131+0000","last_undegraded":"2024-06-02T16:46:03.911131+0000","last_fullsized":"2024-06-02T16:46:03.911131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863684+0000","last_change":"2024-06-02T16:46:02.892674+0000","last_active":"2024-06-02T16:46:03.863684+0000","last_peered":"2024-06-02T16:46:03.863684+0000","last_clean":"2024-06-02T16:46:03.863684+0000","last_became_active":"2024-06-02T16:46:02.890747+0000","last_became_peered":"2024-06-02T16:46:02.890747+0000","last_unstale":"2024-06-02T16:46:03.863684+0000","last_undegraded":"2024-06-02T16:46:03.863684+0000","last_fullsized":"2024-06-02T16:46:03.863684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:10.440456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868386+0000","last_change":"2024-06-02T16:46:03.916186+0000","last_active":"2024-06-02T16:46:04.868386+0000","last_peered":"2024-06-02T16:46:04.868386+0000","last_clean":"2024-06-02T16:46:04.868386+0000","last_became_active":"2024-06-02T16:46:03.915623+0000","last_became_peered":"2024-06-02T16:46:03.915623+0000","last_unstale":"2024-06-02T16:46:04.868386+0000","last_undegraded":"2024-06-02T16:46:04.868386+0000","last_fullsized":"2024-06-02T16:46:04.868386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.876609+0000","last_change":"2024-06-02T16:46:02.892101+0000","last_active":"2024-06-02T16:46:03.876609+0000","last_peered":"2024-06-02T16:46:03.876609+0000","last_clean":"2024-06-02T16:46:03.876609+0000","last_became_active":"2024-06-02T16:46:02.891745+0000","last_became_peered":"2024-06-02T16:46:02.891745+0000","last_unstale":"2024-06-02T16:46:03.876609+0000","last_undegraded":"2024-06-02T16:46:03.876609+0000","last_fullsized":"2024-06-02T16:46:03.876609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867868+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:46:04.867868+0000","last_peered":"2024-06-02T16:46:04.867868+0000","last_clean":"2024-06-02T16:46:04.867868+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:46:04.867868+0000","last_undegraded":"2024-06-02T16:46:04.867868+0000","last_fullsized":"2024-06-02T16:46:04.867868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":733877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":143523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":727012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":130377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:46:08.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:46:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.153+0000 7f5739e00640 1 Processor -- start 2024-06-02T16:46:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.153+0000 7f5739e00640 1 -- start start 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5739e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f573413ed60 0x7f573406e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5739e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 0x7f573406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5739e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57341416c0 con 0x7f573413f140 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5739e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f57340d0890 con 0x7f573413ed60 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5739e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5734160970 con 0x7f5734160350 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5733e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f573413f140 0x7f573415fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48076/0 (socket says 172.21.15.52:48076) 2024-06-02T16:46:09.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.155+0000 7f5733e00640 1 -- 172.21.15.52:0/3913799099 learned_addr learned my addr 172.21.15.52:0/3913799099 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5739400640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 0x7f573406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5738a00640 1 --2- 172.21.15.52:0/3913799099 >> v2:172.21.15.114:3300/0 conn(0x7f573413ed60 0x7f573406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870280835 0 0) 0x7f57341416c0 con 0x7f573413f140 2024-06-02T16:46:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f571c003520 con 0x7f573413f140 2024-06-02T16:46:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 722992949 0 0) 0x7f571c003520 con 0x7f573413f140 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 msgr2=0x7f573406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 0x7f573406e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 >> v2:172.21.15.114:3300/0 conn(0x7f573413ed60 msgr2=0x7f573406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 --2- 172.21.15.52:0/3913799099 >> v2:172.21.15.114:3300/0 conn(0x7f573413ed60 0x7f573406e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734141960 con 0x7f573413f140 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f57240016f0 con 0x7f573413f140 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 >> v1:172.21.15.52:6789/0 conn(0x7f573413f140 legacy=0x7f573415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c003a00 0x7f571c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c004800 0x7f571c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 0x7f571c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57340d0890 con 0x7f571c003a00 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5734160970 con 0x7f571c004800 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.156+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f571c00ba40 con 0x7f5734160350 2024-06-02T16:46:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c003a00 0x7f571c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5733e00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c004800 0x7f571c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 -- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 msgr2=0x7f571c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5734160350 0x7f571c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 -- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c004800 msgr2=0x7f571c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c004800 0x7f571c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5738a00640 1 -- 172.21.15.52:0/3913799099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c003520 con 0x7f571c003a00 2024-06-02T16:46:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.157+0000 7f5733e00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c004800 0x7f571c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.158+0000 7f5738a00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c003a00 0x7f571c003e20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5728009ac0 tx=0x7f571c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8faf36fe332f6a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.158+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728036070 con 0x7f571c003a00 2024-06-02T16:46:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.158+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728031400 con 0x7f571c003a00 2024-06-02T16:46:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.158+0000 7f5733400640 1 -- 172.21.15.52:0/3913799099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728009690 con 0x7f571c003a00 2024-06-02T16:46:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 -- 172.21.15.52:0/3913799099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c003a00 msgr2=0x7f571c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 --2- 172.21.15.52:0/3913799099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571c003a00 0x7f571c003e20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5728009ac0 tx=0x7f571c005830 comp rx=0 tx=0).stop 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739400640 1 -- 172.21.15.52:0/3913799099 reap_dead start 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 -- 172.21.15.52:0/3913799099 shutdown_connections 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 -- 172.21.15.52:0/3913799099 >> 172.21.15.52:0/3913799099 conn(0x7f573406c380 msgr2=0x7f573406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 -- 172.21.15.52:0/3913799099 shutdown_connections 2024-06-02T16:46:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.159+0000 7f5739e00640 1 -- 172.21.15.52:0/3913799099 wait complete. 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.161+0000 7f5739e00640 1 Processor -- start 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.161+0000 7f5739e00640 1 -- start start 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c003a00 0x7f57341456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57341371f0 0x7f5734137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5734142440 con 0x7f573413ff40 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5734141f20 con 0x7f571c003a00 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.162+0000 7f5739e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f57341425c0 con 0x7f57341371f0 2024-06-02T16:46:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36468/0 (socket says 172.21.15.52:36468) 2024-06-02T16:46:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 -- 172.21.15.52:0/4165495041 learned_addr learned my addr 172.21.15.52:0/4165495041 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 -- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57341371f0 msgr2=0x7f5734137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57341371f0 0x7f5734137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 -- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c003a00 msgr2=0x7f57341456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5738a00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c003a00 0x7f57341456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c003a00 0x7f57341456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 -- 172.21.15.52:0/4165495041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734140720 con 0x7f573413ff40 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.163+0000 7f5733e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f572400d780 tx=0x7f572400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.164+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724019070 con 0x7f573413ff40 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.164+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240072d0 con 0x7f573413ff40 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.164+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240047e0 con 0x7f573413ff40 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.164+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5734140a00 con 0x7f573413ff40 2024-06-02T16:46:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.164+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734154a80 con 0x7f573413ff40 2024-06-02T16:46:09.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.165+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734075ea0 con 0x7f573413ff40 2024-06-02T16:46:09.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.166+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f572401c070 con 0x7f573413ff40 2024-06-02T16:46:09.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.167+0000 7f5730c00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 0x7f5718078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.167+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5724096fe0 con 0x7f573413ff40 2024-06-02T16:46:09.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.168+0000 7f5738a00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 0x7f5718078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.169+0000 7f5738a00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 0x7f5718078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5728033000 tx=0x7f5728008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.172+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f57240608a0 con 0x7f573413ff40 2024-06-02T16:46:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.377+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f573415f510 con 0x7f57180762d0 2024-06-02T16:46:09.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.397+0000 7f5730c00640 1 -- 172.21.15.52:0/4165495041 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251224 (secure 0 0 0) 0x7f573415f510 con 0x7f57180762d0 2024-06-02T16:46:09.399 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:09.400 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:46:09.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.402+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 msgr2=0x7f5718078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.402+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 0x7f5718078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5728033000 tx=0x7f5728008030 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.402+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 msgr2=0x7f57341f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.402+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f572400d780 tx=0x7f572400dc40 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.402+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 shutdown_connections 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57180762d0 0x7f5718078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57341371f0 0x7f5734137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f573413ff40 0x7f57341f5230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 --2- 172.21.15.52:0/4165495041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f571c003a00 0x7f57341456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 >> 172.21.15.52:0/4165495041 conn(0x7f573406c380 msgr2=0x7f573406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 shutdown_connections 2024-06-02T16:46:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.403+0000 7f5739e00640 1 -- 172.21.15.52:0/4165495041 wait complete. 2024-06-02T16:46:09.420 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-06-02T16:46:08.012009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236848,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737872,"statfs":{"total":773094113280,"available":772851580928,"internally_reserved":0,"allocated":4136960,"data_stored":2296203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002273"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902594+0000","last_change":"2024-06-02T16:46:03.899601+0000","last_active":"2024-06-02T16:46:03.902594+0000","last_peered":"2024-06-02T16:46:03.902594+0000","last_clean":"2024-06-02T16:46:03.902594+0000","last_became_active":"2024-06-02T16:46:03.899249+0000","last_became_peered":"2024-06-02T16:46:03.899249+0000","last_unstale":"2024-06-02T16:46:03.902594+0000","last_undegraded":"2024-06-02T16:46:03.902594+0000","last_fullsized":"2024-06-02T16:46:03.902594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.896339+0000","last_change":"2024-06-02T16:46:03.893509+0000","last_active":"2024-06-02T16:46:03.896339+0000","last_peered":"2024-06-02T16:46:03.896339+0000","last_clean":"2024-06-02T16:46:03.896339+0000","last_became_active":"2024-06-02T16:46:03.893090+0000","last_became_peered":"2024-06-02T16:46:03.893090+0000","last_unstale":"2024-06-02T16:46:03.896339+0000","last_undegraded":"2024-06-02T16:46:03.896339+0000","last_fullsized":"2024-06-02T16:46:03.896339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910086+0000","last_change":"2024-06-02T16:46:03.906471+0000","last_active":"2024-06-02T16:46:03.910086+0000","last_peered":"2024-06-02T16:46:03.910086+0000","last_clean":"2024-06-02T16:46:03.910086+0000","last_became_active":"2024-06-02T16:46:03.904044+0000","last_became_peered":"2024-06-02T16:46:03.904044+0000","last_unstale":"2024-06-02T16:46:03.910086+0000","last_undegraded":"2024-06-02T16:46:03.910086+0000","last_fullsized":"2024-06-02T16:46:03.910086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.870067+0000","last_change":"2024-06-02T16:46:02.870067+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.870067+0000","last_undegraded":"2024-06-02T16:46:02.870067+0000","last_fullsized":"2024-06-02T16:46:02.870067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891945+0000","last_change":"2024-06-02T16:46:03.886231+0000","last_active":"2024-06-02T16:46:03.891945+0000","last_peered":"2024-06-02T16:46:03.891945+0000","last_clean":"2024-06-02T16:46:03.891945+0000","last_became_active":"2024-06-02T16:46:03.884590+0000","last_became_peered":"2024-06-02T16:46:03.884590+0000","last_unstale":"2024-06-02T16:46:03.891945+0000","last_undegraded":"2024-06-02T16:46:03.891945+0000","last_fullsized":"2024-06-02T16:46:03.891945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:22.800808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.893794+0000","last_change":"2024-06-02T16:46:03.890058+0000","last_active":"2024-06-02T16:46:03.893794+0000","last_peered":"2024-06-02T16:46:03.893794+0000","last_clean":"2024-06-02T16:46:03.893794+0000","last_became_active":"2024-06-02T16:46:03.889655+0000","last_became_peered":"2024-06-02T16:46:03.889655+0000","last_unstale":"2024-06-02T16:46:03.893794+0000","last_undegraded":"2024-06-02T16:46:03.893794+0000","last_fullsized":"2024-06-02T16:46:03.893794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867638+0000","last_change":"2024-06-02T16:46:03.900580+0000","last_active":"2024-06-02T16:46:04.867638+0000","last_peered":"2024-06-02T16:46:04.867638+0000","last_clean":"2024-06-02T16:46:04.867638+0000","last_became_active":"2024-06-02T16:46:03.899640+0000","last_became_peered":"2024-06-02T16:46:03.899640+0000","last_unstale":"2024-06-02T16:46:04.867638+0000","last_undegraded":"2024-06-02T16:46:04.867638+0000","last_fullsized":"2024-06-02T16:46:04.867638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867223+0000","last_change":"2024-06-02T16:46:03.908391+0000","last_active":"2024-06-02T16:46:04.867223+0000","last_peered":"2024-06-02T16:46:04.867223+0000","last_clean":"2024-06-02T16:46:04.867223+0000","last_became_active":"2024-06-02T16:46:03.907935+0000","last_became_peered":"2024-06-02T16:46:03.907935+0000","last_unstale":"2024-06-02T16:46:04.867223+0000","last_undegraded":"2024-06-02T16:46:04.867223+0000","last_fullsized":"2024-06-02T16:46:04.867223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913926+0000","last_change":"2024-06-02T16:46:03.909678+0000","last_active":"2024-06-02T16:46:03.913926+0000","last_peered":"2024-06-02T16:46:03.913926+0000","last_clean":"2024-06-02T16:46:03.913926+0000","last_became_active":"2024-06-02T16:46:03.905007+0000","last_became_peered":"2024-06-02T16:46:03.905007+0000","last_unstale":"2024-06-02T16:46:03.913926+0000","last_undegraded":"2024-06-02T16:46:03.913926+0000","last_fullsized":"2024-06-02T16:46:03.913926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865396+0000","last_change":"2024-06-02T16:46:02.865396+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865396+0000","last_undegraded":"2024-06-02T16:46:02.865396+0000","last_fullsized":"2024-06-02T16:46:02.865396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868493+0000","last_change":"2024-06-02T16:46:03.897768+0000","last_active":"2024-06-02T16:46:04.868493+0000","last_peered":"2024-06-02T16:46:04.868493+0000","last_clean":"2024-06-02T16:46:04.868493+0000","last_became_active":"2024-06-02T16:46:03.897473+0000","last_became_peered":"2024-06-02T16:46:03.897473+0000","last_unstale":"2024-06-02T16:46:04.868493+0000","last_undegraded":"2024-06-02T16:46:04.868493+0000","last_fullsized":"2024-06-02T16:46:04.868493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900481+0000","last_change":"2024-06-02T16:46:03.893747+0000","last_active":"2024-06-02T16:46:03.900481+0000","last_peered":"2024-06-02T16:46:03.900481+0000","last_clean":"2024-06-02T16:46:03.900481+0000","last_became_active":"2024-06-02T16:46:03.893457+0000","last_became_peered":"2024-06-02T16:46:03.893457+0000","last_unstale":"2024-06-02T16:46:03.900481+0000","last_undegraded":"2024-06-02T16:46:03.900481+0000","last_fullsized":"2024-06-02T16:46:03.900481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906034+0000","last_change":"2024-06-02T16:46:03.904170+0000","last_active":"2024-06-02T16:46:03.906034+0000","last_peered":"2024-06-02T16:46:03.906034+0000","last_clean":"2024-06-02T16:46:03.906034+0000","last_became_active":"2024-06-02T16:46:03.903910+0000","last_became_peered":"2024-06-02T16:46:03.903910+0000","last_unstale":"2024-06-02T16:46:03.906034+0000","last_undegraded":"2024-06-02T16:46:03.906034+0000","last_fullsized":"2024-06-02T16:46:03.906034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:03.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.889930+0000","last_change":"2024-06-02T16:46:03.881096+0000","last_active":"2024-06-02T16:46:03.889930+0000","last_peered":"2024-06-02T16:46:03.889930+0000","last_clean":"2024-06-02T16:46:03.889930+0000","last_became_active":"2024-06-02T16:46:03.880588+0000","last_became_peered":"2024-06-02T16:46:03.880588+0000","last_unstale":"2024-06-02T16:46:03.889930+0000","last_undegraded":"2024-06-02T16:46:03.889930+0000","last_fullsized":"2024-06-02T16:46:03.889930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903548+0000","last_change":"2024-06-02T16:46:03.898043+0000","last_active":"2024-06-02T16:46:03.903548+0000","last_peered":"2024-06-02T16:46:03.903548+0000","last_clean":"2024-06-02T16:46:03.903548+0000","last_became_active":"2024-06-02T16:46:03.897729+0000","last_became_peered":"2024-06-02T16:46:03.897729+0000","last_unstale":"2024-06-02T16:46:03.903548+0000","last_undegraded":"2024-06-02T16:46:03.903548+0000","last_fullsized":"2024-06-02T16:46:03.903548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:19.601796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867980+0000","last_change":"2024-06-02T16:46:03.901353+0000","last_active":"2024-06-02T16:46:04.867980+0000","last_peered":"2024-06-02T16:46:04.867980+0000","last_clean":"2024-06-02T16:46:04.867980+0000","last_became_active":"2024-06-02T16:46:03.901086+0000","last_became_peered":"2024-06-02T16:46:03.901086+0000","last_unstale":"2024-06-02T16:46:04.867980+0000","last_undegraded":"2024-06-02T16:46:04.867980+0000","last_fullsized":"2024-06-02T16:46:04.867980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868905+0000","last_change":"2024-06-02T16:46:03.903426+0000","last_active":"2024-06-02T16:46:04.868905+0000","last_peered":"2024-06-02T16:46:04.868905+0000","last_clean":"2024-06-02T16:46:04.868905+0000","last_became_active":"2024-06-02T16:46:03.903109+0000","last_became_peered":"2024-06-02T16:46:03.903109+0000","last_unstale":"2024-06-02T16:46:04.868905+0000","last_undegraded":"2024-06-02T16:46:04.868905+0000","last_fullsized":"2024-06-02T16:46:04.868905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.912003+0000","last_change":"2024-06-02T16:46:03.908555+0000","last_active":"2024-06-02T16:46:03.912003+0000","last_peered":"2024-06-02T16:46:03.912003+0000","last_clean":"2024-06-02T16:46:03.912003+0000","last_became_active":"2024-06-02T16:46:03.908205+0000","last_became_peered":"2024-06-02T16:46:03.908205+0000","last_unstale":"2024-06-02T16:46:03.912003+0000","last_undegraded":"2024-06-02T16:46:03.912003+0000","last_fullsized":"2024-06-02T16:46:03.912003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903376+0000","last_change":"2024-06-02T16:46:03.897750+0000","last_active":"2024-06-02T16:46:03.903376+0000","last_peered":"2024-06-02T16:46:03.903376+0000","last_clean":"2024-06-02T16:46:03.903376+0000","last_became_active":"2024-06-02T16:46:03.897419+0000","last_became_peered":"2024-06-02T16:46:03.897419+0000","last_unstale":"2024-06-02T16:46:03.903376+0000","last_undegraded":"2024-06-02T16:46:03.903376+0000","last_fullsized":"2024-06-02T16:46:03.903376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907778+0000","last_change":"2024-06-02T16:46:03.899325+0000","last_active":"2024-06-02T16:46:03.907778+0000","last_peered":"2024-06-02T16:46:03.907778+0000","last_clean":"2024-06-02T16:46:03.907778+0000","last_became_active":"2024-06-02T16:46:03.899055+0000","last_became_peered":"2024-06-02T16:46:03.899055+0000","last_unstale":"2024-06-02T16:46:03.907778+0000","last_undegraded":"2024-06-02T16:46:03.907778+0000","last_fullsized":"2024-06-02T16:46:03.907778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:56:17.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914066+0000","last_change":"2024-06-02T16:46:03.906474+0000","last_active":"2024-06-02T16:46:03.914066+0000","last_peered":"2024-06-02T16:46:03.914066+0000","last_clean":"2024-06-02T16:46:03.914066+0000","last_became_active":"2024-06-02T16:46:03.906146+0000","last_became_peered":"2024-06-02T16:46:03.906146+0000","last_unstale":"2024-06-02T16:46:03.914066+0000","last_undegraded":"2024-06-02T16:46:03.914066+0000","last_fullsized":"2024-06-02T16:46:03.914066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914317+0000","last_change":"2024-06-02T16:46:03.910134+0000","last_active":"2024-06-02T16:46:03.914317+0000","last_peered":"2024-06-02T16:46:03.914317+0000","last_clean":"2024-06-02T16:46:03.914317+0000","last_became_active":"2024-06-02T16:46:03.909544+0000","last_became_peered":"2024-06-02T16:46:03.909544+0000","last_unstale":"2024-06-02T16:46:03.914317+0000","last_undegraded":"2024-06-02T16:46:03.914317+0000","last_fullsized":"2024-06-02T16:46:03.914317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908187+0000","last_change":"2024-06-02T16:46:03.895902+0000","last_active":"2024-06-02T16:46:03.908187+0000","last_peered":"2024-06-02T16:46:03.908187+0000","last_clean":"2024-06-02T16:46:03.908187+0000","last_became_active":"2024-06-02T16:46:03.895533+0000","last_became_peered":"2024-06-02T16:46:03.895533+0000","last_unstale":"2024-06-02T16:46:03.908187+0000","last_undegraded":"2024-06-02T16:46:03.908187+0000","last_fullsized":"2024-06-02T16:46:03.908187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891820+0000","last_change":"2024-06-02T16:46:03.889132+0000","last_active":"2024-06-02T16:46:03.891820+0000","last_peered":"2024-06-02T16:46:03.891820+0000","last_clean":"2024-06-02T16:46:03.891820+0000","last_became_active":"2024-06-02T16:46:03.888335+0000","last_became_peered":"2024-06-02T16:46:03.888335+0000","last_unstale":"2024-06-02T16:46:03.891820+0000","last_undegraded":"2024-06-02T16:46:03.891820+0000","last_fullsized":"2024-06-02T16:46:03.891820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899970+0000","last_change":"2024-06-02T16:46:03.894665+0000","last_active":"2024-06-02T16:46:03.899970+0000","last_peered":"2024-06-02T16:46:03.899970+0000","last_clean":"2024-06-02T16:46:03.899970+0000","last_became_active":"2024-06-02T16:46:03.894317+0000","last_became_peered":"2024-06-02T16:46:03.894317+0000","last_unstale":"2024-06-02T16:46:03.899970+0000","last_undegraded":"2024-06-02T16:46:03.899970+0000","last_fullsized":"2024-06-02T16:46:03.899970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866006+0000","last_change":"2024-06-02T16:46:02.866006+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866006+0000","last_undegraded":"2024-06-02T16:46:02.866006+0000","last_fullsized":"2024-06-02T16:46:02.866006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902707+0000","last_change":"2024-06-02T16:46:03.896638+0000","last_active":"2024-06-02T16:46:03.902707+0000","last_peered":"2024-06-02T16:46:03.902707+0000","last_clean":"2024-06-02T16:46:03.902707+0000","last_became_active":"2024-06-02T16:46:03.896360+0000","last_became_peered":"2024-06-02T16:46:03.896360+0000","last_unstale":"2024-06-02T16:46:03.902707+0000","last_undegraded":"2024-06-02T16:46:03.902707+0000","last_fullsized":"2024-06-02T16:46:03.902707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914044+0000","last_change":"2024-06-02T16:46:03.904596+0000","last_active":"2024-06-02T16:46:03.914044+0000","last_peered":"2024-06-02T16:46:03.914044+0000","last_clean":"2024-06-02T16:46:03.914044+0000","last_became_active":"2024-06-02T16:46:03.901408+0000","last_became_peered":"2024-06-02T16:46:03.901408+0000","last_unstale":"2024-06-02T16:46:03.914044+0000","last_undegraded":"2024-06-02T16:46:03.914044+0000","last_fullsized":"2024-06-02T16:46:03.914044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868136+0000","last_change":"2024-06-02T16:46:03.903410+0000","last_active":"2024-06-02T16:46:04.868136+0000","last_peered":"2024-06-02T16:46:04.868136+0000","last_clean":"2024-06-02T16:46:04.868136+0000","last_became_active":"2024-06-02T16:46:03.903107+0000","last_became_peered":"2024-06-02T16:46:03.903107+0000","last_unstale":"2024-06-02T16:46:04.868136+0000","last_undegraded":"2024-06-02T16:46:04.868136+0000","last_fullsized":"2024-06-02T16:46:04.868136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901736+0000","last_change":"2024-06-02T16:46:03.895116+0000","last_active":"2024-06-02T16:46:03.901736+0000","last_peered":"2024-06-02T16:46:03.901736+0000","last_clean":"2024-06-02T16:46:03.901736+0000","last_became_active":"2024-06-02T16:46:03.894743+0000","last_became_peered":"2024-06-02T16:46:03.894743+0000","last_unstale":"2024-06-02T16:46:03.901736+0000","last_undegraded":"2024-06-02T16:46:03.901736+0000","last_fullsized":"2024-06-02T16:46:03.901736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867072+0000","last_change":"2024-06-02T16:46:03.914694+0000","last_active":"2024-06-02T16:46:04.867072+0000","last_peered":"2024-06-02T16:46:04.867072+0000","last_clean":"2024-06-02T16:46:04.867072+0000","last_became_active":"2024-06-02T16:46:03.914442+0000","last_became_peered":"2024-06-02T16:46:03.914442+0000","last_unstale":"2024-06-02T16:46:04.867072+0000","last_undegraded":"2024-06-02T16:46:04.867072+0000","last_fullsized":"2024-06-02T16:46:04.867072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.905385+0000","last_change":"2024-06-02T16:46:03.896326+0000","last_active":"2024-06-02T16:46:03.905385+0000","last_peered":"2024-06-02T16:46:03.905385+0000","last_clean":"2024-06-02T16:46:03.905385+0000","last_became_active":"2024-06-02T16:46:03.896032+0000","last_became_peered":"2024-06-02T16:46:03.896032+0000","last_unstale":"2024-06-02T16:46:03.905385+0000","last_undegraded":"2024-06-02T16:46:03.905385+0000","last_fullsized":"2024-06-02T16:46:03.905385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917653+0000","last_change":"2024-06-02T16:46:02.888949+0000","last_active":"2024-06-02T16:46:03.917653+0000","last_peered":"2024-06-02T16:46:03.917653+0000","last_clean":"2024-06-02T16:46:03.917653+0000","last_became_active":"2024-06-02T16:46:02.888543+0000","last_became_peered":"2024-06-02T16:46:02.888543+0000","last_unstale":"2024-06-02T16:46:03.917653+0000","last_undegraded":"2024-06-02T16:46:03.917653+0000","last_fullsized":"2024-06-02T16:46:03.917653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902214+0000","last_change":"2024-06-02T16:46:03.897726+0000","last_active":"2024-06-02T16:46:03.902214+0000","last_peered":"2024-06-02T16:46:03.902214+0000","last_clean":"2024-06-02T16:46:03.902214+0000","last_became_active":"2024-06-02T16:46:03.897418+0000","last_became_peered":"2024-06-02T16:46:03.897418+0000","last_unstale":"2024-06-02T16:46:03.902214+0000","last_undegraded":"2024-06-02T16:46:03.902214+0000","last_fullsized":"2024-06-02T16:46:03.902214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919454+0000","last_change":"2024-06-02T16:46:02.893537+0000","last_active":"2024-06-02T16:46:03.919454+0000","last_peered":"2024-06-02T16:46:03.919454+0000","last_clean":"2024-06-02T16:46:03.919454+0000","last_became_active":"2024-06-02T16:46:02.892005+0000","last_became_peered":"2024-06-02T16:46:02.892005+0000","last_unstale":"2024-06-02T16:46:03.919454+0000","last_undegraded":"2024-06-02T16:46:03.919454+0000","last_fullsized":"2024-06-02T16:46:03.919454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911432+0000","last_change":"2024-06-02T16:46:03.901369+0000","last_active":"2024-06-02T16:46:03.911432+0000","last_peered":"2024-06-02T16:46:03.911432+0000","last_clean":"2024-06-02T16:46:03.911432+0000","last_became_active":"2024-06-02T16:46:03.901096+0000","last_became_peered":"2024-06-02T16:46:03.901096+0000","last_unstale":"2024-06-02T16:46:03.911432+0000","last_undegraded":"2024-06-02T16:46:03.911432+0000","last_fullsized":"2024-06-02T16:46:03.911432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.922973+0000","last_change":"2024-06-02T16:46:02.885969+0000","last_active":"2024-06-02T16:46:03.922973+0000","last_peered":"2024-06-02T16:46:03.922973+0000","last_clean":"2024-06-02T16:46:03.922973+0000","last_became_active":"2024-06-02T16:46:02.885069+0000","last_became_peered":"2024-06-02T16:46:02.885069+0000","last_unstale":"2024-06-02T16:46:03.922973+0000","last_undegraded":"2024-06-02T16:46:03.922973+0000","last_fullsized":"2024-06-02T16:46:03.922973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:18.595331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.864965+0000","last_change":"2024-06-02T16:46:02.864965+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.864965+0000","last_undegraded":"2024-06-02T16:46:02.864965+0000","last_fullsized":"2024-06-02T16:46:02.864965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.919597+0000","last_change":"2024-06-02T16:46:02.884689+0000","last_active":"2024-06-02T16:46:03.919597+0000","last_peered":"2024-06-02T16:46:03.919597+0000","last_clean":"2024-06-02T16:46:03.919597+0000","last_became_active":"2024-06-02T16:46:02.884375+0000","last_became_peered":"2024-06-02T16:46:02.884375+0000","last_unstale":"2024-06-02T16:46:03.919597+0000","last_undegraded":"2024-06-02T16:46:03.919597+0000","last_fullsized":"2024-06-02T16:46:03.919597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:55.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868244+0000","last_change":"2024-06-02T16:46:03.915192+0000","last_active":"2024-06-02T16:46:04.868244+0000","last_peered":"2024-06-02T16:46:04.868244+0000","last_clean":"2024-06-02T16:46:04.868244+0000","last_became_active":"2024-06-02T16:46:03.914914+0000","last_became_peered":"2024-06-02T16:46:03.914914+0000","last_unstale":"2024-06-02T16:46:04.868244+0000","last_undegraded":"2024-06-02T16:46:04.868244+0000","last_fullsized":"2024-06-02T16:46:04.868244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920894+0000","last_change":"2024-06-02T16:46:02.890589+0000","last_active":"2024-06-02T16:46:03.920894+0000","last_peered":"2024-06-02T16:46:03.920894+0000","last_clean":"2024-06-02T16:46:03.920894+0000","last_became_active":"2024-06-02T16:46:02.890352+0000","last_became_peered":"2024-06-02T16:46:02.890352+0000","last_unstale":"2024-06-02T16:46:03.920894+0000","last_undegraded":"2024-06-02T16:46:03.920894+0000","last_fullsized":"2024-06-02T16:46:03.920894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903653+0000","last_change":"2024-06-02T16:46:03.897804+0000","last_active":"2024-06-02T16:46:03.903653+0000","last_peered":"2024-06-02T16:46:03.903653+0000","last_clean":"2024-06-02T16:46:03.903653+0000","last_became_active":"2024-06-02T16:46:03.896250+0000","last_became_peered":"2024-06-02T16:46:03.896250+0000","last_unstale":"2024-06-02T16:46:03.903653+0000","last_undegraded":"2024-06-02T16:46:03.903653+0000","last_fullsized":"2024-06-02T16:46:03.903653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:23.137749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920927+0000","last_change":"2024-06-02T16:46:02.887796+0000","last_active":"2024-06-02T16:46:03.920927+0000","last_peered":"2024-06-02T16:46:03.920927+0000","last_clean":"2024-06-02T16:46:03.920927+0000","last_became_active":"2024-06-02T16:46:02.887447+0000","last_became_peered":"2024-06-02T16:46:02.887447+0000","last_unstale":"2024-06-02T16:46:03.920927+0000","last_undegraded":"2024-06-02T16:46:03.920927+0000","last_fullsized":"2024-06-02T16:46:03.920927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:13.404538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913883+0000","last_change":"2024-06-02T16:46:03.906099+0000","last_active":"2024-06-02T16:46:03.913883+0000","last_peered":"2024-06-02T16:46:03.913883+0000","last_clean":"2024-06-02T16:46:03.913883+0000","last_became_active":"2024-06-02T16:46:03.905768+0000","last_became_peered":"2024-06-02T16:46:03.905768+0000","last_unstale":"2024-06-02T16:46:03.913883+0000","last_undegraded":"2024-06-02T16:46:03.913883+0000","last_fullsized":"2024-06-02T16:46:03.913883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863774+0000","last_change":"2024-06-02T16:46:02.881438+0000","last_active":"2024-06-02T16:46:03.863774+0000","last_peered":"2024-06-02T16:46:03.863774+0000","last_clean":"2024-06-02T16:46:03.863774+0000","last_became_active":"2024-06-02T16:46:02.881163+0000","last_became_peered":"2024-06-02T16:46:02.881163+0000","last_unstale":"2024-06-02T16:46:03.863774+0000","last_undegraded":"2024-06-02T16:46:03.863774+0000","last_fullsized":"2024-06-02T16:46:03.863774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:45.683326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866217+0000","last_change":"2024-06-02T16:46:02.866217+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866217+0000","last_undegraded":"2024-06-02T16:46:02.866217+0000","last_fullsized":"2024-06-02T16:46:02.866217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883516+0000","last_change":"2024-06-02T16:46:02.887974+0000","last_active":"2024-06-02T16:46:03.883516+0000","last_peered":"2024-06-02T16:46:03.883516+0000","last_clean":"2024-06-02T16:46:03.883516+0000","last_became_active":"2024-06-02T16:46:02.887518+0000","last_became_peered":"2024-06-02T16:46:02.887518+0000","last_unstale":"2024-06-02T16:46:03.883516+0000","last_undegraded":"2024-06-02T16:46:03.883516+0000","last_fullsized":"2024-06-02T16:46:03.883516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:41.542744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.892984+0000","last_change":"2024-06-02T16:46:03.889252+0000","last_active":"2024-06-02T16:46:03.892984+0000","last_peered":"2024-06-02T16:46:03.892984+0000","last_clean":"2024-06-02T16:46:03.892984+0000","last_became_active":"2024-06-02T16:46:03.888930+0000","last_became_peered":"2024-06-02T16:46:03.888930+0000","last_unstale":"2024-06-02T16:46:03.892984+0000","last_undegraded":"2024-06-02T16:46:03.892984+0000","last_fullsized":"2024-06-02T16:46:03.892984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.867354+0000","last_change":"2024-06-02T16:46:02.893885+0000","last_active":"2024-06-02T16:46:03.867354+0000","last_peered":"2024-06-02T16:46:03.867354+0000","last_clean":"2024-06-02T16:46:03.867354+0000","last_became_active":"2024-06-02T16:46:02.893025+0000","last_became_peered":"2024-06-02T16:46:02.893025+0000","last_unstale":"2024-06-02T16:46:03.867354+0000","last_undegraded":"2024-06-02T16:46:03.867354+0000","last_fullsized":"2024-06-02T16:46:03.867354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:22.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902602+0000","last_change":"2024-06-02T16:46:03.899191+0000","last_active":"2024-06-02T16:46:03.902602+0000","last_peered":"2024-06-02T16:46:03.902602+0000","last_clean":"2024-06-02T16:46:03.902602+0000","last_became_active":"2024-06-02T16:46:03.898870+0000","last_became_peered":"2024-06-02T16:46:03.898870+0000","last_unstale":"2024-06-02T16:46:03.902602+0000","last_undegraded":"2024-06-02T16:46:03.902602+0000","last_fullsized":"2024-06-02T16:46:03.902602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883777+0000","last_change":"2024-06-02T16:46:02.891514+0000","last_active":"2024-06-02T16:46:03.883777+0000","last_peered":"2024-06-02T16:46:03.883777+0000","last_clean":"2024-06-02T16:46:03.883777+0000","last_became_active":"2024-06-02T16:46:02.890402+0000","last_became_peered":"2024-06-02T16:46:02.890402+0000","last_unstale":"2024-06-02T16:46:03.883777+0000","last_undegraded":"2024-06-02T16:46:03.883777+0000","last_fullsized":"2024-06-02T16:46:03.883777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:43.161036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900457+0000","last_change":"2024-06-02T16:46:03.894968+0000","last_active":"2024-06-02T16:46:03.900457+0000","last_peered":"2024-06-02T16:46:03.900457+0000","last_clean":"2024-06-02T16:46:03.900457+0000","last_became_active":"2024-06-02T16:46:03.894677+0000","last_became_peered":"2024-06-02T16:46:03.894677+0000","last_unstale":"2024-06-02T16:46:03.900457+0000","last_undegraded":"2024-06-02T16:46:03.900457+0000","last_fullsized":"2024-06-02T16:46:03.900457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924967+0000","last_change":"2024-06-02T16:46:02.891663+0000","last_active":"2024-06-02T16:46:03.924967+0000","last_peered":"2024-06-02T16:46:03.924967+0000","last_clean":"2024-06-02T16:46:03.924967+0000","last_became_active":"2024-06-02T16:46:02.891289+0000","last_became_peered":"2024-06-02T16:46:02.891289+0000","last_unstale":"2024-06-02T16:46:03.924967+0000","last_undegraded":"2024-06-02T16:46:03.924967+0000","last_fullsized":"2024-06-02T16:46:03.924967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:50.505687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910059+0000","last_change":"2024-06-02T16:46:03.905722+0000","last_active":"2024-06-02T16:46:03.910059+0000","last_peered":"2024-06-02T16:46:03.910059+0000","last_clean":"2024-06-02T16:46:03.910059+0000","last_became_active":"2024-06-02T16:46:03.904804+0000","last_became_peered":"2024-06-02T16:46:03.904804+0000","last_unstale":"2024-06-02T16:46:03.910059+0000","last_undegraded":"2024-06-02T16:46:03.910059+0000","last_fullsized":"2024-06-02T16:46:03.910059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.927116+0000","last_change":"2024-06-02T16:46:02.891914+0000","last_active":"2024-06-02T16:46:03.927116+0000","last_peered":"2024-06-02T16:46:03.927116+0000","last_clean":"2024-06-02T16:46:03.927116+0000","last_became_active":"2024-06-02T16:46:02.891501+0000","last_became_peered":"2024-06-02T16:46:02.891501+0000","last_unstale":"2024-06-02T16:46:03.927116+0000","last_undegraded":"2024-06-02T16:46:03.927116+0000","last_fullsized":"2024-06-02T16:46:03.927116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:02.020123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.865668+0000","last_change":"2024-06-02T16:46:02.865668+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.865668+0000","last_undegraded":"2024-06-02T16:46:02.865668+0000","last_fullsized":"2024-06-02T16:46:02.865668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917306+0000","last_change":"2024-06-02T16:46:02.884664+0000","last_active":"2024-06-02T16:46:03.917306+0000","last_peered":"2024-06-02T16:46:03.917306+0000","last_clean":"2024-06-02T16:46:03.917306+0000","last_became_active":"2024-06-02T16:46:02.884222+0000","last_became_peered":"2024-06-02T16:46:02.884222+0000","last_unstale":"2024-06-02T16:46:03.917306+0000","last_undegraded":"2024-06-02T16:46:03.917306+0000","last_fullsized":"2024-06-02T16:46:03.917306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.899256+0000","last_change":"2024-06-02T16:46:03.894341+0000","last_active":"2024-06-02T16:46:03.899256+0000","last_peered":"2024-06-02T16:46:03.899256+0000","last_clean":"2024-06-02T16:46:03.899256+0000","last_became_active":"2024-06-02T16:46:03.894036+0000","last_became_peered":"2024-06-02T16:46:03.894036+0000","last_unstale":"2024-06-02T16:46:03.899256+0000","last_undegraded":"2024-06-02T16:46:03.899256+0000","last_fullsized":"2024-06-02T16:46:03.899256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892720+0000","last_change":"2024-06-02T16:46:02.882333+0000","last_active":"2024-06-02T16:46:02.892720+0000","last_peered":"2024-06-02T16:46:02.892720+0000","last_clean":"2024-06-02T16:46:02.892720+0000","last_became_active":"2024-06-02T16:46:02.882046+0000","last_became_peered":"2024-06-02T16:46:02.882046+0000","last_unstale":"2024-06-02T16:46:02.892720+0000","last_undegraded":"2024-06-02T16:46:02.892720+0000","last_fullsized":"2024-06-02T16:46:02.892720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:23:58.943787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867524+0000","last_change":"2024-06-02T16:46:03.905599+0000","last_active":"2024-06-02T16:46:04.867524+0000","last_peered":"2024-06-02T16:46:04.867524+0000","last_clean":"2024-06-02T16:46:04.867524+0000","last_became_active":"2024-06-02T16:46:03.905288+0000","last_became_peered":"2024-06-02T16:46:03.905288+0000","last_unstale":"2024-06-02T16:46:04.867524+0000","last_undegraded":"2024-06-02T16:46:04.867524+0000","last_fullsized":"2024-06-02T16:46:04.867524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.864228+0000","last_change":"2024-06-02T16:46:02.891190+0000","last_active":"2024-06-02T16:46:03.864228+0000","last_peered":"2024-06-02T16:46:03.864228+0000","last_clean":"2024-06-02T16:46:03.864228+0000","last_became_active":"2024-06-02T16:46:02.890783+0000","last_became_peered":"2024-06-02T16:46:02.890783+0000","last_unstale":"2024-06-02T16:46:03.864228+0000","last_undegraded":"2024-06-02T16:46:03.864228+0000","last_fullsized":"2024-06-02T16:46:03.864228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:18.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901713+0000","last_change":"2024-06-02T16:46:03.894216+0000","last_active":"2024-06-02T16:46:03.901713+0000","last_peered":"2024-06-02T16:46:03.901713+0000","last_clean":"2024-06-02T16:46:03.901713+0000","last_became_active":"2024-06-02T16:46:03.893381+0000","last_became_peered":"2024-06-02T16:46:03.893381+0000","last_unstale":"2024-06-02T16:46:03.901713+0000","last_undegraded":"2024-06-02T16:46:03.901713+0000","last_fullsized":"2024-06-02T16:46:03.901713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924708+0000","last_change":"2024-06-02T16:46:02.885194+0000","last_active":"2024-06-02T16:46:03.924708+0000","last_peered":"2024-06-02T16:46:03.924708+0000","last_clean":"2024-06-02T16:46:03.924708+0000","last_became_active":"2024-06-02T16:46:02.884879+0000","last_became_peered":"2024-06-02T16:46:02.884879+0000","last_unstale":"2024-06-02T16:46:03.924708+0000","last_undegraded":"2024-06-02T16:46:03.924708+0000","last_fullsized":"2024-06-02T16:46:03.924708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:51.294201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914109+0000","last_change":"2024-06-02T16:46:03.909612+0000","last_active":"2024-06-02T16:46:03.914109+0000","last_peered":"2024-06-02T16:46:03.914109+0000","last_clean":"2024-06-02T16:46:03.914109+0000","last_became_active":"2024-06-02T16:46:03.909152+0000","last_became_peered":"2024-06-02T16:46:03.909152+0000","last_unstale":"2024-06-02T16:46:03.914109+0000","last_undegraded":"2024-06-02T16:46:03.914109+0000","last_fullsized":"2024-06-02T16:46:03.914109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894265+0000","last_change":"2024-06-02T16:46:02.888602+0000","last_active":"2024-06-02T16:46:02.894265+0000","last_peered":"2024-06-02T16:46:02.894265+0000","last_clean":"2024-06-02T16:46:02.894265+0000","last_became_active":"2024-06-02T16:46:02.887961+0000","last_became_peered":"2024-06-02T16:46:02.887961+0000","last_unstale":"2024-06-02T16:46:02.894265+0000","last_undegraded":"2024-06-02T16:46:02.894265+0000","last_fullsized":"2024-06-02T16:46:02.894265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:05:36.795302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900369+0000","last_change":"2024-06-02T16:46:03.893517+0000","last_active":"2024-06-02T16:46:03.900369+0000","last_peered":"2024-06-02T16:46:03.900369+0000","last_clean":"2024-06-02T16:46:03.900369+0000","last_became_active":"2024-06-02T16:46:03.893145+0000","last_became_peered":"2024-06-02T16:46:03.893145+0000","last_unstale":"2024-06-02T16:46:03.900369+0000","last_undegraded":"2024-06-02T16:46:03.900369+0000","last_fullsized":"2024-06-02T16:46:03.900369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917502+0000","last_change":"2024-06-02T16:46:02.887086+0000","last_active":"2024-06-02T16:46:03.917502+0000","last_peered":"2024-06-02T16:46:03.917502+0000","last_clean":"2024-06-02T16:46:03.917502+0000","last_became_active":"2024-06-02T16:46:02.886357+0000","last_became_peered":"2024-06-02T16:46:02.886357+0000","last_unstale":"2024-06-02T16:46:03.917502+0000","last_undegraded":"2024-06-02T16:46:03.917502+0000","last_fullsized":"2024-06-02T16:46:03.917502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:20.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-06-02T16:46:02.866864+0000","last_change":"2024-06-02T16:46:02.866864+0000","last_active":"2024-06-02T16:46:02.838402+0000","last_peered":"2024-06-02T16:46:02.838402+0000","last_clean":"2024-06-02T16:46:02.838402+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T16:46:02.866864+0000","last_undegraded":"2024-06-02T16:46:02.866864+0000","last_fullsized":"2024-06-02T16:46:02.866864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.918801+0000","last_change":"2024-06-02T16:46:02.888288+0000","last_active":"2024-06-02T16:46:03.918801+0000","last_peered":"2024-06-02T16:46:03.918801+0000","last_clean":"2024-06-02T16:46:03.918801+0000","last_became_active":"2024-06-02T16:46:02.883890+0000","last_became_peered":"2024-06-02T16:46:02.883890+0000","last_unstale":"2024-06-02T16:46:03.918801+0000","last_undegraded":"2024-06-02T16:46:03.918801+0000","last_fullsized":"2024-06-02T16:46:03.918801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913731+0000","last_change":"2024-06-02T16:46:03.906699+0000","last_active":"2024-06-02T16:46:03.913731+0000","last_peered":"2024-06-02T16:46:03.913731+0000","last_clean":"2024-06-02T16:46:03.913731+0000","last_became_active":"2024-06-02T16:46:03.906415+0000","last_became_peered":"2024-06-02T16:46:03.906415+0000","last_unstale":"2024-06-02T16:46:03.913731+0000","last_undegraded":"2024-06-02T16:46:03.913731+0000","last_fullsized":"2024-06-02T16:46:03.913731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:50.238477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.887537+0000","last_change":"2024-06-02T16:46:02.886711+0000","last_active":"2024-06-02T16:46:03.887537+0000","last_peered":"2024-06-02T16:46:03.887537+0000","last_clean":"2024-06-02T16:46:03.887537+0000","last_became_active":"2024-06-02T16:46:02.886377+0000","last_became_peered":"2024-06-02T16:46:02.886377+0000","last_unstale":"2024-06-02T16:46:03.887537+0000","last_undegraded":"2024-06-02T16:46:03.887537+0000","last_fullsized":"2024-06-02T16:46:03.887537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:38.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.916407+0000","last_change":"2024-06-02T16:46:03.910758+0000","last_active":"2024-06-02T16:46:03.916407+0000","last_peered":"2024-06-02T16:46:03.916407+0000","last_clean":"2024-06-02T16:46:03.916407+0000","last_became_active":"2024-06-02T16:46:03.910435+0000","last_became_peered":"2024-06-02T16:46:03.910435+0000","last_unstale":"2024-06-02T16:46:03.916407+0000","last_undegraded":"2024-06-02T16:46:03.916407+0000","last_fullsized":"2024-06-02T16:46:03.916407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:21.623342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920139+0000","last_change":"2024-06-02T16:46:02.883493+0000","last_active":"2024-06-02T16:46:03.920139+0000","last_peered":"2024-06-02T16:46:03.920139+0000","last_clean":"2024-06-02T16:46:03.920139+0000","last_became_active":"2024-06-02T16:46:02.880100+0000","last_became_peered":"2024-06-02T16:46:02.880100+0000","last_unstale":"2024-06-02T16:46:03.920139+0000","last_undegraded":"2024-06-02T16:46:03.920139+0000","last_fullsized":"2024-06-02T16:46:03.920139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:02.344035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914028+0000","last_change":"2024-06-02T16:46:03.907359+0000","last_active":"2024-06-02T16:46:03.914028+0000","last_peered":"2024-06-02T16:46:03.914028+0000","last_clean":"2024-06-02T16:46:03.914028+0000","last_became_active":"2024-06-02T16:46:03.906700+0000","last_became_peered":"2024-06-02T16:46:03.906700+0000","last_unstale":"2024-06-02T16:46:03.914028+0000","last_undegraded":"2024-06-02T16:46:03.914028+0000","last_fullsized":"2024-06-02T16:46:03.914028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:39.424200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.877454+0000","last_change":"2024-06-02T16:46:02.895540+0000","last_active":"2024-06-02T16:46:03.877454+0000","last_peered":"2024-06-02T16:46:03.877454+0000","last_clean":"2024-06-02T16:46:03.877454+0000","last_became_active":"2024-06-02T16:46:02.895129+0000","last_became_peered":"2024-06-02T16:46:02.895129+0000","last_unstale":"2024-06-02T16:46:03.877454+0000","last_undegraded":"2024-06-02T16:46:03.877454+0000","last_fullsized":"2024-06-02T16:46:03.877454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904670+0000","last_change":"2024-06-02T16:46:03.895347+0000","last_active":"2024-06-02T16:46:03.904670+0000","last_peered":"2024-06-02T16:46:03.904670+0000","last_clean":"2024-06-02T16:46:03.904670+0000","last_became_active":"2024-06-02T16:46:03.894742+0000","last_became_peered":"2024-06-02T16:46:03.894742+0000","last_unstale":"2024-06-02T16:46:03.904670+0000","last_undegraded":"2024-06-02T16:46:03.904670+0000","last_fullsized":"2024-06-02T16:46:03.904670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:16.294203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883547+0000","last_change":"2024-06-02T16:46:02.882260+0000","last_active":"2024-06-02T16:46:03.883547+0000","last_peered":"2024-06-02T16:46:03.883547+0000","last_clean":"2024-06-02T16:46:03.883547+0000","last_became_active":"2024-06-02T16:46:02.875091+0000","last_became_peered":"2024-06-02T16:46:02.875091+0000","last_unstale":"2024-06-02T16:46:03.883547+0000","last_undegraded":"2024-06-02T16:46:03.883547+0000","last_fullsized":"2024-06-02T16:46:03.883547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:02.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867216+0000","last_change":"2024-06-02T16:46:03.899743+0000","last_active":"2024-06-02T16:46:04.867216+0000","last_peered":"2024-06-02T16:46:04.867216+0000","last_clean":"2024-06-02T16:46:04.867216+0000","last_became_active":"2024-06-02T16:46:03.899449+0000","last_became_peered":"2024-06-02T16:46:03.899449+0000","last_unstale":"2024-06-02T16:46:04.867216+0000","last_undegraded":"2024-06-02T16:46:04.867216+0000","last_fullsized":"2024-06-02T16:46:04.867216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.874810+0000","last_change":"2024-06-02T16:46:02.890214+0000","last_active":"2024-06-02T16:46:03.874810+0000","last_peered":"2024-06-02T16:46:03.874810+0000","last_clean":"2024-06-02T16:46:03.874810+0000","last_became_active":"2024-06-02T16:46:02.889874+0000","last_became_peered":"2024-06-02T16:46:02.889874+0000","last_unstale":"2024-06-02T16:46:03.874810+0000","last_undegraded":"2024-06-02T16:46:03.874810+0000","last_fullsized":"2024-06-02T16:46:03.874810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:01.204300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906101+0000","last_change":"2024-06-02T16:46:03.901073+0000","last_active":"2024-06-02T16:46:03.906101+0000","last_peered":"2024-06-02T16:46:03.906101+0000","last_clean":"2024-06-02T16:46:03.906101+0000","last_became_active":"2024-06-02T16:46:03.890045+0000","last_became_peered":"2024-06-02T16:46:03.890045+0000","last_unstale":"2024-06-02T16:46:03.906101+0000","last_undegraded":"2024-06-02T16:46:03.906101+0000","last_fullsized":"2024-06-02T16:46:03.906101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:42.549209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.888570+0000","last_change":"2024-06-02T16:46:02.883504+0000","last_active":"2024-06-02T16:46:02.888570+0000","last_peered":"2024-06-02T16:46:02.888570+0000","last_clean":"2024-06-02T16:46:02.888570+0000","last_became_active":"2024-06-02T16:46:02.883177+0000","last_became_peered":"2024-06-02T16:46:02.883177+0000","last_unstale":"2024-06-02T16:46:02.888570+0000","last_undegraded":"2024-06-02T16:46:02.888570+0000","last_fullsized":"2024-06-02T16:46:02.888570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:42:21.241624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907648+0000","last_change":"2024-06-02T16:46:03.903394+0000","last_active":"2024-06-02T16:46:03.907648+0000","last_peered":"2024-06-02T16:46:03.907648+0000","last_clean":"2024-06-02T16:46:03.907648+0000","last_became_active":"2024-06-02T16:46:03.902987+0000","last_became_peered":"2024-06-02T16:46:03.902987+0000","last_unstale":"2024-06-02T16:46:03.907648+0000","last_undegraded":"2024-06-02T16:46:03.907648+0000","last_fullsized":"2024-06-02T16:46:03.907648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883295+0000","last_change":"2024-06-02T16:46:02.890382+0000","last_active":"2024-06-02T16:46:03.883295+0000","last_peered":"2024-06-02T16:46:03.883295+0000","last_clean":"2024-06-02T16:46:03.883295+0000","last_became_active":"2024-06-02T16:46:02.890074+0000","last_became_peered":"2024-06-02T16:46:02.890074+0000","last_unstale":"2024-06-02T16:46:03.883295+0000","last_undegraded":"2024-06-02T16:46:03.883295+0000","last_fullsized":"2024-06-02T16:46:03.883295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.906250+0000","last_change":"2024-06-02T16:46:03.899253+0000","last_active":"2024-06-02T16:46:03.906250+0000","last_peered":"2024-06-02T16:46:03.906250+0000","last_clean":"2024-06-02T16:46:03.906250+0000","last_became_active":"2024-06-02T16:46:03.898932+0000","last_became_peered":"2024-06-02T16:46:03.898932+0000","last_unstale":"2024-06-02T16:46:03.906250+0000","last_undegraded":"2024-06-02T16:46:03.906250+0000","last_fullsized":"2024-06-02T16:46:03.906250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.892087+0000","last_change":"2024-06-02T16:46:02.885176+0000","last_active":"2024-06-02T16:46:02.892087+0000","last_peered":"2024-06-02T16:46:02.892087+0000","last_clean":"2024-06-02T16:46:02.892087+0000","last_became_active":"2024-06-02T16:46:02.884863+0000","last_became_peered":"2024-06-02T16:46:02.884863+0000","last_unstale":"2024-06-02T16:46:02.892087+0000","last_undegraded":"2024-06-02T16:46:02.892087+0000","last_fullsized":"2024-06-02T16:46:02.892087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:59:34.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901094+0000","last_change":"2024-06-02T16:46:03.896244+0000","last_active":"2024-06-02T16:46:03.901094+0000","last_peered":"2024-06-02T16:46:03.901094+0000","last_clean":"2024-06-02T16:46:03.901094+0000","last_became_active":"2024-06-02T16:46:03.895899+0000","last_became_peered":"2024-06-02T16:46:03.895899+0000","last_unstale":"2024-06-02T16:46:03.901094+0000","last_undegraded":"2024-06-02T16:46:03.901094+0000","last_fullsized":"2024-06-02T16:46:03.901094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.886144+0000","last_change":"2024-06-02T16:46:02.882808+0000","last_active":"2024-06-02T16:46:03.886144+0000","last_peered":"2024-06-02T16:46:03.886144+0000","last_clean":"2024-06-02T16:46:03.886144+0000","last_became_active":"2024-06-02T16:46:02.882515+0000","last_became_peered":"2024-06-02T16:46:02.882515+0000","last_unstale":"2024-06-02T16:46:03.886144+0000","last_undegraded":"2024-06-02T16:46:03.886144+0000","last_fullsized":"2024-06-02T16:46:03.886144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:05.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.908603+0000","last_change":"2024-06-02T16:46:03.902214+0000","last_active":"2024-06-02T16:46:03.908603+0000","last_peered":"2024-06-02T16:46:03.908603+0000","last_clean":"2024-06-02T16:46:03.908603+0000","last_became_active":"2024-06-02T16:46:03.901873+0000","last_became_peered":"2024-06-02T16:46:03.901873+0000","last_unstale":"2024-06-02T16:46:03.908603+0000","last_undegraded":"2024-06-02T16:46:03.908603+0000","last_fullsized":"2024-06-02T16:46:03.908603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-06-02T16:46:02.894545+0000","last_change":"2024-06-02T16:46:02.890723+0000","last_active":"2024-06-02T16:46:02.894545+0000","last_peered":"2024-06-02T16:46:02.894545+0000","last_clean":"2024-06-02T16:46:02.894545+0000","last_became_active":"2024-06-02T16:46:02.889856+0000","last_became_peered":"2024-06-02T16:46:02.889856+0000","last_unstale":"2024-06-02T16:46:02.894545+0000","last_undegraded":"2024-06-02T16:46:02.894545+0000","last_fullsized":"2024-06-02T16:46:02.894545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:31.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.904734+0000","last_change":"2024-06-02T16:46:03.902323+0000","last_active":"2024-06-02T16:46:03.904734+0000","last_peered":"2024-06-02T16:46:03.904734+0000","last_clean":"2024-06-02T16:46:03.904734+0000","last_became_active":"2024-06-02T16:46:03.901882+0000","last_became_peered":"2024-06-02T16:46:03.901882+0000","last_unstale":"2024-06-02T16:46:03.904734+0000","last_undegraded":"2024-06-02T16:46:03.904734+0000","last_fullsized":"2024-06-02T16:46:03.904734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.885236+0000","last_change":"2024-06-02T16:46:02.884578+0000","last_active":"2024-06-02T16:46:03.885236+0000","last_peered":"2024-06-02T16:46:03.885236+0000","last_clean":"2024-06-02T16:46:03.885236+0000","last_became_active":"2024-06-02T16:46:02.882715+0000","last_became_peered":"2024-06-02T16:46:02.882715+0000","last_unstale":"2024-06-02T16:46:03.885236+0000","last_undegraded":"2024-06-02T16:46:03.885236+0000","last_fullsized":"2024-06-02T16:46:03.885236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:49.232011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911131+0000","last_change":"2024-06-02T16:46:03.892141+0000","last_active":"2024-06-02T16:46:03.911131+0000","last_peered":"2024-06-02T16:46:03.911131+0000","last_clean":"2024-06-02T16:46:03.911131+0000","last_became_active":"2024-06-02T16:46:03.891420+0000","last_became_peered":"2024-06-02T16:46:03.891420+0000","last_unstale":"2024-06-02T16:46:03.911131+0000","last_undegraded":"2024-06-02T16:46:03.911131+0000","last_fullsized":"2024-06-02T16:46:03.911131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.863684+0000","last_change":"2024-06-02T16:46:02.892674+0000","last_active":"2024-06-02T16:46:03.863684+0000","last_peered":"2024-06-02T16:46:03.863684+0000","last_clean":"2024-06-02T16:46:03.863684+0000","last_became_active":"2024-06-02T16:46:02.890747+0000","last_became_peered":"2024-06-02T16:46:02.890747+0000","last_unstale":"2024-06-02T16:46:03.863684+0000","last_undegraded":"2024-06-02T16:46:03.863684+0000","last_fullsized":"2024-06-02T16:46:03.863684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:10.440456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868386+0000","last_change":"2024-06-02T16:46:03.916186+0000","last_active":"2024-06-02T16:46:04.868386+0000","last_peered":"2024-06-02T16:46:04.868386+0000","last_clean":"2024-06-02T16:46:04.868386+0000","last_became_active":"2024-06-02T16:46:03.915623+0000","last_became_peered":"2024-06-02T16:46:03.915623+0000","last_unstale":"2024-06-02T16:46:04.868386+0000","last_undegraded":"2024-06-02T16:46:04.868386+0000","last_fullsized":"2024-06-02T16:46:04.868386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.876609+0000","last_change":"2024-06-02T16:46:02.892101+0000","last_active":"2024-06-02T16:46:03.876609+0000","last_peered":"2024-06-02T16:46:03.876609+0000","last_clean":"2024-06-02T16:46:03.876609+0000","last_became_active":"2024-06-02T16:46:02.891745+0000","last_became_peered":"2024-06-02T16:46:02.891745+0000","last_unstale":"2024-06-02T16:46:03.876609+0000","last_undegraded":"2024-06-02T16:46:03.876609+0000","last_fullsized":"2024-06-02T16:46:03.876609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867868+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:46:04.867868+0000","last_peered":"2024-06-02T16:46:04.867868+0000","last_clean":"2024-06-02T16:46:04.867868+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:46:04.867868+0000","last_undegraded":"2024-06-02T16:46:04.867868+0000","last_fullsized":"2024-06-02T16:46:04.867868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":733877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":143523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":136644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":727012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":130377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.870067+0000', 'last_change': '2024-06-02T16:46:02.870067+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.870067+0000', 'last_undegraded': '2024-06-02T16:46:02.870067+0000', 'last_fullsized': '2024-06-02T16:46:02.870067+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.865396+0000', 'last_change': '2024-06-02T16:46:02.865396+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.865396+0000', 'last_undegraded': '2024-06-02T16:46:02.865396+0000', 'last_fullsized': '2024-06-02T16:46:02.865396+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.866217+0000', 'last_change': '2024-06-02T16:46:02.866217+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.866217+0000', 'last_undegraded': '2024-06-02T16:46:02.866217+0000', 'last_fullsized': '2024-06-02T16:46:02.866217+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.866006+0000', 'last_change': '2024-06-02T16:46:02.866006+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.866006+0000', 'last_undegraded': '2024-06-02T16:46:02.866006+0000', 'last_fullsized': '2024-06-02T16:46:02.866006+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-06-02T16:46:09.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.864965+0000', 'last_change': '2024-06-02T16:46:02.864965+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.864965+0000', 'last_undegraded': '2024-06-02T16:46:02.864965+0000', 'last_fullsized': '2024-06-02T16:46:02.864965+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.866217+0000', 'last_change': '2024-06-02T16:46:02.866217+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.866217+0000', 'last_undegraded': '2024-06-02T16:46:02.866217+0000', 'last_fullsized': '2024-06-02T16:46:02.866217+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.865668+0000', 'last_change': '2024-06-02T16:46:02.865668+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.865668+0000', 'last_undegraded': '2024-06-02T16:46:02.865668+0000', 'last_fullsized': '2024-06-02T16:46:02.865668+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-06-02T16:46:09.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-06-02T16:46:02.866864+0000', 'last_change': '2024-06-02T16:46:02.866864+0000', 'last_active': '2024-06-02T16:46:02.838402+0000', 'last_peered': '2024-06-02T16:46:02.838402+0000', 'last_clean': '2024-06-02T16:46:02.838402+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T16:46:02.866864+0000', 'last_undegraded': '2024-06-02T16:46:02.866864+0000', 'last_fullsized': '2024-06-02T16:46:02.866864+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'last_clean_scrub_stamp': '2024-06-02T16:46:02.838402+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T16:46:09.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-02T16:46:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.681+0000 7f4097e00640 1 Processor -- start 2024-06-02T16:46:09.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.681+0000 7f4097e00640 1 -- start start 2024-06-02T16:46:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.682+0000 7f4097e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40980b6c50 0x7f40980bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.682+0000 7f4097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40980b7030 0x7f409806d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f40980d3aa0 con 0x7f40980b7030 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f409815f7a0 con 0x7f40980b6c50 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f40980d3d00 con 0x7f40980d4da0 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40980b7030 0x7f409806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40980b7030 0x7f409806d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36484/0 (socket says 172.21.15.52:36484) 2024-06-02T16:46:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4097400640 1 -- 172.21.15.52:0/933121122 learned_addr learned my addr 172.21.15.52:0/933121122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4096a00640 1 --2- 172.21.15.52:0/933121122 >> v2:172.21.15.114:3300/0 conn(0x7f40980b6c50 0x7f40980bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.683+0000 7f4096000640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.684+0000 7f4097400640 1 -- 172.21.15.52:0/933121122 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 msgr2=0x7f40980d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.684+0000 7f4097400640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980d3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.684+0000 7f4097400640 1 -- 172.21.15.52:0/933121122 >> v2:172.21.15.114:3300/0 conn(0x7f40980b6c50 msgr2=0x7f40980bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.684+0000 7f4097400640 1 --2- 172.21.15.52:0/933121122 >> v2:172.21.15.114:3300/0 conn(0x7f40980b6c50 0x7f40980bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.684+0000 7f4097400640 1 -- 172.21.15.52:0/933121122 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40980d3fe0 con 0x7f40980b7030 2024-06-02T16:46:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.685+0000 7f4097400640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b7030 0x7f409806d380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40980d2b60 tx=0x7f409002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cc43234b690445 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.685+0000 7f4095600640 1 -- 172.21.15.52:0/933121122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090037070 con 0x7f40980b7030 2024-06-02T16:46:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.685+0000 7f4095600640 1 -- 172.21.15.52:0/933121122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4090032440 con 0x7f40980b7030 2024-06-02T16:46:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.685+0000 7f4095600640 1 -- 172.21.15.52:0/933121122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090032810 con 0x7f40980b7030 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 -- 172.21.15.52:0/933121122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b7030 msgr2=0x7f409806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b7030 0x7f409806d380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40980d2b60 tx=0x7f409002a1e0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 -- 172.21.15.52:0/933121122 shutdown_connections 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 --2- 172.21.15.52:0/933121122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b7030 0x7f409806d380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 --2- 172.21.15.52:0/933121122 >> v2:172.21.15.114:3300/0 conn(0x7f40980b6c50 0x7f40980bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 -- 172.21.15.52:0/933121122 >> 172.21.15.52:0/933121122 conn(0x7f40980740e0 msgr2=0x7f40980d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 -- 172.21.15.52:0/933121122 shutdown_connections 2024-06-02T16:46:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.686+0000 7f4097e00640 1 -- 172.21.15.52:0/933121122 wait complete. 2024-06-02T16:46:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.688+0000 7f4097e00640 1 Processor -- start 2024-06-02T16:46:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.688+0000 7f4097e00640 1 -- start start 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40980b7030 0x7f40980cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40980d4880 con 0x7f40980b6c50 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f40980d45a0 con 0x7f40980b7030 2024-06-02T16:46:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4097e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f40980b7480 con 0x7f40980d4da0 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4096a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4096a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36492/0 (socket says 172.21.15.52:36492) 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.689+0000 7f4096a00640 1 -- 172.21.15.52:0/2701049745 learned_addr learned my addr 172.21.15.52:0/2701049745 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096000640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40980b7030 0x7f40980cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 -- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 msgr2=0x7f40980abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 -- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40980b7030 msgr2=0x7f40980cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40980b7030 0x7f40980cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 -- 172.21.15.52:0/2701049745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40980cde40 con 0x7f40980b6c50 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4096a00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4088007e90 tx=0x7f408800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088014420 con 0x7f40980b6c50 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4088019070 con 0x7f40980b6c50 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.690+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40980ce120 con 0x7f40980b6c50 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.691+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40880147e0 con 0x7f40980b6c50 2024-06-02T16:46:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.691+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40980ce6e0 con 0x7f40980b6c50 2024-06-02T16:46:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.692+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40980507e0 con 0x7f40980b6c50 2024-06-02T16:46:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.693+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4088014980 con 0x7f40980b6c50 2024-06-02T16:46:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.694+0000 7f408ea00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 0x7f4074078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.694+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f4088097e00 con 0x7f40980b6c50 2024-06-02T16:46:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.695+0000 7f4096000640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 0x7f4074078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.696+0000 7f4096000640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 0x7f4074078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40980b3930 tx=0x7f4080008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:09.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.699+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4088061750 con 0x7f40980b6c50 2024-06-02T16:46:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.984+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f40980cd0e0 con 0x7f40980b6c50 2024-06-02T16:46:09.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.984+0000 7f408ea00640 1 -- 172.21.15.52:0/2701049745 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1646 (secure 0 0 0) 0x7f4088061050 con 0x7f40980b6c50 2024-06-02T16:46:09.983 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:09.983 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1717346699,"num_in_osds":8,"osd_in_since":1717346689,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"creating+peering","count":8}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592756,"bytes_used":242532352,"bytes_avail":772851580928,"bytes_total":773094113280,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":2217,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4740}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-02T16:46:02.009862+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 msgr2=0x7f4074078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 0x7f4074078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40980b3930 tx=0x7f4080008040 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 msgr2=0x7f40981548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4088007e90 tx=0x7f408800e4b0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 shutdown_connections 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f40740762d0 0x7f4074078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40980d4da0 0x7f40980abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40980b7030 0x7f40980cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 --2- 172.21.15.52:0/2701049745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40980b6c50 0x7f40981548d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 >> 172.21.15.52:0/2701049745 conn(0x7f40980740e0 msgr2=0x7f40980b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 shutdown_connections 2024-06-02T16:46:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:09.987+0000 7f4097e00640 1 -- 172.21.15.52:0/2701049745 wait complete. 2024-06-02T16:46:10.004 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-02T16:46:10.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:46:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.210+0000 7f560f200640 1 Processor -- start 2024-06-02T16:46:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.210+0000 7f560f200640 1 -- start start 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f561015cce0 0x7f561006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56101604d0 0x7f561006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5610162e10 0x7f56101632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5610163800 con 0x7f561015cce0 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f561015fa10 con 0x7f5610162e10 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.212+0000 7f560f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5610163ab0 con 0x7f56101604d0 2024-06-02T16:46:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f561015cce0 0x7f561006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f561015cce0 0x7f561006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36496/0 (socket says 172.21.15.52:36496) 2024-06-02T16:46:10.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 -- 172.21.15.52:0/2431800027 learned_addr learned my addr 172.21.15.52:0/2431800027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:10.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560e800640 1 --2- 172.21.15.52:0/2431800027 >> v2:172.21.15.114:3300/0 conn(0x7f5610162e10 0x7f56101632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560d400640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56101604d0 0x7f561006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 -- 172.21.15.52:0/2431800027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56101604d0 msgr2=0x7f561006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56101604d0 0x7f561006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 -- 172.21.15.52:0/2431800027 >> v2:172.21.15.114:3300/0 conn(0x7f5610162e10 msgr2=0x7f56101632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 --2- 172.21.15.52:0/2431800027 >> v2:172.21.15.114:3300/0 conn(0x7f5610162e10 0x7f56101632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.213+0000 7f560de00640 1 -- 172.21.15.52:0/2431800027 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561015fcd0 con 0x7f561015cce0 2024-06-02T16:46:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.215+0000 7f560de00640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f561015cce0 0x7f561006e130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f56100b6560 tx=0x7f55f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e54dc9c116cf00a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.215+0000 7f560ca00640 1 -- 172.21.15.52:0/2431800027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8037070 con 0x7f561015cce0 2024-06-02T16:46:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.215+0000 7f560ca00640 1 -- 172.21.15.52:0/2431800027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f8032440 con 0x7f561015cce0 2024-06-02T16:46:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.215+0000 7f560ca00640 1 -- 172.21.15.52:0/2431800027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8032810 con 0x7f561015cce0 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 -- 172.21.15.52:0/2431800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f561015cce0 msgr2=0x7f561006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f561015cce0 0x7f561006e130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f56100b6560 tx=0x7f55f802a1e0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 -- 172.21.15.52:0/2431800027 shutdown_connections 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56101604d0 0x7f561006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 --2- 172.21.15.52:0/2431800027 >> v2:172.21.15.114:3300/0 conn(0x7f5610162e10 0x7f56101632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 --2- 172.21.15.52:0/2431800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f561015cce0 0x7f561006e130 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 -- 172.21.15.52:0/2431800027 >> 172.21.15.52:0/2431800027 conn(0x7f561006c380 msgr2=0x7f561006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 -- 172.21.15.52:0/2431800027 shutdown_connections 2024-06-02T16:46:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.216+0000 7f560f200640 1 -- 172.21.15.52:0/2431800027 wait complete. 2024-06-02T16:46:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.219+0000 7f560f200640 1 Processor -- start 2024-06-02T16:46:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.219+0000 7f560f200640 1 -- start start 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f561015cce0 0x7f561015d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5610162e10 0x7f56100cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56100ae830 con 0x7f56101604d0 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f561015d0c0 con 0x7f5610162e10 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.220+0000 7f560f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f56100ae9b0 con 0x7f561015cce0 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36510/0 (socket says 172.21.15.52:36510) 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 -- 172.21.15.52:0/3539932530 learned_addr learned my addr 172.21.15.52:0/3539932530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560de00640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f561015cce0 0x7f561015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560e800640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5610162e10 0x7f56100cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 -- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f561015cce0 msgr2=0x7f561015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f561015cce0 0x7f561015d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 -- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5610162e10 msgr2=0x7f56100cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5610162e10 0x7f56100cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.221+0000 7f560d400640 1 -- 172.21.15.52:0/3539932530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561013b0e0 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f560d400640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f560000d800 tx=0x7f560000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560000b6c0 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5600019070 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560000ba80 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56100ce410 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.222+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56100ce9d0 con 0x7f56101604d0 2024-06-02T16:46:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.223+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56100507e0 con 0x7f56101604d0 2024-06-02T16:46:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.225+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f560000bc20 con 0x7f56101604d0 2024-06-02T16:46:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.225+0000 7f5606000640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 0x7f55ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.226+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5600097ab0 con 0x7f56101604d0 2024-06-02T16:46:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.226+0000 7f560de00640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 0x7f55ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:10.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.227+0000 7f560de00640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 0x7f55ec078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55f8034000 tx=0x7f55f802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.230+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5600061400 con 0x7f56101604d0 2024-06-02T16:46:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.432+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56100b3ee0 con 0x7f55ec0762d0 2024-06-02T16:46:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.451+0000 7f5606000640 1 -- 172.21.15.52:0/3539932530 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f56100b3ee0 con 0x7f55ec0762d0 2024-06-02T16:46:10.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:10.457 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 msgr2=0x7f55ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 0x7f55ec078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55f8034000 tx=0x7f55f802e000 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 msgr2=0x7f56100cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f560000d800 tx=0x7f560000dcc0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 shutdown_connections 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f55ec0762d0 0x7f55ec078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5610162e10 0x7f56100cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56101604d0 0x7f56100cd8a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 --2- 172.21.15.52:0/3539932530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f561015cce0 0x7f561015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 >> 172.21.15.52:0/3539932530 conn(0x7f561006c380 msgr2=0x7f561015e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 shutdown_connections 2024-06-02T16:46:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:10.456+0000 7f560f200640 1 -- 172.21.15.52:0/3539932530 wait complete. 2024-06-02T16:46:10.475 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-06-02T16:46:10.012602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237000,"kb_used_data":4184,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737720,"statfs":{"total":773094113280,"available":772851425280,"internally_reserved":0,"allocated":4284416,"data_stored":2358108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.154650"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902594+0000","last_change":"2024-06-02T16:46:03.899601+0000","last_active":"2024-06-02T16:46:03.902594+0000","last_peered":"2024-06-02T16:46:03.902594+0000","last_clean":"2024-06-02T16:46:03.902594+0000","last_became_active":"2024-06-02T16:46:03.899249+0000","last_became_peered":"2024-06-02T16:46:03.899249+0000","last_unstale":"2024-06-02T16:46:03.902594+0000","last_undegraded":"2024-06-02T16:46:03.902594+0000","last_fullsized":"2024-06-02T16:46:03.902594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864289+0000","last_change":"2024-06-02T16:46:03.893509+0000","last_active":"2024-06-02T16:46:04.864289+0000","last_peered":"2024-06-02T16:46:04.864289+0000","last_clean":"2024-06-02T16:46:04.864289+0000","last_became_active":"2024-06-02T16:46:03.893090+0000","last_became_peered":"2024-06-02T16:46:03.893090+0000","last_unstale":"2024-06-02T16:46:04.864289+0000","last_undegraded":"2024-06-02T16:46:04.864289+0000","last_fullsized":"2024-06-02T16:46:04.864289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:14:46.311181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910086+0000","last_change":"2024-06-02T16:46:03.906471+0000","last_active":"2024-06-02T16:46:03.910086+0000","last_peered":"2024-06-02T16:46:03.910086+0000","last_clean":"2024-06-02T16:46:03.910086+0000","last_became_active":"2024-06-02T16:46:03.904044+0000","last_became_peered":"2024-06-02T16:46:03.904044+0000","last_unstale":"2024-06-02T16:46:03.910086+0000","last_undegraded":"2024-06-02T16:46:03.910086+0000","last_fullsized":"2024-06-02T16:46:03.910086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906673+0000","last_change":"2024-06-02T16:46:03.915749+0000","last_active":"2024-06-02T16:46:04.906673+0000","last_peered":"2024-06-02T16:46:04.906673+0000","last_clean":"2024-06-02T16:46:04.906673+0000","last_became_active":"2024-06-02T16:46:03.915290+0000","last_became_peered":"2024-06-02T16:46:03.915290+0000","last_unstale":"2024-06-02T16:46:04.906673+0000","last_undegraded":"2024-06-02T16:46:04.906673+0000","last_fullsized":"2024-06-02T16:46:04.906673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:35:14.071460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368147+0000","last_change":"2024-06-02T16:46:03.886231+0000","last_active":"2024-06-02T16:46:05.368147+0000","last_peered":"2024-06-02T16:46:05.368147+0000","last_clean":"2024-06-02T16:46:05.368147+0000","last_became_active":"2024-06-02T16:46:03.884590+0000","last_became_peered":"2024-06-02T16:46:03.884590+0000","last_unstale":"2024-06-02T16:46:05.368147+0000","last_undegraded":"2024-06-02T16:46:05.368147+0000","last_fullsized":"2024-06-02T16:46:05.368147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:14.411004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863697+0000","last_change":"2024-06-02T16:46:03.890058+0000","last_active":"2024-06-02T16:46:04.863697+0000","last_peered":"2024-06-02T16:46:04.863697+0000","last_clean":"2024-06-02T16:46:04.863697+0000","last_became_active":"2024-06-02T16:46:03.889655+0000","last_became_peered":"2024-06-02T16:46:03.889655+0000","last_unstale":"2024-06-02T16:46:04.863697+0000","last_undegraded":"2024-06-02T16:46:04.863697+0000","last_fullsized":"2024-06-02T16:46:04.863697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:25.447402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867638+0000","last_change":"2024-06-02T16:46:03.900580+0000","last_active":"2024-06-02T16:46:04.867638+0000","last_peered":"2024-06-02T16:46:04.867638+0000","last_clean":"2024-06-02T16:46:04.867638+0000","last_became_active":"2024-06-02T16:46:03.899640+0000","last_became_peered":"2024-06-02T16:46:03.899640+0000","last_unstale":"2024-06-02T16:46:04.867638+0000","last_undegraded":"2024-06-02T16:46:04.867638+0000","last_fullsized":"2024-06-02T16:46:04.867638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867223+0000","last_change":"2024-06-02T16:46:03.908391+0000","last_active":"2024-06-02T16:46:04.867223+0000","last_peered":"2024-06-02T16:46:04.867223+0000","last_clean":"2024-06-02T16:46:04.867223+0000","last_became_active":"2024-06-02T16:46:03.907935+0000","last_became_peered":"2024-06-02T16:46:03.907935+0000","last_unstale":"2024-06-02T16:46:04.867223+0000","last_undegraded":"2024-06-02T16:46:04.867223+0000","last_fullsized":"2024-06-02T16:46:04.867223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913926+0000","last_change":"2024-06-02T16:46:03.909678+0000","last_active":"2024-06-02T16:46:03.913926+0000","last_peered":"2024-06-02T16:46:03.913926+0000","last_clean":"2024-06-02T16:46:03.913926+0000","last_became_active":"2024-06-02T16:46:03.905007+0000","last_became_peered":"2024-06-02T16:46:03.905007+0000","last_unstale":"2024-06-02T16:46:03.913926+0000","last_undegraded":"2024-06-02T16:46:03.913926+0000","last_fullsized":"2024-06-02T16:46:03.913926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906905+0000","last_change":"2024-06-02T16:46:03.904815+0000","last_active":"2024-06-02T16:46:04.906905+0000","last_peered":"2024-06-02T16:46:04.906905+0000","last_clean":"2024-06-02T16:46:04.906905+0000","last_became_active":"2024-06-02T16:46:03.904505+0000","last_became_peered":"2024-06-02T16:46:03.904505+0000","last_unstale":"2024-06-02T16:46:04.906905+0000","last_undegraded":"2024-06-02T16:46:04.906905+0000","last_fullsized":"2024-06-02T16:46:04.906905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:29:48.997246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868493+0000","last_change":"2024-06-02T16:46:03.897768+0000","last_active":"2024-06-02T16:46:04.868493+0000","last_peered":"2024-06-02T16:46:04.868493+0000","last_clean":"2024-06-02T16:46:04.868493+0000","last_became_active":"2024-06-02T16:46:03.897473+0000","last_became_peered":"2024-06-02T16:46:03.897473+0000","last_unstale":"2024-06-02T16:46:04.868493+0000","last_undegraded":"2024-06-02T16:46:04.868493+0000","last_fullsized":"2024-06-02T16:46:04.868493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900481+0000","last_change":"2024-06-02T16:46:03.893747+0000","last_active":"2024-06-02T16:46:03.900481+0000","last_peered":"2024-06-02T16:46:03.900481+0000","last_clean":"2024-06-02T16:46:03.900481+0000","last_became_active":"2024-06-02T16:46:03.893457+0000","last_became_peered":"2024-06-02T16:46:03.893457+0000","last_unstale":"2024-06-02T16:46:03.900481+0000","last_undegraded":"2024-06-02T16:46:03.900481+0000","last_fullsized":"2024-06-02T16:46:03.900481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368341+0000","last_change":"2024-06-02T16:46:03.904170+0000","last_active":"2024-06-02T16:46:05.368341+0000","last_peered":"2024-06-02T16:46:05.368341+0000","last_clean":"2024-06-02T16:46:05.368341+0000","last_became_active":"2024-06-02T16:46:03.903910+0000","last_became_peered":"2024-06-02T16:46:03.903910+0000","last_unstale":"2024-06-02T16:46:05.368341+0000","last_undegraded":"2024-06-02T16:46:05.368341+0000","last_fullsized":"2024-06-02T16:46:05.368341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:07.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863907+0000","last_change":"2024-06-02T16:46:03.881096+0000","last_active":"2024-06-02T16:46:04.863907+0000","last_peered":"2024-06-02T16:46:04.863907+0000","last_clean":"2024-06-02T16:46:04.863907+0000","last_became_active":"2024-06-02T16:46:03.880588+0000","last_became_peered":"2024-06-02T16:46:03.880588+0000","last_unstale":"2024-06-02T16:46:04.863907+0000","last_undegraded":"2024-06-02T16:46:04.863907+0000","last_fullsized":"2024-06-02T16:46:04.863907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:58:55.278805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903548+0000","last_change":"2024-06-02T16:46:03.898043+0000","last_active":"2024-06-02T16:46:03.903548+0000","last_peered":"2024-06-02T16:46:03.903548+0000","last_clean":"2024-06-02T16:46:03.903548+0000","last_became_active":"2024-06-02T16:46:03.897729+0000","last_became_peered":"2024-06-02T16:46:03.897729+0000","last_unstale":"2024-06-02T16:46:03.903548+0000","last_undegraded":"2024-06-02T16:46:03.903548+0000","last_fullsized":"2024-06-02T16:46:03.903548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:19.601796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867980+0000","last_change":"2024-06-02T16:46:03.901353+0000","last_active":"2024-06-02T16:46:04.867980+0000","last_peered":"2024-06-02T16:46:04.867980+0000","last_clean":"2024-06-02T16:46:04.867980+0000","last_became_active":"2024-06-02T16:46:03.901086+0000","last_became_peered":"2024-06-02T16:46:03.901086+0000","last_unstale":"2024-06-02T16:46:04.867980+0000","last_undegraded":"2024-06-02T16:46:04.867980+0000","last_fullsized":"2024-06-02T16:46:04.867980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868905+0000","last_change":"2024-06-02T16:46:03.903426+0000","last_active":"2024-06-02T16:46:04.868905+0000","last_peered":"2024-06-02T16:46:04.868905+0000","last_clean":"2024-06-02T16:46:04.868905+0000","last_became_active":"2024-06-02T16:46:03.903109+0000","last_became_peered":"2024-06-02T16:46:03.903109+0000","last_unstale":"2024-06-02T16:46:04.868905+0000","last_undegraded":"2024-06-02T16:46:04.868905+0000","last_fullsized":"2024-06-02T16:46:04.868905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864498+0000","last_change":"2024-06-02T16:46:03.908555+0000","last_active":"2024-06-02T16:46:04.864498+0000","last_peered":"2024-06-02T16:46:04.864498+0000","last_clean":"2024-06-02T16:46:04.864498+0000","last_became_active":"2024-06-02T16:46:03.908205+0000","last_became_peered":"2024-06-02T16:46:03.908205+0000","last_unstale":"2024-06-02T16:46:04.864498+0000","last_undegraded":"2024-06-02T16:46:04.864498+0000","last_fullsized":"2024-06-02T16:46:04.864498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:39:01.011537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863658+0000","last_change":"2024-06-02T16:46:03.897750+0000","last_active":"2024-06-02T16:46:04.863658+0000","last_peered":"2024-06-02T16:46:04.863658+0000","last_clean":"2024-06-02T16:46:04.863658+0000","last_became_active":"2024-06-02T16:46:03.897419+0000","last_became_peered":"2024-06-02T16:46:03.897419+0000","last_unstale":"2024-06-02T16:46:04.863658+0000","last_undegraded":"2024-06-02T16:46:04.863658+0000","last_fullsized":"2024-06-02T16:46:04.863658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368584+0000","last_change":"2024-06-02T16:46:03.899325+0000","last_active":"2024-06-02T16:46:05.368584+0000","last_peered":"2024-06-02T16:46:05.368584+0000","last_clean":"2024-06-02T16:46:05.368584+0000","last_became_active":"2024-06-02T16:46:03.899055+0000","last_became_peered":"2024-06-02T16:46:03.899055+0000","last_unstale":"2024-06-02T16:46:05.368584+0000","last_undegraded":"2024-06-02T16:46:05.368584+0000","last_fullsized":"2024-06-02T16:46:05.368584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914066+0000","last_change":"2024-06-02T16:46:03.906474+0000","last_active":"2024-06-02T16:46:03.914066+0000","last_peered":"2024-06-02T16:46:03.914066+0000","last_clean":"2024-06-02T16:46:03.914066+0000","last_became_active":"2024-06-02T16:46:03.906146+0000","last_became_peered":"2024-06-02T16:46:03.906146+0000","last_unstale":"2024-06-02T16:46:03.914066+0000","last_undegraded":"2024-06-02T16:46:03.914066+0000","last_fullsized":"2024-06-02T16:46:03.914066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:15:42.386433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914317+0000","last_change":"2024-06-02T16:46:03.910134+0000","last_active":"2024-06-02T16:46:03.914317+0000","last_peered":"2024-06-02T16:46:03.914317+0000","last_clean":"2024-06-02T16:46:03.914317+0000","last_became_active":"2024-06-02T16:46:03.909544+0000","last_became_peered":"2024-06-02T16:46:03.909544+0000","last_unstale":"2024-06-02T16:46:03.914317+0000","last_undegraded":"2024-06-02T16:46:03.914317+0000","last_fullsized":"2024-06-02T16:46:03.914317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900149+0000","last_change":"2024-06-02T16:46:03.895902+0000","last_active":"2024-06-02T16:46:04.900149+0000","last_peered":"2024-06-02T16:46:04.900149+0000","last_clean":"2024-06-02T16:46:04.900149+0000","last_became_active":"2024-06-02T16:46:03.895533+0000","last_became_peered":"2024-06-02T16:46:03.895533+0000","last_unstale":"2024-06-02T16:46:04.900149+0000","last_undegraded":"2024-06-02T16:46:04.900149+0000","last_fullsized":"2024-06-02T16:46:04.900149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.891820+0000","last_change":"2024-06-02T16:46:03.889132+0000","last_active":"2024-06-02T16:46:03.891820+0000","last_peered":"2024-06-02T16:46:03.891820+0000","last_clean":"2024-06-02T16:46:03.891820+0000","last_became_active":"2024-06-02T16:46:03.888335+0000","last_became_peered":"2024-06-02T16:46:03.888335+0000","last_unstale":"2024-06-02T16:46:03.891820+0000","last_undegraded":"2024-06-02T16:46:03.891820+0000","last_fullsized":"2024-06-02T16:46:03.891820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907072+0000","last_change":"2024-06-02T16:46:03.903124+0000","last_active":"2024-06-02T16:46:04.907072+0000","last_peered":"2024-06-02T16:46:04.907072+0000","last_clean":"2024-06-02T16:46:04.907072+0000","last_became_active":"2024-06-02T16:46:03.902585+0000","last_became_peered":"2024-06-02T16:46:03.902585+0000","last_unstale":"2024-06-02T16:46:04.907072+0000","last_undegraded":"2024-06-02T16:46:04.907072+0000","last_fullsized":"2024-06-02T16:46:04.907072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:06:39.170619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864639+0000","last_change":"2024-06-02T16:46:03.894665+0000","last_active":"2024-06-02T16:46:04.864639+0000","last_peered":"2024-06-02T16:46:04.864639+0000","last_clean":"2024-06-02T16:46:04.864639+0000","last_became_active":"2024-06-02T16:46:03.894317+0000","last_became_peered":"2024-06-02T16:46:03.894317+0000","last_unstale":"2024-06-02T16:46:04.864639+0000","last_undegraded":"2024-06-02T16:46:04.864639+0000","last_fullsized":"2024-06-02T16:46:04.864639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:15:46.823260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907039+0000","last_change":"2024-06-02T16:46:03.918112+0000","last_active":"2024-06-02T16:46:04.907039+0000","last_peered":"2024-06-02T16:46:04.907039+0000","last_clean":"2024-06-02T16:46:04.907039+0000","last_became_active":"2024-06-02T16:46:03.916981+0000","last_became_peered":"2024-06-02T16:46:03.916981+0000","last_unstale":"2024-06-02T16:46:04.907039+0000","last_undegraded":"2024-06-02T16:46:04.907039+0000","last_fullsized":"2024-06-02T16:46:04.907039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:58.035427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902707+0000","last_change":"2024-06-02T16:46:03.896638+0000","last_active":"2024-06-02T16:46:03.902707+0000","last_peered":"2024-06-02T16:46:03.902707+0000","last_clean":"2024-06-02T16:46:03.902707+0000","last_became_active":"2024-06-02T16:46:03.896360+0000","last_became_peered":"2024-06-02T16:46:03.896360+0000","last_unstale":"2024-06-02T16:46:03.902707+0000","last_undegraded":"2024-06-02T16:46:03.902707+0000","last_fullsized":"2024-06-02T16:46:03.902707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914044+0000","last_change":"2024-06-02T16:46:03.904596+0000","last_active":"2024-06-02T16:46:03.914044+0000","last_peered":"2024-06-02T16:46:03.914044+0000","last_clean":"2024-06-02T16:46:03.914044+0000","last_became_active":"2024-06-02T16:46:03.901408+0000","last_became_peered":"2024-06-02T16:46:03.901408+0000","last_unstale":"2024-06-02T16:46:03.914044+0000","last_undegraded":"2024-06-02T16:46:03.914044+0000","last_fullsized":"2024-06-02T16:46:03.914044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868136+0000","last_change":"2024-06-02T16:46:03.903410+0000","last_active":"2024-06-02T16:46:04.868136+0000","last_peered":"2024-06-02T16:46:04.868136+0000","last_clean":"2024-06-02T16:46:04.868136+0000","last_became_active":"2024-06-02T16:46:03.903107+0000","last_became_peered":"2024-06-02T16:46:03.903107+0000","last_unstale":"2024-06-02T16:46:04.868136+0000","last_undegraded":"2024-06-02T16:46:04.868136+0000","last_fullsized":"2024-06-02T16:46:04.868136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901736+0000","last_change":"2024-06-02T16:46:03.895116+0000","last_active":"2024-06-02T16:46:03.901736+0000","last_peered":"2024-06-02T16:46:03.901736+0000","last_clean":"2024-06-02T16:46:03.901736+0000","last_became_active":"2024-06-02T16:46:03.894743+0000","last_became_peered":"2024-06-02T16:46:03.894743+0000","last_unstale":"2024-06-02T16:46:03.901736+0000","last_undegraded":"2024-06-02T16:46:03.901736+0000","last_fullsized":"2024-06-02T16:46:03.901736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867072+0000","last_change":"2024-06-02T16:46:03.914694+0000","last_active":"2024-06-02T16:46:04.867072+0000","last_peered":"2024-06-02T16:46:04.867072+0000","last_clean":"2024-06-02T16:46:04.867072+0000","last_became_active":"2024-06-02T16:46:03.914442+0000","last_became_peered":"2024-06-02T16:46:03.914442+0000","last_unstale":"2024-06-02T16:46:04.867072+0000","last_undegraded":"2024-06-02T16:46:04.867072+0000","last_fullsized":"2024-06-02T16:46:04.867072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900641+0000","last_change":"2024-06-02T16:46:03.896326+0000","last_active":"2024-06-02T16:46:04.900641+0000","last_peered":"2024-06-02T16:46:04.900641+0000","last_clean":"2024-06-02T16:46:04.900641+0000","last_became_active":"2024-06-02T16:46:03.896032+0000","last_became_peered":"2024-06-02T16:46:03.896032+0000","last_unstale":"2024-06-02T16:46:04.900641+0000","last_undegraded":"2024-06-02T16:46:04.900641+0000","last_fullsized":"2024-06-02T16:46:04.900641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917653+0000","last_change":"2024-06-02T16:46:02.888949+0000","last_active":"2024-06-02T16:46:03.917653+0000","last_peered":"2024-06-02T16:46:03.917653+0000","last_clean":"2024-06-02T16:46:03.917653+0000","last_became_active":"2024-06-02T16:46:02.888543+0000","last_became_peered":"2024-06-02T16:46:02.888543+0000","last_unstale":"2024-06-02T16:46:03.917653+0000","last_undegraded":"2024-06-02T16:46:03.917653+0000","last_fullsized":"2024-06-02T16:46:03.917653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.902214+0000","last_change":"2024-06-02T16:46:03.897726+0000","last_active":"2024-06-02T16:46:03.902214+0000","last_peered":"2024-06-02T16:46:03.902214+0000","last_clean":"2024-06-02T16:46:03.902214+0000","last_became_active":"2024-06-02T16:46:03.897418+0000","last_became_peered":"2024-06-02T16:46:03.897418+0000","last_unstale":"2024-06-02T16:46:03.902214+0000","last_undegraded":"2024-06-02T16:46:03.902214+0000","last_fullsized":"2024-06-02T16:46:03.902214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900744+0000","last_change":"2024-06-02T16:46:02.893537+0000","last_active":"2024-06-02T16:46:04.900744+0000","last_peered":"2024-06-02T16:46:04.900744+0000","last_clean":"2024-06-02T16:46:04.900744+0000","last_became_active":"2024-06-02T16:46:02.892005+0000","last_became_peered":"2024-06-02T16:46:02.892005+0000","last_unstale":"2024-06-02T16:46:04.900744+0000","last_undegraded":"2024-06-02T16:46:04.900744+0000","last_fullsized":"2024-06-02T16:46:04.900744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911432+0000","last_change":"2024-06-02T16:46:03.901369+0000","last_active":"2024-06-02T16:46:03.911432+0000","last_peered":"2024-06-02T16:46:03.911432+0000","last_clean":"2024-06-02T16:46:03.911432+0000","last_became_active":"2024-06-02T16:46:03.901096+0000","last_became_peered":"2024-06-02T16:46:03.901096+0000","last_unstale":"2024-06-02T16:46:03.911432+0000","last_undegraded":"2024-06-02T16:46:03.911432+0000","last_fullsized":"2024-06-02T16:46:03.911432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863809+0000","last_change":"2024-06-02T16:46:02.885969+0000","last_active":"2024-06-02T16:46:04.863809+0000","last_peered":"2024-06-02T16:46:04.863809+0000","last_clean":"2024-06-02T16:46:04.863809+0000","last_became_active":"2024-06-02T16:46:02.885069+0000","last_became_peered":"2024-06-02T16:46:02.885069+0000","last_unstale":"2024-06-02T16:46:04.863809+0000","last_undegraded":"2024-06-02T16:46:04.863809+0000","last_fullsized":"2024-06-02T16:46:04.863809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:18.595331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907071+0000","last_change":"2024-06-02T16:46:03.908371+0000","last_active":"2024-06-02T16:46:04.907071+0000","last_peered":"2024-06-02T16:46:04.907071+0000","last_clean":"2024-06-02T16:46:04.907071+0000","last_became_active":"2024-06-02T16:46:03.908082+0000","last_became_peered":"2024-06-02T16:46:03.908082+0000","last_unstale":"2024-06-02T16:46:04.907071+0000","last_undegraded":"2024-06-02T16:46:04.907071+0000","last_fullsized":"2024-06-02T16:46:04.907071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:36:56.550451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368887+0000","last_change":"2024-06-02T16:46:02.884689+0000","last_active":"2024-06-02T16:46:05.368887+0000","last_peered":"2024-06-02T16:46:05.368887+0000","last_clean":"2024-06-02T16:46:05.368887+0000","last_became_active":"2024-06-02T16:46:02.884375+0000","last_became_peered":"2024-06-02T16:46:02.884375+0000","last_unstale":"2024-06-02T16:46:05.368887+0000","last_undegraded":"2024-06-02T16:46:05.368887+0000","last_fullsized":"2024-06-02T16:46:05.368887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:55.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868244+0000","last_change":"2024-06-02T16:46:03.915192+0000","last_active":"2024-06-02T16:46:04.868244+0000","last_peered":"2024-06-02T16:46:04.868244+0000","last_clean":"2024-06-02T16:46:04.868244+0000","last_became_active":"2024-06-02T16:46:03.914914+0000","last_became_peered":"2024-06-02T16:46:03.914914+0000","last_unstale":"2024-06-02T16:46:04.868244+0000","last_undegraded":"2024-06-02T16:46:04.868244+0000","last_fullsized":"2024-06-02T16:46:04.868244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920894+0000","last_change":"2024-06-02T16:46:02.890589+0000","last_active":"2024-06-02T16:46:03.920894+0000","last_peered":"2024-06-02T16:46:03.920894+0000","last_clean":"2024-06-02T16:46:03.920894+0000","last_became_active":"2024-06-02T16:46:02.890352+0000","last_became_peered":"2024-06-02T16:46:02.890352+0000","last_unstale":"2024-06-02T16:46:03.920894+0000","last_undegraded":"2024-06-02T16:46:03.920894+0000","last_fullsized":"2024-06-02T16:46:03.920894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.903653+0000","last_change":"2024-06-02T16:46:03.897804+0000","last_active":"2024-06-02T16:46:03.903653+0000","last_peered":"2024-06-02T16:46:03.903653+0000","last_clean":"2024-06-02T16:46:03.903653+0000","last_became_active":"2024-06-02T16:46:03.896250+0000","last_became_peered":"2024-06-02T16:46:03.896250+0000","last_unstale":"2024-06-02T16:46:03.903653+0000","last_undegraded":"2024-06-02T16:46:03.903653+0000","last_fullsized":"2024-06-02T16:46:03.903653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:23.137749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.920927+0000","last_change":"2024-06-02T16:46:02.887796+0000","last_active":"2024-06-02T16:46:03.920927+0000","last_peered":"2024-06-02T16:46:03.920927+0000","last_clean":"2024-06-02T16:46:03.920927+0000","last_became_active":"2024-06-02T16:46:02.887447+0000","last_became_peered":"2024-06-02T16:46:02.887447+0000","last_unstale":"2024-06-02T16:46:03.920927+0000","last_undegraded":"2024-06-02T16:46:03.920927+0000","last_fullsized":"2024-06-02T16:46:03.920927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:13.404538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.913883+0000","last_change":"2024-06-02T16:46:03.906099+0000","last_active":"2024-06-02T16:46:03.913883+0000","last_peered":"2024-06-02T16:46:03.913883+0000","last_clean":"2024-06-02T16:46:03.913883+0000","last_became_active":"2024-06-02T16:46:03.905768+0000","last_became_peered":"2024-06-02T16:46:03.905768+0000","last_unstale":"2024-06-02T16:46:03.913883+0000","last_undegraded":"2024-06-02T16:46:03.913883+0000","last_fullsized":"2024-06-02T16:46:03.913883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863246+0000","last_change":"2024-06-02T16:46:02.881438+0000","last_active":"2024-06-02T16:46:04.863246+0000","last_peered":"2024-06-02T16:46:04.863246+0000","last_clean":"2024-06-02T16:46:04.863246+0000","last_became_active":"2024-06-02T16:46:02.881163+0000","last_became_peered":"2024-06-02T16:46:02.881163+0000","last_unstale":"2024-06-02T16:46:04.863246+0000","last_undegraded":"2024-06-02T16:46:04.863246+0000","last_fullsized":"2024-06-02T16:46:04.863246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:45.683326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906289+0000","last_change":"2024-06-02T16:46:03.901916+0000","last_active":"2024-06-02T16:46:04.906289+0000","last_peered":"2024-06-02T16:46:04.906289+0000","last_clean":"2024-06-02T16:46:04.906289+0000","last_became_active":"2024-06-02T16:46:03.901614+0000","last_became_peered":"2024-06-02T16:46:03.901614+0000","last_unstale":"2024-06-02T16:46:04.906289+0000","last_undegraded":"2024-06-02T16:46:04.906289+0000","last_fullsized":"2024-06-02T16:46:04.906289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:06.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883516+0000","last_change":"2024-06-02T16:46:02.887974+0000","last_active":"2024-06-02T16:46:03.883516+0000","last_peered":"2024-06-02T16:46:03.883516+0000","last_clean":"2024-06-02T16:46:03.883516+0000","last_became_active":"2024-06-02T16:46:02.887518+0000","last_became_peered":"2024-06-02T16:46:02.887518+0000","last_unstale":"2024-06-02T16:46:03.883516+0000","last_undegraded":"2024-06-02T16:46:03.883516+0000","last_fullsized":"2024-06-02T16:46:03.883516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:41.542744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.892984+0000","last_change":"2024-06-02T16:46:03.889252+0000","last_active":"2024-06-02T16:46:03.892984+0000","last_peered":"2024-06-02T16:46:03.892984+0000","last_clean":"2024-06-02T16:46:03.892984+0000","last_became_active":"2024-06-02T16:46:03.888930+0000","last_became_peered":"2024-06-02T16:46:03.888930+0000","last_unstale":"2024-06-02T16:46:03.892984+0000","last_undegraded":"2024-06-02T16:46:03.892984+0000","last_fullsized":"2024-06-02T16:46:03.892984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864189+0000","last_change":"2024-06-02T16:46:02.893885+0000","last_active":"2024-06-02T16:46:04.864189+0000","last_peered":"2024-06-02T16:46:04.864189+0000","last_clean":"2024-06-02T16:46:04.864189+0000","last_became_active":"2024-06-02T16:46:02.893025+0000","last_became_peered":"2024-06-02T16:46:02.893025+0000","last_unstale":"2024-06-02T16:46:04.864189+0000","last_undegraded":"2024-06-02T16:46:04.864189+0000","last_fullsized":"2024-06-02T16:46:04.864189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:22.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864239+0000","last_change":"2024-06-02T16:46:03.899191+0000","last_active":"2024-06-02T16:46:04.864239+0000","last_peered":"2024-06-02T16:46:04.864239+0000","last_clean":"2024-06-02T16:46:04.864239+0000","last_became_active":"2024-06-02T16:46:03.898870+0000","last_became_peered":"2024-06-02T16:46:03.898870+0000","last_unstale":"2024-06-02T16:46:04.864239+0000","last_undegraded":"2024-06-02T16:46:04.864239+0000","last_fullsized":"2024-06-02T16:46:04.864239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:19.682458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.901356+0000","last_change":"2024-06-02T16:46:02.891514+0000","last_active":"2024-06-02T16:46:04.901356+0000","last_peered":"2024-06-02T16:46:04.901356+0000","last_clean":"2024-06-02T16:46:04.901356+0000","last_became_active":"2024-06-02T16:46:02.890402+0000","last_became_peered":"2024-06-02T16:46:02.890402+0000","last_unstale":"2024-06-02T16:46:04.901356+0000","last_undegraded":"2024-06-02T16:46:04.901356+0000","last_fullsized":"2024-06-02T16:46:04.901356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:43.161036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863931+0000","last_change":"2024-06-02T16:46:03.894968+0000","last_active":"2024-06-02T16:46:04.863931+0000","last_peered":"2024-06-02T16:46:04.863931+0000","last_clean":"2024-06-02T16:46:04.863931+0000","last_became_active":"2024-06-02T16:46:03.894677+0000","last_became_peered":"2024-06-02T16:46:03.894677+0000","last_unstale":"2024-06-02T16:46:04.863931+0000","last_undegraded":"2024-06-02T16:46:04.863931+0000","last_fullsized":"2024-06-02T16:46:04.863931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:47:50.909155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.924967+0000","last_change":"2024-06-02T16:46:02.891663+0000","last_active":"2024-06-02T16:46:03.924967+0000","last_peered":"2024-06-02T16:46:03.924967+0000","last_clean":"2024-06-02T16:46:03.924967+0000","last_became_active":"2024-06-02T16:46:02.891289+0000","last_became_peered":"2024-06-02T16:46:02.891289+0000","last_unstale":"2024-06-02T16:46:03.924967+0000","last_undegraded":"2024-06-02T16:46:03.924967+0000","last_fullsized":"2024-06-02T16:46:03.924967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:50.505687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.910059+0000","last_change":"2024-06-02T16:46:03.905722+0000","last_active":"2024-06-02T16:46:03.910059+0000","last_peered":"2024-06-02T16:46:03.910059+0000","last_clean":"2024-06-02T16:46:03.910059+0000","last_became_active":"2024-06-02T16:46:03.904804+0000","last_became_peered":"2024-06-02T16:46:03.904804+0000","last_unstale":"2024-06-02T16:46:03.910059+0000","last_undegraded":"2024-06-02T16:46:03.910059+0000","last_fullsized":"2024-06-02T16:46:03.910059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863977+0000","last_change":"2024-06-02T16:46:02.891914+0000","last_active":"2024-06-02T16:46:04.863977+0000","last_peered":"2024-06-02T16:46:04.863977+0000","last_clean":"2024-06-02T16:46:04.863977+0000","last_became_active":"2024-06-02T16:46:02.891501+0000","last_became_peered":"2024-06-02T16:46:02.891501+0000","last_unstale":"2024-06-02T16:46:04.863977+0000","last_undegraded":"2024-06-02T16:46:04.863977+0000","last_fullsized":"2024-06-02T16:46:04.863977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:02.020123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906357+0000","last_change":"2024-06-02T16:46:03.901154+0000","last_active":"2024-06-02T16:46:04.906357+0000","last_peered":"2024-06-02T16:46:04.906357+0000","last_clean":"2024-06-02T16:46:04.906357+0000","last_became_active":"2024-06-02T16:46:03.900908+0000","last_became_peered":"2024-06-02T16:46:03.900908+0000","last_unstale":"2024-06-02T16:46:04.906357+0000","last_undegraded":"2024-06-02T16:46:04.906357+0000","last_fullsized":"2024-06-02T16:46:04.906357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:18:46.765644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917306+0000","last_change":"2024-06-02T16:46:02.884664+0000","last_active":"2024-06-02T16:46:03.917306+0000","last_peered":"2024-06-02T16:46:03.917306+0000","last_clean":"2024-06-02T16:46:03.917306+0000","last_became_active":"2024-06-02T16:46:02.884222+0000","last_became_peered":"2024-06-02T16:46:02.884222+0000","last_unstale":"2024-06-02T16:46:03.917306+0000","last_undegraded":"2024-06-02T16:46:03.917306+0000","last_fullsized":"2024-06-02T16:46:03.917306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864235+0000","last_change":"2024-06-02T16:46:03.894341+0000","last_active":"2024-06-02T16:46:04.864235+0000","last_peered":"2024-06-02T16:46:04.864235+0000","last_clean":"2024-06-02T16:46:04.864235+0000","last_became_active":"2024-06-02T16:46:03.894036+0000","last_became_peered":"2024-06-02T16:46:03.894036+0000","last_unstale":"2024-06-02T16:46:04.864235+0000","last_undegraded":"2024-06-02T16:46:04.864235+0000","last_fullsized":"2024-06-02T16:46:04.864235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:53:33.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906447+0000","last_change":"2024-06-02T16:46:02.882333+0000","last_active":"2024-06-02T16:46:04.906447+0000","last_peered":"2024-06-02T16:46:04.906447+0000","last_clean":"2024-06-02T16:46:04.906447+0000","last_became_active":"2024-06-02T16:46:02.882046+0000","last_became_peered":"2024-06-02T16:46:02.882046+0000","last_unstale":"2024-06-02T16:46:04.906447+0000","last_undegraded":"2024-06-02T16:46:04.906447+0000","last_fullsized":"2024-06-02T16:46:04.906447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:29.419254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867524+0000","last_change":"2024-06-02T16:46:03.905599+0000","last_active":"2024-06-02T16:46:04.867524+0000","last_peered":"2024-06-02T16:46:04.867524+0000","last_clean":"2024-06-02T16:46:04.867524+0000","last_became_active":"2024-06-02T16:46:03.905288+0000","last_became_peered":"2024-06-02T16:46:03.905288+0000","last_unstale":"2024-06-02T16:46:04.867524+0000","last_undegraded":"2024-06-02T16:46:04.867524+0000","last_fullsized":"2024-06-02T16:46:04.867524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863127+0000","last_change":"2024-06-02T16:46:02.891190+0000","last_active":"2024-06-02T16:46:04.863127+0000","last_peered":"2024-06-02T16:46:04.863127+0000","last_clean":"2024-06-02T16:46:04.863127+0000","last_became_active":"2024-06-02T16:46:02.890783+0000","last_became_peered":"2024-06-02T16:46:02.890783+0000","last_unstale":"2024-06-02T16:46:04.863127+0000","last_undegraded":"2024-06-02T16:46:04.863127+0000","last_fullsized":"2024-06-02T16:46:04.863127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:18.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901713+0000","last_change":"2024-06-02T16:46:03.894216+0000","last_active":"2024-06-02T16:46:03.901713+0000","last_peered":"2024-06-02T16:46:03.901713+0000","last_clean":"2024-06-02T16:46:03.901713+0000","last_became_active":"2024-06-02T16:46:03.893381+0000","last_became_peered":"2024-06-02T16:46:03.893381+0000","last_unstale":"2024-06-02T16:46:03.901713+0000","last_undegraded":"2024-06-02T16:46:03.901713+0000","last_fullsized":"2024-06-02T16:46:03.901713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863361+0000","last_change":"2024-06-02T16:46:02.885194+0000","last_active":"2024-06-02T16:46:04.863361+0000","last_peered":"2024-06-02T16:46:04.863361+0000","last_clean":"2024-06-02T16:46:04.863361+0000","last_became_active":"2024-06-02T16:46:02.884879+0000","last_became_peered":"2024-06-02T16:46:02.884879+0000","last_unstale":"2024-06-02T16:46:04.863361+0000","last_undegraded":"2024-06-02T16:46:04.863361+0000","last_fullsized":"2024-06-02T16:46:04.863361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:51.294201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.914109+0000","last_change":"2024-06-02T16:46:03.909612+0000","last_active":"2024-06-02T16:46:03.914109+0000","last_peered":"2024-06-02T16:46:03.914109+0000","last_clean":"2024-06-02T16:46:03.914109+0000","last_became_active":"2024-06-02T16:46:03.909152+0000","last_became_peered":"2024-06-02T16:46:03.909152+0000","last_unstale":"2024-06-02T16:46:03.914109+0000","last_undegraded":"2024-06-02T16:46:03.914109+0000","last_fullsized":"2024-06-02T16:46:03.914109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:02.210765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907128+0000","last_change":"2024-06-02T16:46:02.888602+0000","last_active":"2024-06-02T16:46:04.907128+0000","last_peered":"2024-06-02T16:46:04.907128+0000","last_clean":"2024-06-02T16:46:04.907128+0000","last_became_active":"2024-06-02T16:46:02.887961+0000","last_became_peered":"2024-06-02T16:46:02.887961+0000","last_unstale":"2024-06-02T16:46:04.907128+0000","last_undegraded":"2024-06-02T16:46:04.907128+0000","last_fullsized":"2024-06-02T16:46:04.907128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:39.314302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.900369+0000","last_change":"2024-06-02T16:46:03.893517+0000","last_active":"2024-06-02T16:46:03.900369+0000","last_peered":"2024-06-02T16:46:03.900369+0000","last_clean":"2024-06-02T16:46:03.900369+0000","last_became_active":"2024-06-02T16:46:03.893145+0000","last_became_peered":"2024-06-02T16:46:03.893145+0000","last_unstale":"2024-06-02T16:46:03.900369+0000","last_undegraded":"2024-06-02T16:46:03.900369+0000","last_fullsized":"2024-06-02T16:46:03.900369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.917502+0000","last_change":"2024-06-02T16:46:02.887086+0000","last_active":"2024-06-02T16:46:03.917502+0000","last_peered":"2024-06-02T16:46:03.917502+0000","last_clean":"2024-06-02T16:46:03.917502+0000","last_became_active":"2024-06-02T16:46:02.886357+0000","last_became_peered":"2024-06-02T16:46:02.886357+0000","last_unstale":"2024-06-02T16:46:03.917502+0000","last_undegraded":"2024-06-02T16:46:03.917502+0000","last_fullsized":"2024-06-02T16:46:03.917502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:20.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906778+0000","last_change":"2024-06-02T16:46:03.914717+0000","last_active":"2024-06-02T16:46:04.906778+0000","last_peered":"2024-06-02T16:46:04.906778+0000","last_clean":"2024-06-02T16:46:04.906778+0000","last_became_active":"2024-06-02T16:46:03.913526+0000","last_became_peered":"2024-06-02T16:46:03.913526+0000","last_unstale":"2024-06-02T16:46:04.906778+0000","last_undegraded":"2024-06-02T16:46:04.906778+0000","last_fullsized":"2024-06-02T16:46:04.906778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:32:54.736579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.918801+0000","last_change":"2024-06-02T16:46:02.888288+0000","last_active":"2024-06-02T16:46:03.918801+0000","last_peered":"2024-06-02T16:46:03.918801+0000","last_clean":"2024-06-02T16:46:03.918801+0000","last_became_active":"2024-06-02T16:46:02.883890+0000","last_became_peered":"2024-06-02T16:46:02.883890+0000","last_unstale":"2024-06-02T16:46:03.918801+0000","last_undegraded":"2024-06-02T16:46:03.918801+0000","last_fullsized":"2024-06-02T16:46:03.918801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368926+0000","last_change":"2024-06-02T16:46:03.906699+0000","last_active":"2024-06-02T16:46:05.368926+0000","last_peered":"2024-06-02T16:46:05.368926+0000","last_clean":"2024-06-02T16:46:05.368926+0000","last_became_active":"2024-06-02T16:46:03.906415+0000","last_became_peered":"2024-06-02T16:46:03.906415+0000","last_unstale":"2024-06-02T16:46:05.368926+0000","last_undegraded":"2024-06-02T16:46:05.368926+0000","last_fullsized":"2024-06-02T16:46:05.368926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.887537+0000","last_change":"2024-06-02T16:46:02.886711+0000","last_active":"2024-06-02T16:46:03.887537+0000","last_peered":"2024-06-02T16:46:03.887537+0000","last_clean":"2024-06-02T16:46:03.887537+0000","last_became_active":"2024-06-02T16:46:02.886377+0000","last_became_peered":"2024-06-02T16:46:02.886377+0000","last_unstale":"2024-06-02T16:46:03.887537+0000","last_undegraded":"2024-06-02T16:46:03.887537+0000","last_fullsized":"2024-06-02T16:46:03.887537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:38.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368482+0000","last_change":"2024-06-02T16:46:03.910758+0000","last_active":"2024-06-02T16:46:05.368482+0000","last_peered":"2024-06-02T16:46:05.368482+0000","last_clean":"2024-06-02T16:46:05.368482+0000","last_became_active":"2024-06-02T16:46:03.910435+0000","last_became_peered":"2024-06-02T16:46:03.910435+0000","last_unstale":"2024-06-02T16:46:05.368482+0000","last_undegraded":"2024-06-02T16:46:05.368482+0000","last_fullsized":"2024-06-02T16:46:05.368482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900426+0000","last_change":"2024-06-02T16:46:02.883493+0000","last_active":"2024-06-02T16:46:04.900426+0000","last_peered":"2024-06-02T16:46:04.900426+0000","last_clean":"2024-06-02T16:46:04.900426+0000","last_became_active":"2024-06-02T16:46:02.880100+0000","last_became_peered":"2024-06-02T16:46:02.880100+0000","last_unstale":"2024-06-02T16:46:04.900426+0000","last_undegraded":"2024-06-02T16:46:04.900426+0000","last_fullsized":"2024-06-02T16:46:04.900426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:02.344035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368571+0000","last_change":"2024-06-02T16:46:03.907359+0000","last_active":"2024-06-02T16:46:05.368571+0000","last_peered":"2024-06-02T16:46:05.368571+0000","last_clean":"2024-06-02T16:46:05.368571+0000","last_became_active":"2024-06-02T16:46:03.906700+0000","last_became_peered":"2024-06-02T16:46:03.906700+0000","last_unstale":"2024-06-02T16:46:05.368571+0000","last_undegraded":"2024-06-02T16:46:05.368571+0000","last_fullsized":"2024-06-02T16:46:05.368571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.877454+0000","last_change":"2024-06-02T16:46:02.895540+0000","last_active":"2024-06-02T16:46:03.877454+0000","last_peered":"2024-06-02T16:46:03.877454+0000","last_clean":"2024-06-02T16:46:03.877454+0000","last_became_active":"2024-06-02T16:46:02.895129+0000","last_became_peered":"2024-06-02T16:46:02.895129+0000","last_unstale":"2024-06-02T16:46:03.877454+0000","last_undegraded":"2024-06-02T16:46:03.877454+0000","last_fullsized":"2024-06-02T16:46:03.877454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368811+0000","last_change":"2024-06-02T16:46:03.895347+0000","last_active":"2024-06-02T16:46:05.368811+0000","last_peered":"2024-06-02T16:46:05.368811+0000","last_clean":"2024-06-02T16:46:05.368811+0000","last_became_active":"2024-06-02T16:46:03.894742+0000","last_became_peered":"2024-06-02T16:46:03.894742+0000","last_unstale":"2024-06-02T16:46:05.368811+0000","last_undegraded":"2024-06-02T16:46:05.368811+0000","last_fullsized":"2024-06-02T16:46:05.368811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.883547+0000","last_change":"2024-06-02T16:46:02.882260+0000","last_active":"2024-06-02T16:46:03.883547+0000","last_peered":"2024-06-02T16:46:03.883547+0000","last_clean":"2024-06-02T16:46:03.883547+0000","last_became_active":"2024-06-02T16:46:02.875091+0000","last_became_peered":"2024-06-02T16:46:02.875091+0000","last_unstale":"2024-06-02T16:46:03.883547+0000","last_undegraded":"2024-06-02T16:46:03.883547+0000","last_fullsized":"2024-06-02T16:46:03.883547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:02.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867216+0000","last_change":"2024-06-02T16:46:03.899743+0000","last_active":"2024-06-02T16:46:04.867216+0000","last_peered":"2024-06-02T16:46:04.867216+0000","last_clean":"2024-06-02T16:46:04.867216+0000","last_became_active":"2024-06-02T16:46:03.899449+0000","last_became_peered":"2024-06-02T16:46:03.899449+0000","last_unstale":"2024-06-02T16:46:04.867216+0000","last_undegraded":"2024-06-02T16:46:04.867216+0000","last_fullsized":"2024-06-02T16:46:04.867216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.874810+0000","last_change":"2024-06-02T16:46:02.890214+0000","last_active":"2024-06-02T16:46:03.874810+0000","last_peered":"2024-06-02T16:46:03.874810+0000","last_clean":"2024-06-02T16:46:03.874810+0000","last_became_active":"2024-06-02T16:46:02.889874+0000","last_became_peered":"2024-06-02T16:46:02.889874+0000","last_unstale":"2024-06-02T16:46:03.874810+0000","last_undegraded":"2024-06-02T16:46:03.874810+0000","last_fullsized":"2024-06-02T16:46:03.874810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:01.204300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368363+0000","last_change":"2024-06-02T16:46:03.901073+0000","last_active":"2024-06-02T16:46:05.368363+0000","last_peered":"2024-06-02T16:46:05.368363+0000","last_clean":"2024-06-02T16:46:05.368363+0000","last_became_active":"2024-06-02T16:46:03.890045+0000","last_became_peered":"2024-06-02T16:46:03.890045+0000","last_unstale":"2024-06-02T16:46:05.368363+0000","last_undegraded":"2024-06-02T16:46:05.368363+0000","last_fullsized":"2024-06-02T16:46:05.368363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:57.073479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907198+0000","last_change":"2024-06-02T16:46:02.883504+0000","last_active":"2024-06-02T16:46:04.907198+0000","last_peered":"2024-06-02T16:46:04.907198+0000","last_clean":"2024-06-02T16:46:04.907198+0000","last_became_active":"2024-06-02T16:46:02.883177+0000","last_became_peered":"2024-06-02T16:46:02.883177+0000","last_unstale":"2024-06-02T16:46:04.907198+0000","last_undegraded":"2024-06-02T16:46:04.907198+0000","last_fullsized":"2024-06-02T16:46:04.907198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:07:36.269419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.907648+0000","last_change":"2024-06-02T16:46:03.903394+0000","last_active":"2024-06-02T16:46:03.907648+0000","last_peered":"2024-06-02T16:46:03.907648+0000","last_clean":"2024-06-02T16:46:03.907648+0000","last_became_active":"2024-06-02T16:46:03.902987+0000","last_became_peered":"2024-06-02T16:46:03.902987+0000","last_unstale":"2024-06-02T16:46:03.907648+0000","last_undegraded":"2024-06-02T16:46:03.907648+0000","last_fullsized":"2024-06-02T16:46:03.907648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.901232+0000","last_change":"2024-06-02T16:46:02.890382+0000","last_active":"2024-06-02T16:46:04.901232+0000","last_peered":"2024-06-02T16:46:04.901232+0000","last_clean":"2024-06-02T16:46:04.901232+0000","last_became_active":"2024-06-02T16:46:02.890074+0000","last_became_peered":"2024-06-02T16:46:02.890074+0000","last_unstale":"2024-06-02T16:46:04.901232+0000","last_undegraded":"2024-06-02T16:46:04.901232+0000","last_fullsized":"2024-06-02T16:46:04.901232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900434+0000","last_change":"2024-06-02T16:46:03.899253+0000","last_active":"2024-06-02T16:46:04.900434+0000","last_peered":"2024-06-02T16:46:04.900434+0000","last_clean":"2024-06-02T16:46:04.900434+0000","last_became_active":"2024-06-02T16:46:03.898932+0000","last_became_peered":"2024-06-02T16:46:03.898932+0000","last_unstale":"2024-06-02T16:46:04.900434+0000","last_undegraded":"2024-06-02T16:46:04.900434+0000","last_fullsized":"2024-06-02T16:46:04.900434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906795+0000","last_change":"2024-06-02T16:46:02.885176+0000","last_active":"2024-06-02T16:46:04.906795+0000","last_peered":"2024-06-02T16:46:04.906795+0000","last_clean":"2024-06-02T16:46:04.906795+0000","last_became_active":"2024-06-02T16:46:02.884863+0000","last_became_peered":"2024-06-02T16:46:02.884863+0000","last_unstale":"2024-06-02T16:46:04.906795+0000","last_undegraded":"2024-06-02T16:46:04.906795+0000","last_fullsized":"2024-06-02T16:46:04.906795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:02:03.125487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.901094+0000","last_change":"2024-06-02T16:46:03.896244+0000","last_active":"2024-06-02T16:46:03.901094+0000","last_peered":"2024-06-02T16:46:03.901094+0000","last_clean":"2024-06-02T16:46:03.901094+0000","last_became_active":"2024-06-02T16:46:03.895899+0000","last_became_peered":"2024-06-02T16:46:03.895899+0000","last_unstale":"2024-06-02T16:46:03.901094+0000","last_undegraded":"2024-06-02T16:46:03.901094+0000","last_fullsized":"2024-06-02T16:46:03.901094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900552+0000","last_change":"2024-06-02T16:46:02.882808+0000","last_active":"2024-06-02T16:46:04.900552+0000","last_peered":"2024-06-02T16:46:04.900552+0000","last_clean":"2024-06-02T16:46:04.900552+0000","last_became_active":"2024-06-02T16:46:02.882515+0000","last_became_peered":"2024-06-02T16:46:02.882515+0000","last_unstale":"2024-06-02T16:46:04.900552+0000","last_undegraded":"2024-06-02T16:46:04.900552+0000","last_fullsized":"2024-06-02T16:46:04.900552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:05.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900378+0000","last_change":"2024-06-02T16:46:03.902214+0000","last_active":"2024-06-02T16:46:04.900378+0000","last_peered":"2024-06-02T16:46:04.900378+0000","last_clean":"2024-06-02T16:46:04.900378+0000","last_became_active":"2024-06-02T16:46:03.901873+0000","last_became_peered":"2024-06-02T16:46:03.901873+0000","last_unstale":"2024-06-02T16:46:04.900378+0000","last_undegraded":"2024-06-02T16:46:04.900378+0000","last_fullsized":"2024-06-02T16:46:04.900378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906487+0000","last_change":"2024-06-02T16:46:02.890723+0000","last_active":"2024-06-02T16:46:04.906487+0000","last_peered":"2024-06-02T16:46:04.906487+0000","last_clean":"2024-06-02T16:46:04.906487+0000","last_became_active":"2024-06-02T16:46:02.889856+0000","last_became_peered":"2024-06-02T16:46:02.889856+0000","last_unstale":"2024-06-02T16:46:04.906487+0000","last_undegraded":"2024-06-02T16:46:04.906487+0000","last_fullsized":"2024-06-02T16:46:04.906487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:19:52.124662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863254+0000","last_change":"2024-06-02T16:46:03.902323+0000","last_active":"2024-06-02T16:46:04.863254+0000","last_peered":"2024-06-02T16:46:04.863254+0000","last_clean":"2024-06-02T16:46:04.863254+0000","last_became_active":"2024-06-02T16:46:03.901882+0000","last_became_peered":"2024-06-02T16:46:03.901882+0000","last_unstale":"2024-06-02T16:46:04.863254+0000","last_undegraded":"2024-06-02T16:46:04.863254+0000","last_fullsized":"2024-06-02T16:46:04.863254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.885236+0000","last_change":"2024-06-02T16:46:02.884578+0000","last_active":"2024-06-02T16:46:03.885236+0000","last_peered":"2024-06-02T16:46:03.885236+0000","last_clean":"2024-06-02T16:46:03.885236+0000","last_became_active":"2024-06-02T16:46:02.882715+0000","last_became_peered":"2024-06-02T16:46:02.882715+0000","last_unstale":"2024-06-02T16:46:03.885236+0000","last_undegraded":"2024-06-02T16:46:03.885236+0000","last_fullsized":"2024-06-02T16:46:03.885236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:49.232011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.911131+0000","last_change":"2024-06-02T16:46:03.892141+0000","last_active":"2024-06-02T16:46:03.911131+0000","last_peered":"2024-06-02T16:46:03.911131+0000","last_clean":"2024-06-02T16:46:03.911131+0000","last_became_active":"2024-06-02T16:46:03.891420+0000","last_became_peered":"2024-06-02T16:46:03.891420+0000","last_unstale":"2024-06-02T16:46:03.911131+0000","last_undegraded":"2024-06-02T16:46:03.911131+0000","last_fullsized":"2024-06-02T16:46:03.911131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863232+0000","last_change":"2024-06-02T16:46:02.892674+0000","last_active":"2024-06-02T16:46:04.863232+0000","last_peered":"2024-06-02T16:46:04.863232+0000","last_clean":"2024-06-02T16:46:04.863232+0000","last_became_active":"2024-06-02T16:46:02.890747+0000","last_became_peered":"2024-06-02T16:46:02.890747+0000","last_unstale":"2024-06-02T16:46:04.863232+0000","last_undegraded":"2024-06-02T16:46:04.863232+0000","last_fullsized":"2024-06-02T16:46:04.863232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:10.440456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868386+0000","last_change":"2024-06-02T16:46:03.916186+0000","last_active":"2024-06-02T16:46:04.868386+0000","last_peered":"2024-06-02T16:46:04.868386+0000","last_clean":"2024-06-02T16:46:04.868386+0000","last_became_active":"2024-06-02T16:46:03.915623+0000","last_became_peered":"2024-06-02T16:46:03.915623+0000","last_unstale":"2024-06-02T16:46:04.868386+0000","last_undegraded":"2024-06-02T16:46:04.868386+0000","last_fullsized":"2024-06-02T16:46:04.868386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-06-02T16:46:03.876609+0000","last_change":"2024-06-02T16:46:02.892101+0000","last_active":"2024-06-02T16:46:03.876609+0000","last_peered":"2024-06-02T16:46:03.876609+0000","last_clean":"2024-06-02T16:46:03.876609+0000","last_became_active":"2024-06-02T16:46:02.891745+0000","last_became_peered":"2024-06-02T16:46:02.891745+0000","last_unstale":"2024-06-02T16:46:03.876609+0000","last_undegraded":"2024-06-02T16:46:03.876609+0000","last_fullsized":"2024-06-02T16:46:03.876609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867868+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:46:04.867868+0000","last_peered":"2024-06-02T16:46:04.867868+0000","last_clean":"2024-06-02T16:46:04.867868+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:46:04.867868+0000","last_undegraded":"2024-06-02T16:46:04.867868+0000","last_fullsized":"2024-06-02T16:46:04.867868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":733877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":143523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":151353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":149789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":740087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":151353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:46:13.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:46:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.702+0000 7f7b6ea00640 1 Processor -- start 2024-06-02T16:46:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.702+0000 7f7b6ea00640 1 -- start start 2024-06-02T16:46:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.703+0000 7f7b6ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b681577f0 0x7f7b68073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.703+0000 7f7b6ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 0x7f7b68072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6ea00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b68160c80 con 0x7f7b68073fb0 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6ea00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7b68160f60 con 0x7f7b681577f0 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6ea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7b68161240 con 0x7f7b6806e840 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b681577f0 0x7f7b68073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b681577f0 0x7f7b68073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46862/0 (socket says 172.21.15.52:46862) 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6d600640 1 -- 172.21.15.52:0/547393781 learned_addr learned my addr 172.21.15.52:0/547393781 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6cc00640 1 --1- 172.21.15.52:0/547393781 >> v1:172.21.15.52:6789/0 conn(0x7f7b68073fb0 0x7f7b6806e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53932/0 (socket says 172.21.15.52:53932) 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6e000640 1 --2- 172.21.15.52:0/547393781 >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 0x7f7b68072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6d600640 1 -- 172.21.15.52:0/547393781 >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 msgr2=0x7f7b68072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.704+0000 7f7b6d600640 1 --2- 172.21.15.52:0/547393781 >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 0x7f7b68072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.705+0000 7f7b6d600640 1 -- 172.21.15.52:0/547393781 >> v1:172.21.15.52:6789/0 conn(0x7f7b68073fb0 legacy=0x7f7b6806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.705+0000 7f7b67e00640 1 -- 172.21.15.52:0/547393781 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144989272 0 0) 0x7f7b68160c80 con 0x7f7b68073fb0 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.705+0000 7f7b6d600640 1 -- 172.21.15.52:0/547393781 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b68161520 con 0x7f7b681577f0 2024-06-02T16:46:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.705+0000 7f7b6e000640 1 --2- 172.21.15.52:0/547393781 >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 0x7f7b68072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:13.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.706+0000 7f7b6d600640 1 --2- 172.21.15.52:0/547393781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b68073a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009870 tx=0x7f7b5c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e8e95964bf5a38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:13.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.706+0000 7f7b67e00640 1 -- 172.21.15.52:0/547393781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c037070 con 0x7f7b681577f0 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.706+0000 7f7b67e00640 1 -- 172.21.15.52:0/547393781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5c032440 con 0x7f7b681577f0 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.706+0000 7f7b67e00640 1 -- 172.21.15.52:0/547393781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c032810 con 0x7f7b681577f0 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 -- 172.21.15.52:0/547393781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 msgr2=0x7f7b68073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/547393781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b68073a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009870 tx=0x7f7b5c02a2a0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 -- 172.21.15.52:0/547393781 shutdown_connections 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/547393781 >> v2:172.21.15.114:3300/0 conn(0x7f7b6806e840 0x7f7b68072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/547393781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b68073a70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 -- 172.21.15.52:0/547393781 >> 172.21.15.52:0/547393781 conn(0x7f7b6806c380 msgr2=0x7f7b6806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 -- 172.21.15.52:0/547393781 shutdown_connections 2024-06-02T16:46:13.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.707+0000 7f7b6ea00640 1 -- 172.21.15.52:0/547393781 wait complete. 2024-06-02T16:46:13.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.709+0000 7f7b6ea00640 1 Processor -- start 2024-06-02T16:46:13.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.709+0000 7f7b6ea00640 1 -- start start 2024-06-02T16:46:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 0x7f7b681f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b68073fb0 0x7f7b681e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68074580 con 0x7f7b681577f0 2024-06-02T16:46:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68161a40 con 0x7f7b68073fb0 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6ea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7b68072880 con 0x7f7b6806e840 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46874/0 (socket says 172.21.15.52:46874) 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6e000640 1 -- 172.21.15.52:0/3134498409 learned_addr learned my addr 172.21.15.52:0/3134498409 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6d600640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 0x7f7b681f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6cc00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b68073fb0 0x7f7b681e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6e000640 1 -- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 msgr2=0x7f7b681f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.710+0000 7f7b6e000640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 0x7f7b681f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6e000640 1 -- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b68073fb0 msgr2=0x7f7b681e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6e000640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b68073fb0 0x7f7b681e68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6e000640 1 -- 172.21.15.52:0/3134498409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b681f8bf0 con 0x7f7b681577f0 2024-06-02T16:46:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6d600640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 0x7f7b681f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6e000640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000cef0 tx=0x7f7b6000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6001a070 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6000d860 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b681f8ed0 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000dc50 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.711+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b680b4fc0 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.713+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b68075ea0 con 0x7f7b681577f0 2024-06-02T16:46:13.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.714+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b6001d070 con 0x7f7b681577f0 2024-06-02T16:46:13.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.715+0000 7f7b65600640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 0x7f7b480787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:13.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.715+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7b60097e50 con 0x7f7b681577f0 2024-06-02T16:46:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.715+0000 7f7b6d600640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 0x7f7b480787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.717+0000 7f7b6d600640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 0x7f7b480787c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c034000 tx=0x7f7b5c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:13.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.719+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b60061860 con 0x7f7b681577f0 2024-06-02T16:46:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.923+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b680b4dd0 con 0x7f7b48076300 2024-06-02T16:46:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.942+0000 7f7b65600640 1 -- 172.21.15.52:0/3134498409 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7f7b680b4dd0 con 0x7f7b48076300 2024-06-02T16:46:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:13.946 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:46:13.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 msgr2=0x7f7b480787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 0x7f7b480787c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c034000 tx=0x7f7b5c02e000 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 msgr2=0x7f7b681526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000cef0 tx=0x7f7b6000a710 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 shutdown_connections 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7b48076300 0x7f7b480787c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b681577f0 0x7f7b681526f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b68073fb0 0x7f7b681e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 --2- 172.21.15.52:0/3134498409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b6806e840 0x7f7b681f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 >> 172.21.15.52:0/3134498409 conn(0x7f7b6806c380 msgr2=0x7f7b6815c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 shutdown_connections 2024-06-02T16:46:13.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:13.948+0000 7f7b6ea00640 1 -- 172.21.15.52:0/3134498409 wait complete. 2024-06-02T16:46:13.967 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-06-02T16:46:12.013460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237064,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737656,"statfs":{"total":773094113280,"available":772851359744,"internally_reserved":0,"allocated":4333568,"data_stored":2383308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":238276158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.152407"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279465+0000","last_change":"2024-06-02T16:46:03.899601+0000","last_active":"2024-06-02T16:46:05.279465+0000","last_peered":"2024-06-02T16:46:05.279465+0000","last_clean":"2024-06-02T16:46:05.279465+0000","last_became_active":"2024-06-02T16:46:03.899249+0000","last_became_peered":"2024-06-02T16:46:03.899249+0000","last_unstale":"2024-06-02T16:46:05.279465+0000","last_undegraded":"2024-06-02T16:46:05.279465+0000","last_fullsized":"2024-06-02T16:46:05.279465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:11.446921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864289+0000","last_change":"2024-06-02T16:46:03.893509+0000","last_active":"2024-06-02T16:46:04.864289+0000","last_peered":"2024-06-02T16:46:04.864289+0000","last_clean":"2024-06-02T16:46:04.864289+0000","last_became_active":"2024-06-02T16:46:03.893090+0000","last_became_peered":"2024-06-02T16:46:03.893090+0000","last_unstale":"2024-06-02T16:46:04.864289+0000","last_undegraded":"2024-06-02T16:46:04.864289+0000","last_fullsized":"2024-06-02T16:46:04.864289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:14:46.311181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.369060+0000","last_change":"2024-06-02T16:46:03.906471+0000","last_active":"2024-06-02T16:46:05.369060+0000","last_peered":"2024-06-02T16:46:05.369060+0000","last_clean":"2024-06-02T16:46:05.369060+0000","last_became_active":"2024-06-02T16:46:03.904044+0000","last_became_peered":"2024-06-02T16:46:03.904044+0000","last_unstale":"2024-06-02T16:46:05.369060+0000","last_undegraded":"2024-06-02T16:46:05.369060+0000","last_fullsized":"2024-06-02T16:46:05.369060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906673+0000","last_change":"2024-06-02T16:46:03.915749+0000","last_active":"2024-06-02T16:46:04.906673+0000","last_peered":"2024-06-02T16:46:04.906673+0000","last_clean":"2024-06-02T16:46:04.906673+0000","last_became_active":"2024-06-02T16:46:03.915290+0000","last_became_peered":"2024-06-02T16:46:03.915290+0000","last_unstale":"2024-06-02T16:46:04.906673+0000","last_undegraded":"2024-06-02T16:46:04.906673+0000","last_fullsized":"2024-06-02T16:46:04.906673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:35:14.071460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368147+0000","last_change":"2024-06-02T16:46:03.886231+0000","last_active":"2024-06-02T16:46:05.368147+0000","last_peered":"2024-06-02T16:46:05.368147+0000","last_clean":"2024-06-02T16:46:05.368147+0000","last_became_active":"2024-06-02T16:46:03.884590+0000","last_became_peered":"2024-06-02T16:46:03.884590+0000","last_unstale":"2024-06-02T16:46:05.368147+0000","last_undegraded":"2024-06-02T16:46:05.368147+0000","last_fullsized":"2024-06-02T16:46:05.368147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:14.411004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863697+0000","last_change":"2024-06-02T16:46:03.890058+0000","last_active":"2024-06-02T16:46:04.863697+0000","last_peered":"2024-06-02T16:46:04.863697+0000","last_clean":"2024-06-02T16:46:04.863697+0000","last_became_active":"2024-06-02T16:46:03.889655+0000","last_became_peered":"2024-06-02T16:46:03.889655+0000","last_unstale":"2024-06-02T16:46:04.863697+0000","last_undegraded":"2024-06-02T16:46:04.863697+0000","last_fullsized":"2024-06-02T16:46:04.863697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:25.447402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867638+0000","last_change":"2024-06-02T16:46:03.900580+0000","last_active":"2024-06-02T16:46:04.867638+0000","last_peered":"2024-06-02T16:46:04.867638+0000","last_clean":"2024-06-02T16:46:04.867638+0000","last_became_active":"2024-06-02T16:46:03.899640+0000","last_became_peered":"2024-06-02T16:46:03.899640+0000","last_unstale":"2024-06-02T16:46:04.867638+0000","last_undegraded":"2024-06-02T16:46:04.867638+0000","last_fullsized":"2024-06-02T16:46:04.867638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867223+0000","last_change":"2024-06-02T16:46:03.908391+0000","last_active":"2024-06-02T16:46:04.867223+0000","last_peered":"2024-06-02T16:46:04.867223+0000","last_clean":"2024-06-02T16:46:04.867223+0000","last_became_active":"2024-06-02T16:46:03.907935+0000","last_became_peered":"2024-06-02T16:46:03.907935+0000","last_unstale":"2024-06-02T16:46:04.867223+0000","last_undegraded":"2024-06-02T16:46:04.867223+0000","last_fullsized":"2024-06-02T16:46:04.867223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.139188+0000","last_change":"2024-06-02T16:46:03.909678+0000","last_active":"2024-06-02T16:46:05.139188+0000","last_peered":"2024-06-02T16:46:05.139188+0000","last_clean":"2024-06-02T16:46:05.139188+0000","last_became_active":"2024-06-02T16:46:03.905007+0000","last_became_peered":"2024-06-02T16:46:03.905007+0000","last_unstale":"2024-06-02T16:46:05.139188+0000","last_undegraded":"2024-06-02T16:46:05.139188+0000","last_fullsized":"2024-06-02T16:46:05.139188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906905+0000","last_change":"2024-06-02T16:46:03.904815+0000","last_active":"2024-06-02T16:46:04.906905+0000","last_peered":"2024-06-02T16:46:04.906905+0000","last_clean":"2024-06-02T16:46:04.906905+0000","last_became_active":"2024-06-02T16:46:03.904505+0000","last_became_peered":"2024-06-02T16:46:03.904505+0000","last_unstale":"2024-06-02T16:46:04.906905+0000","last_undegraded":"2024-06-02T16:46:04.906905+0000","last_fullsized":"2024-06-02T16:46:04.906905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:29:48.997246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868493+0000","last_change":"2024-06-02T16:46:03.897768+0000","last_active":"2024-06-02T16:46:04.868493+0000","last_peered":"2024-06-02T16:46:04.868493+0000","last_clean":"2024-06-02T16:46:04.868493+0000","last_became_active":"2024-06-02T16:46:03.897473+0000","last_became_peered":"2024-06-02T16:46:03.897473+0000","last_unstale":"2024-06-02T16:46:04.868493+0000","last_undegraded":"2024-06-02T16:46:04.868493+0000","last_fullsized":"2024-06-02T16:46:04.868493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368748+0000","last_change":"2024-06-02T16:46:03.893747+0000","last_active":"2024-06-02T16:46:05.368748+0000","last_peered":"2024-06-02T16:46:05.368748+0000","last_clean":"2024-06-02T16:46:05.368748+0000","last_became_active":"2024-06-02T16:46:03.893457+0000","last_became_peered":"2024-06-02T16:46:03.893457+0000","last_unstale":"2024-06-02T16:46:05.368748+0000","last_undegraded":"2024-06-02T16:46:05.368748+0000","last_fullsized":"2024-06-02T16:46:05.368748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:01:30.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368341+0000","last_change":"2024-06-02T16:46:03.904170+0000","last_active":"2024-06-02T16:46:05.368341+0000","last_peered":"2024-06-02T16:46:05.368341+0000","last_clean":"2024-06-02T16:46:05.368341+0000","last_became_active":"2024-06-02T16:46:03.903910+0000","last_became_peered":"2024-06-02T16:46:03.903910+0000","last_unstale":"2024-06-02T16:46:05.368341+0000","last_undegraded":"2024-06-02T16:46:05.368341+0000","last_fullsized":"2024-06-02T16:46:05.368341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:07.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863907+0000","last_change":"2024-06-02T16:46:03.881096+0000","last_active":"2024-06-02T16:46:04.863907+0000","last_peered":"2024-06-02T16:46:04.863907+0000","last_clean":"2024-06-02T16:46:04.863907+0000","last_became_active":"2024-06-02T16:46:03.880588+0000","last_became_peered":"2024-06-02T16:46:03.880588+0000","last_unstale":"2024-06-02T16:46:04.863907+0000","last_undegraded":"2024-06-02T16:46:04.863907+0000","last_fullsized":"2024-06-02T16:46:04.863907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:58:55.278805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368517+0000","last_change":"2024-06-02T16:46:03.898043+0000","last_active":"2024-06-02T16:46:05.368517+0000","last_peered":"2024-06-02T16:46:05.368517+0000","last_clean":"2024-06-02T16:46:05.368517+0000","last_became_active":"2024-06-02T16:46:03.897729+0000","last_became_peered":"2024-06-02T16:46:03.897729+0000","last_unstale":"2024-06-02T16:46:05.368517+0000","last_undegraded":"2024-06-02T16:46:05.368517+0000","last_fullsized":"2024-06-02T16:46:05.368517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867980+0000","last_change":"2024-06-02T16:46:03.901353+0000","last_active":"2024-06-02T16:46:04.867980+0000","last_peered":"2024-06-02T16:46:04.867980+0000","last_clean":"2024-06-02T16:46:04.867980+0000","last_became_active":"2024-06-02T16:46:03.901086+0000","last_became_peered":"2024-06-02T16:46:03.901086+0000","last_unstale":"2024-06-02T16:46:04.867980+0000","last_undegraded":"2024-06-02T16:46:04.867980+0000","last_fullsized":"2024-06-02T16:46:04.867980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868905+0000","last_change":"2024-06-02T16:46:03.903426+0000","last_active":"2024-06-02T16:46:04.868905+0000","last_peered":"2024-06-02T16:46:04.868905+0000","last_clean":"2024-06-02T16:46:04.868905+0000","last_became_active":"2024-06-02T16:46:03.903109+0000","last_became_peered":"2024-06-02T16:46:03.903109+0000","last_unstale":"2024-06-02T16:46:04.868905+0000","last_undegraded":"2024-06-02T16:46:04.868905+0000","last_fullsized":"2024-06-02T16:46:04.868905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864498+0000","last_change":"2024-06-02T16:46:03.908555+0000","last_active":"2024-06-02T16:46:04.864498+0000","last_peered":"2024-06-02T16:46:04.864498+0000","last_clean":"2024-06-02T16:46:04.864498+0000","last_became_active":"2024-06-02T16:46:03.908205+0000","last_became_peered":"2024-06-02T16:46:03.908205+0000","last_unstale":"2024-06-02T16:46:04.864498+0000","last_undegraded":"2024-06-02T16:46:04.864498+0000","last_fullsized":"2024-06-02T16:46:04.864498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:39:01.011537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863658+0000","last_change":"2024-06-02T16:46:03.897750+0000","last_active":"2024-06-02T16:46:04.863658+0000","last_peered":"2024-06-02T16:46:04.863658+0000","last_clean":"2024-06-02T16:46:04.863658+0000","last_became_active":"2024-06-02T16:46:03.897419+0000","last_became_peered":"2024-06-02T16:46:03.897419+0000","last_unstale":"2024-06-02T16:46:04.863658+0000","last_undegraded":"2024-06-02T16:46:04.863658+0000","last_fullsized":"2024-06-02T16:46:04.863658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368584+0000","last_change":"2024-06-02T16:46:03.899325+0000","last_active":"2024-06-02T16:46:05.368584+0000","last_peered":"2024-06-02T16:46:05.368584+0000","last_clean":"2024-06-02T16:46:05.368584+0000","last_became_active":"2024-06-02T16:46:03.899055+0000","last_became_peered":"2024-06-02T16:46:03.899055+0000","last_unstale":"2024-06-02T16:46:05.368584+0000","last_undegraded":"2024-06-02T16:46:05.368584+0000","last_fullsized":"2024-06-02T16:46:05.368584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:45.034318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138134+0000","last_change":"2024-06-02T16:46:03.906474+0000","last_active":"2024-06-02T16:46:05.138134+0000","last_peered":"2024-06-02T16:46:05.138134+0000","last_clean":"2024-06-02T16:46:05.138134+0000","last_became_active":"2024-06-02T16:46:03.906146+0000","last_became_peered":"2024-06-02T16:46:03.906146+0000","last_unstale":"2024-06-02T16:46:05.138134+0000","last_undegraded":"2024-06-02T16:46:05.138134+0000","last_fullsized":"2024-06-02T16:46:05.138134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:19.601796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137839+0000","last_change":"2024-06-02T16:46:03.910134+0000","last_active":"2024-06-02T16:46:05.137839+0000","last_peered":"2024-06-02T16:46:05.137839+0000","last_clean":"2024-06-02T16:46:05.137839+0000","last_became_active":"2024-06-02T16:46:03.909544+0000","last_became_peered":"2024-06-02T16:46:03.909544+0000","last_unstale":"2024-06-02T16:46:05.137839+0000","last_undegraded":"2024-06-02T16:46:05.137839+0000","last_fullsized":"2024-06-02T16:46:05.137839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:23.137749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900149+0000","last_change":"2024-06-02T16:46:03.895902+0000","last_active":"2024-06-02T16:46:04.900149+0000","last_peered":"2024-06-02T16:46:04.900149+0000","last_clean":"2024-06-02T16:46:04.900149+0000","last_became_active":"2024-06-02T16:46:03.895533+0000","last_became_peered":"2024-06-02T16:46:03.895533+0000","last_unstale":"2024-06-02T16:46:04.900149+0000","last_undegraded":"2024-06-02T16:46:04.900149+0000","last_fullsized":"2024-06-02T16:46:04.900149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368573+0000","last_change":"2024-06-02T16:46:03.889132+0000","last_active":"2024-06-02T16:46:05.368573+0000","last_peered":"2024-06-02T16:46:05.368573+0000","last_clean":"2024-06-02T16:46:05.368573+0000","last_became_active":"2024-06-02T16:46:03.888335+0000","last_became_peered":"2024-06-02T16:46:03.888335+0000","last_unstale":"2024-06-02T16:46:05.368573+0000","last_undegraded":"2024-06-02T16:46:05.368573+0000","last_fullsized":"2024-06-02T16:46:05.368573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:20:52.872143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907072+0000","last_change":"2024-06-02T16:46:03.903124+0000","last_active":"2024-06-02T16:46:04.907072+0000","last_peered":"2024-06-02T16:46:04.907072+0000","last_clean":"2024-06-02T16:46:04.907072+0000","last_became_active":"2024-06-02T16:46:03.902585+0000","last_became_peered":"2024-06-02T16:46:03.902585+0000","last_unstale":"2024-06-02T16:46:04.907072+0000","last_undegraded":"2024-06-02T16:46:04.907072+0000","last_fullsized":"2024-06-02T16:46:04.907072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:06:39.170619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864639+0000","last_change":"2024-06-02T16:46:03.894665+0000","last_active":"2024-06-02T16:46:04.864639+0000","last_peered":"2024-06-02T16:46:04.864639+0000","last_clean":"2024-06-02T16:46:04.864639+0000","last_became_active":"2024-06-02T16:46:03.894317+0000","last_became_peered":"2024-06-02T16:46:03.894317+0000","last_unstale":"2024-06-02T16:46:04.864639+0000","last_undegraded":"2024-06-02T16:46:04.864639+0000","last_fullsized":"2024-06-02T16:46:04.864639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:15:46.823260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907039+0000","last_change":"2024-06-02T16:46:03.918112+0000","last_active":"2024-06-02T16:46:04.907039+0000","last_peered":"2024-06-02T16:46:04.907039+0000","last_clean":"2024-06-02T16:46:04.907039+0000","last_became_active":"2024-06-02T16:46:03.916981+0000","last_became_peered":"2024-06-02T16:46:03.916981+0000","last_unstale":"2024-06-02T16:46:04.907039+0000","last_undegraded":"2024-06-02T16:46:04.907039+0000","last_fullsized":"2024-06-02T16:46:04.907039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:58.035427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368876+0000","last_change":"2024-06-02T16:46:03.896638+0000","last_active":"2024-06-02T16:46:05.368876+0000","last_peered":"2024-06-02T16:46:05.368876+0000","last_clean":"2024-06-02T16:46:05.368876+0000","last_became_active":"2024-06-02T16:46:03.896360+0000","last_became_peered":"2024-06-02T16:46:03.896360+0000","last_unstale":"2024-06-02T16:46:05.368876+0000","last_undegraded":"2024-06-02T16:46:05.368876+0000","last_fullsized":"2024-06-02T16:46:05.368876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138554+0000","last_change":"2024-06-02T16:46:03.904596+0000","last_active":"2024-06-02T16:46:05.138554+0000","last_peered":"2024-06-02T16:46:05.138554+0000","last_clean":"2024-06-02T16:46:05.138554+0000","last_became_active":"2024-06-02T16:46:03.901408+0000","last_became_peered":"2024-06-02T16:46:03.901408+0000","last_unstale":"2024-06-02T16:46:05.138554+0000","last_undegraded":"2024-06-02T16:46:05.138554+0000","last_fullsized":"2024-06-02T16:46:05.138554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868136+0000","last_change":"2024-06-02T16:46:03.903410+0000","last_active":"2024-06-02T16:46:04.868136+0000","last_peered":"2024-06-02T16:46:04.868136+0000","last_clean":"2024-06-02T16:46:04.868136+0000","last_became_active":"2024-06-02T16:46:03.903107+0000","last_became_peered":"2024-06-02T16:46:03.903107+0000","last_unstale":"2024-06-02T16:46:04.868136+0000","last_undegraded":"2024-06-02T16:46:04.868136+0000","last_fullsized":"2024-06-02T16:46:04.868136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:12:56.306128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279483+0000","last_change":"2024-06-02T16:46:03.895116+0000","last_active":"2024-06-02T16:46:05.279483+0000","last_peered":"2024-06-02T16:46:05.279483+0000","last_clean":"2024-06-02T16:46:05.279483+0000","last_became_active":"2024-06-02T16:46:03.894743+0000","last_became_peered":"2024-06-02T16:46:03.894743+0000","last_unstale":"2024-06-02T16:46:05.279483+0000","last_undegraded":"2024-06-02T16:46:05.279483+0000","last_fullsized":"2024-06-02T16:46:05.279483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:46.689792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867072+0000","last_change":"2024-06-02T16:46:03.914694+0000","last_active":"2024-06-02T16:46:04.867072+0000","last_peered":"2024-06-02T16:46:04.867072+0000","last_clean":"2024-06-02T16:46:04.867072+0000","last_became_active":"2024-06-02T16:46:03.914442+0000","last_became_peered":"2024-06-02T16:46:03.914442+0000","last_unstale":"2024-06-02T16:46:04.867072+0000","last_undegraded":"2024-06-02T16:46:04.867072+0000","last_fullsized":"2024-06-02T16:46:04.867072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:47.073886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900641+0000","last_change":"2024-06-02T16:46:03.896326+0000","last_active":"2024-06-02T16:46:04.900641+0000","last_peered":"2024-06-02T16:46:04.900641+0000","last_clean":"2024-06-02T16:46:04.900641+0000","last_became_active":"2024-06-02T16:46:03.896032+0000","last_became_peered":"2024-06-02T16:46:03.896032+0000","last_unstale":"2024-06-02T16:46:04.900641+0000","last_undegraded":"2024-06-02T16:46:04.900641+0000","last_fullsized":"2024-06-02T16:46:04.900641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279614+0000","last_change":"2024-06-02T16:46:02.888949+0000","last_active":"2024-06-02T16:46:05.279614+0000","last_peered":"2024-06-02T16:46:05.279614+0000","last_clean":"2024-06-02T16:46:05.279614+0000","last_became_active":"2024-06-02T16:46:02.888543+0000","last_became_peered":"2024-06-02T16:46:02.888543+0000","last_unstale":"2024-06-02T16:46:05.279614+0000","last_undegraded":"2024-06-02T16:46:05.279614+0000","last_fullsized":"2024-06-02T16:46:05.279614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279662+0000","last_change":"2024-06-02T16:46:03.897726+0000","last_active":"2024-06-02T16:46:05.279662+0000","last_peered":"2024-06-02T16:46:05.279662+0000","last_clean":"2024-06-02T16:46:05.279662+0000","last_became_active":"2024-06-02T16:46:03.897418+0000","last_became_peered":"2024-06-02T16:46:03.897418+0000","last_unstale":"2024-06-02T16:46:05.279662+0000","last_undegraded":"2024-06-02T16:46:05.279662+0000","last_fullsized":"2024-06-02T16:46:05.279662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900744+0000","last_change":"2024-06-02T16:46:02.893537+0000","last_active":"2024-06-02T16:46:04.900744+0000","last_peered":"2024-06-02T16:46:04.900744+0000","last_clean":"2024-06-02T16:46:04.900744+0000","last_became_active":"2024-06-02T16:46:02.892005+0000","last_became_peered":"2024-06-02T16:46:02.892005+0000","last_unstale":"2024-06-02T16:46:04.900744+0000","last_undegraded":"2024-06-02T16:46:04.900744+0000","last_fullsized":"2024-06-02T16:46:04.900744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:52.864313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138646+0000","last_change":"2024-06-02T16:46:03.901369+0000","last_active":"2024-06-02T16:46:05.138646+0000","last_peered":"2024-06-02T16:46:05.138646+0000","last_clean":"2024-06-02T16:46:05.138646+0000","last_became_active":"2024-06-02T16:46:03.901096+0000","last_became_peered":"2024-06-02T16:46:03.901096+0000","last_unstale":"2024-06-02T16:46:05.138646+0000","last_undegraded":"2024-06-02T16:46:05.138646+0000","last_fullsized":"2024-06-02T16:46:05.138646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863809+0000","last_change":"2024-06-02T16:46:02.885969+0000","last_active":"2024-06-02T16:46:04.863809+0000","last_peered":"2024-06-02T16:46:04.863809+0000","last_clean":"2024-06-02T16:46:04.863809+0000","last_became_active":"2024-06-02T16:46:02.885069+0000","last_became_peered":"2024-06-02T16:46:02.885069+0000","last_unstale":"2024-06-02T16:46:04.863809+0000","last_undegraded":"2024-06-02T16:46:04.863809+0000","last_fullsized":"2024-06-02T16:46:04.863809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:18:18.595331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907071+0000","last_change":"2024-06-02T16:46:03.908371+0000","last_active":"2024-06-02T16:46:04.907071+0000","last_peered":"2024-06-02T16:46:04.907071+0000","last_clean":"2024-06-02T16:46:04.907071+0000","last_became_active":"2024-06-02T16:46:03.908082+0000","last_became_peered":"2024-06-02T16:46:03.908082+0000","last_unstale":"2024-06-02T16:46:04.907071+0000","last_undegraded":"2024-06-02T16:46:04.907071+0000","last_fullsized":"2024-06-02T16:46:04.907071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:36:56.550451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368887+0000","last_change":"2024-06-02T16:46:02.884689+0000","last_active":"2024-06-02T16:46:05.368887+0000","last_peered":"2024-06-02T16:46:05.368887+0000","last_clean":"2024-06-02T16:46:05.368887+0000","last_became_active":"2024-06-02T16:46:02.884375+0000","last_became_peered":"2024-06-02T16:46:02.884375+0000","last_unstale":"2024-06-02T16:46:05.368887+0000","last_undegraded":"2024-06-02T16:46:05.368887+0000","last_fullsized":"2024-06-02T16:46:05.368887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:55.925445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868244+0000","last_change":"2024-06-02T16:46:03.915192+0000","last_active":"2024-06-02T16:46:04.868244+0000","last_peered":"2024-06-02T16:46:04.868244+0000","last_clean":"2024-06-02T16:46:04.868244+0000","last_became_active":"2024-06-02T16:46:03.914914+0000","last_became_peered":"2024-06-02T16:46:03.914914+0000","last_unstale":"2024-06-02T16:46:04.868244+0000","last_undegraded":"2024-06-02T16:46:04.868244+0000","last_fullsized":"2024-06-02T16:46:04.868244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138893+0000","last_change":"2024-06-02T16:46:02.890589+0000","last_active":"2024-06-02T16:46:05.138893+0000","last_peered":"2024-06-02T16:46:05.138893+0000","last_clean":"2024-06-02T16:46:05.138893+0000","last_became_active":"2024-06-02T16:46:02.890352+0000","last_became_peered":"2024-06-02T16:46:02.890352+0000","last_unstale":"2024-06-02T16:46:05.138893+0000","last_undegraded":"2024-06-02T16:46:05.138893+0000","last_fullsized":"2024-06-02T16:46:05.138893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368907+0000","last_change":"2024-06-02T16:46:03.897804+0000","last_active":"2024-06-02T16:46:05.368907+0000","last_peered":"2024-06-02T16:46:05.368907+0000","last_clean":"2024-06-02T16:46:05.368907+0000","last_became_active":"2024-06-02T16:46:03.896250+0000","last_became_peered":"2024-06-02T16:46:03.896250+0000","last_unstale":"2024-06-02T16:46:05.368907+0000","last_undegraded":"2024-06-02T16:46:05.368907+0000","last_fullsized":"2024-06-02T16:46:05.368907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:10.063172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137697+0000","last_change":"2024-06-02T16:46:02.887796+0000","last_active":"2024-06-02T16:46:05.137697+0000","last_peered":"2024-06-02T16:46:05.137697+0000","last_clean":"2024-06-02T16:46:05.137697+0000","last_became_active":"2024-06-02T16:46:02.887447+0000","last_became_peered":"2024-06-02T16:46:02.887447+0000","last_unstale":"2024-06-02T16:46:05.137697+0000","last_undegraded":"2024-06-02T16:46:05.137697+0000","last_fullsized":"2024-06-02T16:46:05.137697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:40:13.404538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137630+0000","last_change":"2024-06-02T16:46:03.906099+0000","last_active":"2024-06-02T16:46:05.137630+0000","last_peered":"2024-06-02T16:46:05.137630+0000","last_clean":"2024-06-02T16:46:05.137630+0000","last_became_active":"2024-06-02T16:46:03.905768+0000","last_became_peered":"2024-06-02T16:46:03.905768+0000","last_unstale":"2024-06-02T16:46:05.137630+0000","last_undegraded":"2024-06-02T16:46:05.137630+0000","last_fullsized":"2024-06-02T16:46:05.137630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:03.026588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863246+0000","last_change":"2024-06-02T16:46:02.881438+0000","last_active":"2024-06-02T16:46:04.863246+0000","last_peered":"2024-06-02T16:46:04.863246+0000","last_clean":"2024-06-02T16:46:04.863246+0000","last_became_active":"2024-06-02T16:46:02.881163+0000","last_became_peered":"2024-06-02T16:46:02.881163+0000","last_unstale":"2024-06-02T16:46:04.863246+0000","last_undegraded":"2024-06-02T16:46:04.863246+0000","last_fullsized":"2024-06-02T16:46:04.863246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:29:45.683326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906289+0000","last_change":"2024-06-02T16:46:03.901916+0000","last_active":"2024-06-02T16:46:04.906289+0000","last_peered":"2024-06-02T16:46:04.906289+0000","last_clean":"2024-06-02T16:46:04.906289+0000","last_became_active":"2024-06-02T16:46:03.901614+0000","last_became_peered":"2024-06-02T16:46:03.901614+0000","last_unstale":"2024-06-02T16:46:04.906289+0000","last_undegraded":"2024-06-02T16:46:04.906289+0000","last_fullsized":"2024-06-02T16:46:04.906289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:06.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137528+0000","last_change":"2024-06-02T16:46:02.887974+0000","last_active":"2024-06-02T16:46:05.137528+0000","last_peered":"2024-06-02T16:46:05.137528+0000","last_clean":"2024-06-02T16:46:05.137528+0000","last_became_active":"2024-06-02T16:46:02.887518+0000","last_became_peered":"2024-06-02T16:46:02.887518+0000","last_unstale":"2024-06-02T16:46:05.137528+0000","last_undegraded":"2024-06-02T16:46:05.137528+0000","last_fullsized":"2024-06-02T16:46:05.137528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:01:41.542744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.369387+0000","last_change":"2024-06-02T16:46:03.889252+0000","last_active":"2024-06-02T16:46:05.369387+0000","last_peered":"2024-06-02T16:46:05.369387+0000","last_clean":"2024-06-02T16:46:05.369387+0000","last_became_active":"2024-06-02T16:46:03.888930+0000","last_became_peered":"2024-06-02T16:46:03.888930+0000","last_unstale":"2024-06-02T16:46:05.369387+0000","last_undegraded":"2024-06-02T16:46:05.369387+0000","last_fullsized":"2024-06-02T16:46:05.369387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864189+0000","last_change":"2024-06-02T16:46:02.893885+0000","last_active":"2024-06-02T16:46:04.864189+0000","last_peered":"2024-06-02T16:46:04.864189+0000","last_clean":"2024-06-02T16:46:04.864189+0000","last_became_active":"2024-06-02T16:46:02.893025+0000","last_became_peered":"2024-06-02T16:46:02.893025+0000","last_unstale":"2024-06-02T16:46:04.864189+0000","last_undegraded":"2024-06-02T16:46:04.864189+0000","last_fullsized":"2024-06-02T16:46:04.864189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:04:22.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864239+0000","last_change":"2024-06-02T16:46:03.899191+0000","last_active":"2024-06-02T16:46:04.864239+0000","last_peered":"2024-06-02T16:46:04.864239+0000","last_clean":"2024-06-02T16:46:04.864239+0000","last_became_active":"2024-06-02T16:46:03.898870+0000","last_became_peered":"2024-06-02T16:46:03.898870+0000","last_unstale":"2024-06-02T16:46:04.864239+0000","last_undegraded":"2024-06-02T16:46:04.864239+0000","last_fullsized":"2024-06-02T16:46:04.864239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:19.682458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.901356+0000","last_change":"2024-06-02T16:46:02.891514+0000","last_active":"2024-06-02T16:46:04.901356+0000","last_peered":"2024-06-02T16:46:04.901356+0000","last_clean":"2024-06-02T16:46:04.901356+0000","last_became_active":"2024-06-02T16:46:02.890402+0000","last_became_peered":"2024-06-02T16:46:02.890402+0000","last_unstale":"2024-06-02T16:46:04.901356+0000","last_undegraded":"2024-06-02T16:46:04.901356+0000","last_fullsized":"2024-06-02T16:46:04.901356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:43.161036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863931+0000","last_change":"2024-06-02T16:46:03.894968+0000","last_active":"2024-06-02T16:46:04.863931+0000","last_peered":"2024-06-02T16:46:04.863931+0000","last_clean":"2024-06-02T16:46:04.863931+0000","last_became_active":"2024-06-02T16:46:03.894677+0000","last_became_peered":"2024-06-02T16:46:03.894677+0000","last_unstale":"2024-06-02T16:46:04.863931+0000","last_undegraded":"2024-06-02T16:46:04.863931+0000","last_fullsized":"2024-06-02T16:46:04.863931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:47:50.909155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.369176+0000","last_change":"2024-06-02T16:46:02.891663+0000","last_active":"2024-06-02T16:46:05.369176+0000","last_peered":"2024-06-02T16:46:05.369176+0000","last_clean":"2024-06-02T16:46:05.369176+0000","last_became_active":"2024-06-02T16:46:02.891289+0000","last_became_peered":"2024-06-02T16:46:02.891289+0000","last_unstale":"2024-06-02T16:46:05.369176+0000","last_undegraded":"2024-06-02T16:46:05.369176+0000","last_fullsized":"2024-06-02T16:46:05.369176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:50.505687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368841+0000","last_change":"2024-06-02T16:46:03.905722+0000","last_active":"2024-06-02T16:46:05.368841+0000","last_peered":"2024-06-02T16:46:05.368841+0000","last_clean":"2024-06-02T16:46:05.368841+0000","last_became_active":"2024-06-02T16:46:03.904804+0000","last_became_peered":"2024-06-02T16:46:03.904804+0000","last_unstale":"2024-06-02T16:46:05.368841+0000","last_undegraded":"2024-06-02T16:46:05.368841+0000","last_fullsized":"2024-06-02T16:46:05.368841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:03:06.327924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863977+0000","last_change":"2024-06-02T16:46:02.891914+0000","last_active":"2024-06-02T16:46:04.863977+0000","last_peered":"2024-06-02T16:46:04.863977+0000","last_clean":"2024-06-02T16:46:04.863977+0000","last_became_active":"2024-06-02T16:46:02.891501+0000","last_became_peered":"2024-06-02T16:46:02.891501+0000","last_unstale":"2024-06-02T16:46:04.863977+0000","last_undegraded":"2024-06-02T16:46:04.863977+0000","last_fullsized":"2024-06-02T16:46:04.863977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:26:02.020123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906357+0000","last_change":"2024-06-02T16:46:03.901154+0000","last_active":"2024-06-02T16:46:04.906357+0000","last_peered":"2024-06-02T16:46:04.906357+0000","last_clean":"2024-06-02T16:46:04.906357+0000","last_became_active":"2024-06-02T16:46:03.900908+0000","last_became_peered":"2024-06-02T16:46:03.900908+0000","last_unstale":"2024-06-02T16:46:04.906357+0000","last_undegraded":"2024-06-02T16:46:04.906357+0000","last_fullsized":"2024-06-02T16:46:04.906357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:18:46.765644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138914+0000","last_change":"2024-06-02T16:46:02.884664+0000","last_active":"2024-06-02T16:46:05.138914+0000","last_peered":"2024-06-02T16:46:05.138914+0000","last_clean":"2024-06-02T16:46:05.138914+0000","last_became_active":"2024-06-02T16:46:02.884222+0000","last_became_peered":"2024-06-02T16:46:02.884222+0000","last_unstale":"2024-06-02T16:46:05.138914+0000","last_undegraded":"2024-06-02T16:46:05.138914+0000","last_fullsized":"2024-06-02T16:46:05.138914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.864235+0000","last_change":"2024-06-02T16:46:03.894341+0000","last_active":"2024-06-02T16:46:04.864235+0000","last_peered":"2024-06-02T16:46:04.864235+0000","last_clean":"2024-06-02T16:46:04.864235+0000","last_became_active":"2024-06-02T16:46:03.894036+0000","last_became_peered":"2024-06-02T16:46:03.894036+0000","last_unstale":"2024-06-02T16:46:04.864235+0000","last_undegraded":"2024-06-02T16:46:04.864235+0000","last_fullsized":"2024-06-02T16:46:04.864235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:53:33.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906447+0000","last_change":"2024-06-02T16:46:02.882333+0000","last_active":"2024-06-02T16:46:04.906447+0000","last_peered":"2024-06-02T16:46:04.906447+0000","last_clean":"2024-06-02T16:46:04.906447+0000","last_became_active":"2024-06-02T16:46:02.882046+0000","last_became_peered":"2024-06-02T16:46:02.882046+0000","last_unstale":"2024-06-02T16:46:04.906447+0000","last_undegraded":"2024-06-02T16:46:04.906447+0000","last_fullsized":"2024-06-02T16:46:04.906447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:29.419254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867524+0000","last_change":"2024-06-02T16:46:03.905599+0000","last_active":"2024-06-02T16:46:04.867524+0000","last_peered":"2024-06-02T16:46:04.867524+0000","last_clean":"2024-06-02T16:46:04.867524+0000","last_became_active":"2024-06-02T16:46:03.905288+0000","last_became_peered":"2024-06-02T16:46:03.905288+0000","last_unstale":"2024-06-02T16:46:04.867524+0000","last_undegraded":"2024-06-02T16:46:04.867524+0000","last_fullsized":"2024-06-02T16:46:04.867524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:41.167374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863127+0000","last_change":"2024-06-02T16:46:02.891190+0000","last_active":"2024-06-02T16:46:04.863127+0000","last_peered":"2024-06-02T16:46:04.863127+0000","last_clean":"2024-06-02T16:46:04.863127+0000","last_became_active":"2024-06-02T16:46:02.890783+0000","last_became_peered":"2024-06-02T16:46:02.890783+0000","last_unstale":"2024-06-02T16:46:04.863127+0000","last_undegraded":"2024-06-02T16:46:04.863127+0000","last_fullsized":"2024-06-02T16:46:04.863127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:18.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279705+0000","last_change":"2024-06-02T16:46:03.894216+0000","last_active":"2024-06-02T16:46:05.279705+0000","last_peered":"2024-06-02T16:46:05.279705+0000","last_clean":"2024-06-02T16:46:05.279705+0000","last_became_active":"2024-06-02T16:46:03.893381+0000","last_became_peered":"2024-06-02T16:46:03.893381+0000","last_unstale":"2024-06-02T16:46:05.279705+0000","last_undegraded":"2024-06-02T16:46:05.279705+0000","last_fullsized":"2024-06-02T16:46:05.279705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863361+0000","last_change":"2024-06-02T16:46:02.885194+0000","last_active":"2024-06-02T16:46:04.863361+0000","last_peered":"2024-06-02T16:46:04.863361+0000","last_clean":"2024-06-02T16:46:04.863361+0000","last_became_active":"2024-06-02T16:46:02.884879+0000","last_became_peered":"2024-06-02T16:46:02.884879+0000","last_unstale":"2024-06-02T16:46:04.863361+0000","last_undegraded":"2024-06-02T16:46:04.863361+0000","last_fullsized":"2024-06-02T16:46:04.863361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:51.294201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138129+0000","last_change":"2024-06-02T16:46:03.909612+0000","last_active":"2024-06-02T16:46:05.138129+0000","last_peered":"2024-06-02T16:46:05.138129+0000","last_clean":"2024-06-02T16:46:05.138129+0000","last_became_active":"2024-06-02T16:46:03.909152+0000","last_became_peered":"2024-06-02T16:46:03.909152+0000","last_unstale":"2024-06-02T16:46:05.138129+0000","last_undegraded":"2024-06-02T16:46:05.138129+0000","last_fullsized":"2024-06-02T16:46:05.138129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:54:42.611126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907128+0000","last_change":"2024-06-02T16:46:02.888602+0000","last_active":"2024-06-02T16:46:04.907128+0000","last_peered":"2024-06-02T16:46:04.907128+0000","last_clean":"2024-06-02T16:46:04.907128+0000","last_became_active":"2024-06-02T16:46:02.887961+0000","last_became_peered":"2024-06-02T16:46:02.887961+0000","last_unstale":"2024-06-02T16:46:04.907128+0000","last_undegraded":"2024-06-02T16:46:04.907128+0000","last_fullsized":"2024-06-02T16:46:04.907128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:39.314302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.369547+0000","last_change":"2024-06-02T16:46:03.893517+0000","last_active":"2024-06-02T16:46:05.369547+0000","last_peered":"2024-06-02T16:46:05.369547+0000","last_clean":"2024-06-02T16:46:05.369547+0000","last_became_active":"2024-06-02T16:46:03.893145+0000","last_became_peered":"2024-06-02T16:46:03.893145+0000","last_unstale":"2024-06-02T16:46:05.369547+0000","last_undegraded":"2024-06-02T16:46:05.369547+0000","last_fullsized":"2024-06-02T16:46:05.369547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:25.447402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138044+0000","last_change":"2024-06-02T16:46:02.887086+0000","last_active":"2024-06-02T16:46:05.138044+0000","last_peered":"2024-06-02T16:46:05.138044+0000","last_clean":"2024-06-02T16:46:05.138044+0000","last_became_active":"2024-06-02T16:46:02.886357+0000","last_became_peered":"2024-06-02T16:46:02.886357+0000","last_unstale":"2024-06-02T16:46:05.138044+0000","last_undegraded":"2024-06-02T16:46:05.138044+0000","last_fullsized":"2024-06-02T16:46:05.138044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:46:20.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906778+0000","last_change":"2024-06-02T16:46:03.914717+0000","last_active":"2024-06-02T16:46:04.906778+0000","last_peered":"2024-06-02T16:46:04.906778+0000","last_clean":"2024-06-02T16:46:04.906778+0000","last_became_active":"2024-06-02T16:46:03.913526+0000","last_became_peered":"2024-06-02T16:46:03.913526+0000","last_unstale":"2024-06-02T16:46:04.906778+0000","last_undegraded":"2024-06-02T16:46:04.906778+0000","last_fullsized":"2024-06-02T16:46:04.906778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:32:54.736579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138487+0000","last_change":"2024-06-02T16:46:02.888288+0000","last_active":"2024-06-02T16:46:05.138487+0000","last_peered":"2024-06-02T16:46:05.138487+0000","last_clean":"2024-06-02T16:46:05.138487+0000","last_became_active":"2024-06-02T16:46:02.883890+0000","last_became_peered":"2024-06-02T16:46:02.883890+0000","last_unstale":"2024-06-02T16:46:05.138487+0000","last_undegraded":"2024-06-02T16:46:05.138487+0000","last_fullsized":"2024-06-02T16:46:05.138487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368926+0000","last_change":"2024-06-02T16:46:03.906699+0000","last_active":"2024-06-02T16:46:05.368926+0000","last_peered":"2024-06-02T16:46:05.368926+0000","last_clean":"2024-06-02T16:46:05.368926+0000","last_became_active":"2024-06-02T16:46:03.906415+0000","last_became_peered":"2024-06-02T16:46:03.906415+0000","last_unstale":"2024-06-02T16:46:05.368926+0000","last_undegraded":"2024-06-02T16:46:05.368926+0000","last_fullsized":"2024-06-02T16:46:05.368926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:06.636155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.138482+0000","last_change":"2024-06-02T16:46:02.886711+0000","last_active":"2024-06-02T16:46:05.138482+0000","last_peered":"2024-06-02T16:46:05.138482+0000","last_clean":"2024-06-02T16:46:05.138482+0000","last_became_active":"2024-06-02T16:46:02.886377+0000","last_became_peered":"2024-06-02T16:46:02.886377+0000","last_unstale":"2024-06-02T16:46:05.138482+0000","last_undegraded":"2024-06-02T16:46:05.138482+0000","last_fullsized":"2024-06-02T16:46:05.138482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:56:38.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368482+0000","last_change":"2024-06-02T16:46:03.910758+0000","last_active":"2024-06-02T16:46:05.368482+0000","last_peered":"2024-06-02T16:46:05.368482+0000","last_clean":"2024-06-02T16:46:05.368482+0000","last_became_active":"2024-06-02T16:46:03.910435+0000","last_became_peered":"2024-06-02T16:46:03.910435+0000","last_unstale":"2024-06-02T16:46:05.368482+0000","last_undegraded":"2024-06-02T16:46:05.368482+0000","last_fullsized":"2024-06-02T16:46:05.368482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:01:53.870778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900426+0000","last_change":"2024-06-02T16:46:02.883493+0000","last_active":"2024-06-02T16:46:04.900426+0000","last_peered":"2024-06-02T16:46:04.900426+0000","last_clean":"2024-06-02T16:46:04.900426+0000","last_became_active":"2024-06-02T16:46:02.880100+0000","last_became_peered":"2024-06-02T16:46:02.880100+0000","last_unstale":"2024-06-02T16:46:04.900426+0000","last_undegraded":"2024-06-02T16:46:04.900426+0000","last_fullsized":"2024-06-02T16:46:04.900426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:02.344035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368571+0000","last_change":"2024-06-02T16:46:03.907359+0000","last_active":"2024-06-02T16:46:05.368571+0000","last_peered":"2024-06-02T16:46:05.368571+0000","last_clean":"2024-06-02T16:46:05.368571+0000","last_became_active":"2024-06-02T16:46:03.906700+0000","last_became_peered":"2024-06-02T16:46:03.906700+0000","last_unstale":"2024-06-02T16:46:05.368571+0000","last_undegraded":"2024-06-02T16:46:05.368571+0000","last_fullsized":"2024-06-02T16:46:05.368571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:03:44.167501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279390+0000","last_change":"2024-06-02T16:46:02.895540+0000","last_active":"2024-06-02T16:46:05.279390+0000","last_peered":"2024-06-02T16:46:05.279390+0000","last_clean":"2024-06-02T16:46:05.279390+0000","last_became_active":"2024-06-02T16:46:02.895129+0000","last_became_peered":"2024-06-02T16:46:02.895129+0000","last_unstale":"2024-06-02T16:46:05.279390+0000","last_undegraded":"2024-06-02T16:46:05.279390+0000","last_fullsized":"2024-06-02T16:46:05.279390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:56.067013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368811+0000","last_change":"2024-06-02T16:46:03.895347+0000","last_active":"2024-06-02T16:46:05.368811+0000","last_peered":"2024-06-02T16:46:05.368811+0000","last_clean":"2024-06-02T16:46:05.368811+0000","last_became_active":"2024-06-02T16:46:03.894742+0000","last_became_peered":"2024-06-02T16:46:03.894742+0000","last_unstale":"2024-06-02T16:46:05.368811+0000","last_undegraded":"2024-06-02T16:46:05.368811+0000","last_fullsized":"2024-06-02T16:46:05.368811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:03.350501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137625+0000","last_change":"2024-06-02T16:46:02.882260+0000","last_active":"2024-06-02T16:46:05.137625+0000","last_peered":"2024-06-02T16:46:05.137625+0000","last_clean":"2024-06-02T16:46:05.137625+0000","last_became_active":"2024-06-02T16:46:02.875091+0000","last_became_peered":"2024-06-02T16:46:02.875091+0000","last_unstale":"2024-06-02T16:46:05.137625+0000","last_undegraded":"2024-06-02T16:46:05.137625+0000","last_fullsized":"2024-06-02T16:46:05.137625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:41:02.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867216+0000","last_change":"2024-06-02T16:46:03.899743+0000","last_active":"2024-06-02T16:46:04.867216+0000","last_peered":"2024-06-02T16:46:04.867216+0000","last_clean":"2024-06-02T16:46:04.867216+0000","last_became_active":"2024-06-02T16:46:03.899449+0000","last_became_peered":"2024-06-02T16:46:03.899449+0000","last_unstale":"2024-06-02T16:46:04.867216+0000","last_undegraded":"2024-06-02T16:46:04.867216+0000","last_fullsized":"2024-06-02T16:46:04.867216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:51:10.389959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368153+0000","last_change":"2024-06-02T16:46:02.890214+0000","last_active":"2024-06-02T16:46:05.368153+0000","last_peered":"2024-06-02T16:46:05.368153+0000","last_clean":"2024-06-02T16:46:05.368153+0000","last_became_active":"2024-06-02T16:46:02.889874+0000","last_became_peered":"2024-06-02T16:46:02.889874+0000","last_unstale":"2024-06-02T16:46:05.368153+0000","last_undegraded":"2024-06-02T16:46:05.368153+0000","last_fullsized":"2024-06-02T16:46:05.368153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:53:01.204300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.368363+0000","last_change":"2024-06-02T16:46:03.901073+0000","last_active":"2024-06-02T16:46:05.368363+0000","last_peered":"2024-06-02T16:46:05.368363+0000","last_clean":"2024-06-02T16:46:05.368363+0000","last_became_active":"2024-06-02T16:46:03.890045+0000","last_became_peered":"2024-06-02T16:46:03.890045+0000","last_unstale":"2024-06-02T16:46:05.368363+0000","last_undegraded":"2024-06-02T16:46:05.368363+0000","last_fullsized":"2024-06-02T16:46:05.368363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:57.073479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.907198+0000","last_change":"2024-06-02T16:46:02.883504+0000","last_active":"2024-06-02T16:46:04.907198+0000","last_peered":"2024-06-02T16:46:04.907198+0000","last_clean":"2024-06-02T16:46:04.907198+0000","last_became_active":"2024-06-02T16:46:02.883177+0000","last_became_peered":"2024-06-02T16:46:02.883177+0000","last_unstale":"2024-06-02T16:46:04.907198+0000","last_undegraded":"2024-06-02T16:46:04.907198+0000","last_fullsized":"2024-06-02T16:46:04.907198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:07:36.269419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.369509+0000","last_change":"2024-06-02T16:46:03.903394+0000","last_active":"2024-06-02T16:46:05.369509+0000","last_peered":"2024-06-02T16:46:05.369509+0000","last_clean":"2024-06-02T16:46:05.369509+0000","last_became_active":"2024-06-02T16:46:03.902987+0000","last_became_peered":"2024-06-02T16:46:03.902987+0000","last_unstale":"2024-06-02T16:46:05.369509+0000","last_undegraded":"2024-06-02T16:46:05.369509+0000","last_fullsized":"2024-06-02T16:46:05.369509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:27:46.648951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.901232+0000","last_change":"2024-06-02T16:46:02.890382+0000","last_active":"2024-06-02T16:46:04.901232+0000","last_peered":"2024-06-02T16:46:04.901232+0000","last_clean":"2024-06-02T16:46:04.901232+0000","last_became_active":"2024-06-02T16:46:02.890074+0000","last_became_peered":"2024-06-02T16:46:02.890074+0000","last_unstale":"2024-06-02T16:46:04.901232+0000","last_undegraded":"2024-06-02T16:46:04.901232+0000","last_fullsized":"2024-06-02T16:46:04.901232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:51:44.027853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900434+0000","last_change":"2024-06-02T16:46:03.899253+0000","last_active":"2024-06-02T16:46:04.900434+0000","last_peered":"2024-06-02T16:46:04.900434+0000","last_clean":"2024-06-02T16:46:04.900434+0000","last_became_active":"2024-06-02T16:46:03.898932+0000","last_became_peered":"2024-06-02T16:46:03.898932+0000","last_unstale":"2024-06-02T16:46:04.900434+0000","last_undegraded":"2024-06-02T16:46:04.900434+0000","last_fullsized":"2024-06-02T16:46:04.900434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906795+0000","last_change":"2024-06-02T16:46:02.885176+0000","last_active":"2024-06-02T16:46:04.906795+0000","last_peered":"2024-06-02T16:46:04.906795+0000","last_clean":"2024-06-02T16:46:04.906795+0000","last_became_active":"2024-06-02T16:46:02.884863+0000","last_became_peered":"2024-06-02T16:46:02.884863+0000","last_unstale":"2024-06-02T16:46:04.906795+0000","last_undegraded":"2024-06-02T16:46:04.906795+0000","last_fullsized":"2024-06-02T16:46:04.906795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:02:03.125487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279269+0000","last_change":"2024-06-02T16:46:03.896244+0000","last_active":"2024-06-02T16:46:05.279269+0000","last_peered":"2024-06-02T16:46:05.279269+0000","last_clean":"2024-06-02T16:46:05.279269+0000","last_became_active":"2024-06-02T16:46:03.895899+0000","last_became_peered":"2024-06-02T16:46:03.895899+0000","last_unstale":"2024-06-02T16:46:05.279269+0000","last_undegraded":"2024-06-02T16:46:05.279269+0000","last_fullsized":"2024-06-02T16:46:05.279269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:04:51.512152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900552+0000","last_change":"2024-06-02T16:46:02.882808+0000","last_active":"2024-06-02T16:46:04.900552+0000","last_peered":"2024-06-02T16:46:04.900552+0000","last_clean":"2024-06-02T16:46:04.900552+0000","last_became_active":"2024-06-02T16:46:02.882515+0000","last_became_peered":"2024-06-02T16:46:02.882515+0000","last_unstale":"2024-06-02T16:46:04.900552+0000","last_undegraded":"2024-06-02T16:46:04.900552+0000","last_fullsized":"2024-06-02T16:46:04.900552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:37:05.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.900378+0000","last_change":"2024-06-02T16:46:03.902214+0000","last_active":"2024-06-02T16:46:04.900378+0000","last_peered":"2024-06-02T16:46:04.900378+0000","last_clean":"2024-06-02T16:46:04.900378+0000","last_became_active":"2024-06-02T16:46:03.901873+0000","last_became_peered":"2024-06-02T16:46:03.901873+0000","last_unstale":"2024-06-02T16:46:04.900378+0000","last_undegraded":"2024-06-02T16:46:04.900378+0000","last_fullsized":"2024-06-02T16:46:04.900378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:52.300667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.906487+0000","last_change":"2024-06-02T16:46:02.890723+0000","last_active":"2024-06-02T16:46:04.906487+0000","last_peered":"2024-06-02T16:46:04.906487+0000","last_clean":"2024-06-02T16:46:04.906487+0000","last_became_active":"2024-06-02T16:46:02.889856+0000","last_became_peered":"2024-06-02T16:46:02.889856+0000","last_unstale":"2024-06-02T16:46:04.906487+0000","last_undegraded":"2024-06-02T16:46:04.906487+0000","last_fullsized":"2024-06-02T16:46:04.906487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:19:52.124662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863254+0000","last_change":"2024-06-02T16:46:03.902323+0000","last_active":"2024-06-02T16:46:04.863254+0000","last_peered":"2024-06-02T16:46:04.863254+0000","last_clean":"2024-06-02T16:46:04.863254+0000","last_became_active":"2024-06-02T16:46:03.901882+0000","last_became_peered":"2024-06-02T16:46:03.901882+0000","last_unstale":"2024-06-02T16:46:04.863254+0000","last_undegraded":"2024-06-02T16:46:04.863254+0000","last_fullsized":"2024-06-02T16:46:04.863254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:43.706203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137932+0000","last_change":"2024-06-02T16:46:02.884578+0000","last_active":"2024-06-02T16:46:05.137932+0000","last_peered":"2024-06-02T16:46:05.137932+0000","last_clean":"2024-06-02T16:46:05.137932+0000","last_became_active":"2024-06-02T16:46:02.882715+0000","last_became_peered":"2024-06-02T16:46:02.882715+0000","last_unstale":"2024-06-02T16:46:05.137932+0000","last_undegraded":"2024-06-02T16:46:05.137932+0000","last_fullsized":"2024-06-02T16:46:05.137932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:37:49.232011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.137596+0000","last_change":"2024-06-02T16:46:03.892141+0000","last_active":"2024-06-02T16:46:05.137596+0000","last_peered":"2024-06-02T16:46:05.137596+0000","last_clean":"2024-06-02T16:46:05.137596+0000","last_became_active":"2024-06-02T16:46:03.891420+0000","last_became_peered":"2024-06-02T16:46:03.891420+0000","last_unstale":"2024-06-02T16:46:05.137596+0000","last_undegraded":"2024-06-02T16:46:05.137596+0000","last_fullsized":"2024-06-02T16:46:05.137596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:19.455261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.863232+0000","last_change":"2024-06-02T16:46:02.892674+0000","last_active":"2024-06-02T16:46:04.863232+0000","last_peered":"2024-06-02T16:46:04.863232+0000","last_clean":"2024-06-02T16:46:04.863232+0000","last_became_active":"2024-06-02T16:46:02.890747+0000","last_became_peered":"2024-06-02T16:46:02.890747+0000","last_unstale":"2024-06-02T16:46:04.863232+0000","last_undegraded":"2024-06-02T16:46:04.863232+0000","last_fullsized":"2024-06-02T16:46:04.863232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:49:10.440456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.868386+0000","last_change":"2024-06-02T16:46:03.916186+0000","last_active":"2024-06-02T16:46:04.868386+0000","last_peered":"2024-06-02T16:46:04.868386+0000","last_clean":"2024-06-02T16:46:04.868386+0000","last_became_active":"2024-06-02T16:46:03.915623+0000","last_became_peered":"2024-06-02T16:46:03.915623+0000","last_unstale":"2024-06-02T16:46:04.868386+0000","last_undegraded":"2024-06-02T16:46:04.868386+0000","last_fullsized":"2024-06-02T16:46:04.868386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:02.838402+0000","last_clean_scrub_stamp":"2024-06-02T16:46:02.838402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:58:06.662462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:05.279465+0000","last_change":"2024-06-02T16:46:02.892101+0000","last_active":"2024-06-02T16:46:05.279465+0000","last_peered":"2024-06-02T16:46:05.279465+0000","last_clean":"2024-06-02T16:46:05.279465+0000","last_became_active":"2024-06-02T16:46:02.891745+0000","last_became_peered":"2024-06-02T16:46:02.891745+0000","last_unstale":"2024-06-02T16:46:05.279465+0000","last_undegraded":"2024-06-02T16:46:05.279465+0000","last_fullsized":"2024-06-02T16:46:05.279465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:46:01.831936+0000","last_clean_scrub_stamp":"2024-06-02T16:46:01.831936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:06:06.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T16:46:04.867868+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:46:04.867868+0000","last_peered":"2024-06-02T16:46:04.867868+0000","last_clean":"2024-06-02T16:46:04.867868+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:46:04.867868+0000","last_undegraded":"2024-06-02T16:46:04.867868+0000","last_fullsized":"2024-06-02T16:46:04.867868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":740177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":150335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":150391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476754,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":149823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":151353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":149789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":740087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":151353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:46:13.971 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T16:46:13.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T16:46:14.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.236+0000 7fcfeae00640 1 Processor -- start 2024-06-02T16:46:14.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.236+0000 7fcfeae00640 1 -- start start 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfeae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfe40badc0 0x7fcfe40d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfeae00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe40d3e20 con 0x7fcfe40d0660 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfeae00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe40d4100 con 0x7fcfe415f420 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfeae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe40d4a30 con 0x7fcfe40badc0 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfea400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfe40d0660 0x7fcfe40b84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53948/0 (socket says 172.21.15.52:53948) 2024-06-02T16:46:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.238+0000 7fcfea400640 1 -- 172.21.15.52:0/131625959 learned_addr learned my addr 172.21.15.52:0/131625959 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe9000640 1 --2- 172.21.15.52:0/131625959 >> v2:172.21.15.52:3300/0 conn(0x7fcfe40badc0 0x7fcfe40d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe3e00640 1 -- 172.21.15.52:0/131625959 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475409774 0 0) 0x7fcfe40d3e20 con 0x7fcfe40d0660 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe3e00640 1 -- 172.21.15.52:0/131625959 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfcc003520 con 0x7fcfe40d0660 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe9000640 1 -- 172.21.15.52:0/131625959 >> v1:172.21.15.114:6789/0 conn(0x7fcfe415f420 legacy=0x7fcfe40d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe9000640 1 -- 172.21.15.52:0/131625959 >> v1:172.21.15.52:6789/0 conn(0x7fcfe40d0660 legacy=0x7fcfe40b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.239+0000 7fcfe9000640 1 -- 172.21.15.52:0/131625959 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe40d43e0 con 0x7fcfe40badc0 2024-06-02T16:46:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.240+0000 7fcfe9000640 1 --2- 172.21.15.52:0/131625959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40badc0 0x7fcfe40d0120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097a0 tx=0x7fcfd002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af9e56feca668c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfe3e00640 1 -- 172.21.15.52:0/131625959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0037070 con 0x7fcfe40badc0 2024-06-02T16:46:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfe3e00640 1 -- 172.21.15.52:0/131625959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0032440 con 0x7fcfe40badc0 2024-06-02T16:46:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfe3e00640 1 -- 172.21.15.52:0/131625959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0032810 con 0x7fcfe40badc0 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 -- 172.21.15.52:0/131625959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40badc0 msgr2=0x7fcfe40d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 --2- 172.21.15.52:0/131625959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40badc0 0x7fcfe40d0120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097a0 tx=0x7fcfd002a230 comp rx=0 tx=0).stop 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 -- 172.21.15.52:0/131625959 shutdown_connections 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 --2- 172.21.15.52:0/131625959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40badc0 0x7fcfe40d0120 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 -- 172.21.15.52:0/131625959 >> 172.21.15.52:0/131625959 conn(0x7fcfe40740e0 msgr2=0x7fcfe406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 -- 172.21.15.52:0/131625959 shutdown_connections 2024-06-02T16:46:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.241+0000 7fcfeae00640 1 -- 172.21.15.52:0/131625959 wait complete. 2024-06-02T16:46:14.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.243+0000 7fcfeae00640 1 Processor -- start 2024-06-02T16:46:14.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.243+0000 7fcfeae00640 1 -- start start 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 0x7fcfe415fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfe415f420 0x7fcfe415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40d4ec0 con 0x7fcfe40d0660 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40d3bc0 con 0x7fcfe415f420 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.244+0000 7fcfeae00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe4160b60 con 0x7fcfe40badc0 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46888/0 (socket says 172.21.15.52:46888) 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 -- 172.21.15.52:0/3443215178 learned_addr learned my addr 172.21.15.52:0/3443215178 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9a00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 0x7fcfe415fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 -- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 msgr2=0x7fcfe415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 0x7fcfe415fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 -- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfe415f420 msgr2=0x7fcfe415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfe415f420 0x7fcfe415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9000640 1 -- 172.21.15.52:0/3443215178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe40b5e90 con 0x7fcfe40d0660 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.245+0000 7fcfe9a00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 0x7fcfe415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfe9000640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0035040 tx=0x7fcfd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0037040 con 0x7fcfe40d0660 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0030500 con 0x7fcfe40d0660 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0030910 con 0x7fcfe40d0660 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe41fd820 con 0x7fcfe40d0660 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.246+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe41fca60 con 0x7fcfe40d0660 2024-06-02T16:46:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.247+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe40507e0 con 0x7fcfe40d0660 2024-06-02T16:46:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.248+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfd0044020 con 0x7fcfe40d0660 2024-06-02T16:46:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.249+0000 7fcfe1600640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 0x7fcfc4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.249+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcfd00b78f0 con 0x7fcfe40d0660 2024-06-02T16:46:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.250+0000 7fcfe9a00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 0x7fcfc4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.251+0000 7fcfe9a00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 0x7fcfc4078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80016a0 tx=0x7fcfd8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.254+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfe40b5e90 con 0x7fcfe40d0660 2024-06-02T16:46:14.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.539+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcfe40c89d0 con 0x7fcfe40d0660 2024-06-02T16:46:14.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.545+0000 7fcfe1600640 1 -- 172.21.15.52:0/3443215178 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7fcfd0081240 con 0x7fcfe40d0660 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ== 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T16:46:14.544 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 msgr2=0x7fcfc4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 0x7fcfc4078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80016a0 tx=0x7fcfd8009040 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 msgr2=0x7fcfe4160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0035040 tx=0x7fcfd00046c0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 shutdown_connections 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcfc40762d0 0x7fcfc4078790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfe415f420 0x7fcfe415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe40d0660 0x7fcfe4160380 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 --2- 172.21.15.52:0/3443215178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfe40badc0 0x7fcfe415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 >> 172.21.15.52:0/3443215178 conn(0x7fcfe40740e0 msgr2=0x7fcfe40b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:14.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 shutdown_connections 2024-06-02T16:46:14.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.548+0000 7fcfeae00640 1 -- 172.21.15.52:0/3443215178 wait complete. 2024-06-02T16:46:14.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:46:14.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.765+0000 7fcaebe00640 1 Processor -- start 2024-06-02T16:46:14.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.766+0000 7fcaebe00640 1 -- start start 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.767+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 0x7fcaec06e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.767+0000 7fcaebe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcaec13f140 0x7fcaec06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.767+0000 7fcaebe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 0x7fcaec160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.767+0000 7fcaebe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcaec1416c0 con 0x7fcaec13f140 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaebe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcaec160970 con 0x7fcaec15fc40 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaebe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec141960 con 0x7fcaec13ed60 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcaec13f140 0x7fcaec06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcaec13f140 0x7fcaec06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46896/0 (socket says 172.21.15.52:46896) 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 -- 172.21.15.52:0/2564165741 learned_addr learned my addr 172.21.15.52:0/2564165741 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaeaa00640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 0x7fcaec06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaeb400640 1 --2- 172.21.15.52:0/2564165741 >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 0x7fcaec160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 -- 172.21.15.52:0/2564165741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 msgr2=0x7fcaec06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 0x7fcaec06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 -- 172.21.15.52:0/2564165741 >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 msgr2=0x7fcaec160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 --2- 172.21.15.52:0/2564165741 >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 0x7fcaec160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaea000640 1 -- 172.21.15.52:0/2564165741 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec141c40 con 0x7fcaec13f140 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaeaa00640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 0x7fcaec06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:14.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.768+0000 7fcaeb400640 1 --2- 172.21.15.52:0/2564165741 >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 0x7fcaec160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.769+0000 7fcaea000640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13f140 0x7fcaec06e670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0d0e10 tx=0x7fcadc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa923c68236be21 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.770+0000 7fcae9600640 1 -- 172.21.15.52:0/2564165741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc037070 con 0x7fcaec13f140 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.770+0000 7fcae9600640 1 -- 172.21.15.52:0/2564165741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc032440 con 0x7fcaec13f140 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.770+0000 7fcae9600640 1 -- 172.21.15.52:0/2564165741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc032810 con 0x7fcaec13f140 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.770+0000 7fcaebe00640 1 -- 172.21.15.52:0/2564165741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13f140 msgr2=0x7fcaec06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.770+0000 7fcaebe00640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13f140 0x7fcaec06e670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0d0e10 tx=0x7fcadc02a140 comp rx=0 tx=0).stop 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 -- 172.21.15.52:0/2564165741 shutdown_connections 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 --2- 172.21.15.52:0/2564165741 >> v2:172.21.15.114:3300/0 conn(0x7fcaec15fc40 0x7fcaec160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13f140 0x7fcaec06e670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 --2- 172.21.15.52:0/2564165741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec13ed60 0x7fcaec06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 -- 172.21.15.52:0/2564165741 >> 172.21.15.52:0/2564165741 conn(0x7fcaec06c380 msgr2=0x7fcaec06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:14.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 -- 172.21.15.52:0/2564165741 shutdown_connections 2024-06-02T16:46:14.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.771+0000 7fcaebe00640 1 -- 172.21.15.52:0/2564165741 wait complete. 2024-06-02T16:46:14.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.773+0000 7fcaebe00640 1 Processor -- start 2024-06-02T16:46:14.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.773+0000 7fcaebe00640 1 -- start start 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 0x7fcaec0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec1f8c80 0x7fcaec1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec1605c0 con 0x7fcaec13ed60 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec142440 con 0x7fcaec15fc40 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaebe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec0b4890 con 0x7fcaec1f8c80 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaeaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaeaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46912/0 (socket says 172.21.15.52:46912) 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaeaa00640 1 -- 172.21.15.52:0/3388970964 learned_addr learned my addr 172.21.15.52:0/3388970964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.774+0000 7fcaeb400640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec1f8c80 0x7fcaec1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaea000640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 0x7fcaec0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 -- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec1f8c80 msgr2=0x7fcaec1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec1f8c80 0x7fcaec1f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 -- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 msgr2=0x7fcaec0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 0x7fcaec0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 -- 172.21.15.52:0/3388970964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec1400f0 con 0x7fcaec13ed60 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaea000640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 0x7fcaec0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaeaa00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c7f0 tx=0x7fcad400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4015070 con 0x7fcaec13ed60 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40077c0 con 0x7fcaec13ed60 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4007b70 con 0x7fcaec13ed60 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.775+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec0b5d90 con 0x7fcaec13ed60 2024-06-02T16:46:14.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.776+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec1f9ad0 con 0x7fcaec13ed60 2024-06-02T16:46:14.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.777+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec075ea0 con 0x7fcaec13ed60 2024-06-02T16:46:14.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.778+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcad4018070 con 0x7fcaec13ed60 2024-06-02T16:46:14.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.779+0000 7fcae2a00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 0x7fcac8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:14.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.779+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcad4097750 con 0x7fcaec13ed60 2024-06-02T16:46:14.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.780+0000 7fcaea000640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 0x7fcac8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:14.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.781+0000 7fcaea000640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 0x7fcac8078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcadc034000 tx=0x7fcadc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:14.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:14.784+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcad4061010 con 0x7fcaec13ed60 2024-06-02T16:46:15.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.032+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaec15d8b0 con 0x7fcaec13ed60 2024-06-02T16:46:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.033+0000 7fcae2a00640 1 -- 172.21.15.52:0/3388970964 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7fcad4060910 con 0x7fcaec13ed60 2024-06-02T16:46:15.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:46:15.032 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:06.420731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:46:15.033 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-06-02T16:46:15.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 msgr2=0x7fcac8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 0x7fcac8078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcadc034000 tx=0x7fcadc02e000 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 msgr2=0x7fcaec13fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c7f0 tx=0x7fcad400ccb0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 shutdown_connections 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fcac80762d0 0x7fcac8078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcaec1f8c80 0x7fcaec1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaec15fc40 0x7fcaec0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 --2- 172.21.15.52:0/3388970964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaec13ed60 0x7fcaec13fbb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 >> 172.21.15.52:0/3388970964 conn(0x7fcaec06c380 msgr2=0x7fcaec15b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 shutdown_connections 2024-06-02T16:46:15.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.036+0000 7fcaebe00640 1 -- 172.21.15.52:0/3388970964 wait complete. 2024-06-02T16:46:15.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T16:46:03.340986+0000', 'modified': '2024-06-02T16:46:06.420731+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4740}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4740': {'gid': 4740, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6835/3573924540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3573924540}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3573924540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4740, 'qdb_cluster': [4740]} 2024-06-02T16:46:15.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T16:46:15.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T16:46:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.682+0000 7f6dcd000640 1 Processor -- start 2024-06-02T16:46:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.682+0000 7f6dcd000640 1 -- start start 2024-06-02T16:46:15.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dcd000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dc815f5b0 0x7f6dc80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dcd000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc806edf0 con 0x7f6dc815f1d0 2024-06-02T16:46:15.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dcd000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc806f0d0 con 0x7f6dc80725b0 2024-06-02T16:46:15.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dcd000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc80b4470 con 0x7f6dc815f5b0 2024-06-02T16:46:15.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dc5e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6dc815f1d0 0x7f6dc806e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53956/0 (socket says 172.21.15.52:53956) 2024-06-02T16:46:15.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dc5e00640 1 -- 172.21.15.52:0/3858938278 learned_addr learned my addr 172.21.15.52:0/3858938278 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:15.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.684+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3858938278 >> v2:172.21.15.52:3300/0 conn(0x7f6dc815f5b0 0x7f6dc80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.685+0000 7f6dc4a00640 1 -- 172.21.15.52:0/3858938278 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181699623 0 0) 0x7f6dc806edf0 con 0x7f6dc815f1d0 2024-06-02T16:46:15.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.685+0000 7f6dc4a00640 1 -- 172.21.15.52:0/3858938278 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dac003520 con 0x7f6dc815f1d0 2024-06-02T16:46:15.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.685+0000 7f6dc5400640 1 -- 172.21.15.52:0/3858938278 >> v1:172.21.15.114:6789/0 conn(0x7f6dc80725b0 legacy=0x7f6dc80b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.685+0000 7f6dc5400640 1 -- 172.21.15.52:0/3858938278 >> v1:172.21.15.52:6789/0 conn(0x7f6dc815f1d0 legacy=0x7f6dc806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.685+0000 7f6dc5400640 1 -- 172.21.15.52:0/3858938278 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc806f3b0 con 0x7f6dc815f5b0 2024-06-02T16:46:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.686+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3858938278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80ae020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6db00097a0 tx=0x7f6db002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bca037028320f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.687+0000 7f6dc4a00640 1 -- 172.21.15.52:0/3858938278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0037070 con 0x7f6dc815f5b0 2024-06-02T16:46:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.687+0000 7f6dc4a00640 1 -- 172.21.15.52:0/3858938278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db002ae50 con 0x7f6dc815f5b0 2024-06-02T16:46:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.687+0000 7f6dc4a00640 1 -- 172.21.15.52:0/3858938278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0032640 con 0x7f6dc815f5b0 2024-06-02T16:46:15.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.687+0000 7f6dcd000640 1 -- 172.21.15.52:0/3858938278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f5b0 msgr2=0x7f6dc80ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.687+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3858938278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80ae020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6db00097a0 tx=0x7f6db002a100 comp rx=0 tx=0).stop 2024-06-02T16:46:15.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.688+0000 7f6dcd000640 1 -- 172.21.15.52:0/3858938278 shutdown_connections 2024-06-02T16:46:15.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.688+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3858938278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80ae020 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.688+0000 7f6dcd000640 1 -- 172.21.15.52:0/3858938278 >> 172.21.15.52:0/3858938278 conn(0x7f6dc806c7a0 msgr2=0x7f6dc806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.688+0000 7f6dcd000640 1 -- 172.21.15.52:0/3858938278 shutdown_connections 2024-06-02T16:46:15.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.688+0000 7f6dcd000640 1 -- 172.21.15.52:0/3858938278 wait complete. 2024-06-02T16:46:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.689+0000 7f6dcd000640 1 Processor -- start 2024-06-02T16:46:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.690+0000 7f6dcd000640 1 -- start start 2024-06-02T16:46:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.690+0000 7f6dcd000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc80725b0 0x7f6dc81f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.690+0000 7f6dcd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dcd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dcd000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80b5470 con 0x7f6dc815f1d0 2024-06-02T16:46:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dcd000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80b52f0 con 0x7f6dc815f5b0 2024-06-02T16:46:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dcd000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc80ae560 con 0x7f6dc80725b0 2024-06-02T16:46:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46942/0 (socket says 172.21.15.52:46942) 2024-06-02T16:46:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 -- 172.21.15.52:0/3317554877 learned_addr learned my addr 172.21.15.52:0/3317554877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc80725b0 0x7f6dc81f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 -- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc80725b0 msgr2=0x7f6dc81f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc6800640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc80725b0 0x7f6dc81f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 -- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 msgr2=0x7f6dc80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc5400640 1 -- 172.21.15.52:0/3317554877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81f5fb0 con 0x7f6dc815f1d0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.691+0000 7f6dc6800640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6db00097a0 tx=0x7f6db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dbe000640 1 -- 172.21.15.52:0/3317554877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0041020 con 0x7f6dc815f1d0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dbe000640 1 -- 172.21.15.52:0/3317554877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db00044c0 con 0x7f6dc815f1d0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dbe000640 1 -- 172.21.15.52:0/3317554877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0037040 con 0x7f6dc815f1d0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc814e110 con 0x7f6dc815f1d0 2024-06-02T16:46:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.692+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc814e6d0 con 0x7f6dc815f1d0 2024-06-02T16:46:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.695+0000 7f6dbe000640 1 -- 172.21.15.52:0/3317554877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6db0044020 con 0x7f6dc815f1d0 2024-06-02T16:46:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.696+0000 7f6dbe000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 0x7f6da4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.696+0000 7f6dbe000640 1 -- 172.21.15.52:0/3317554877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6db00b7550 con 0x7f6dc815f1d0 2024-06-02T16:46:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.696+0000 7f6dcfd67740 1 Processor -- start 2024-06-02T16:46:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.696+0000 7f6dcfd67740 1 -- start start 2024-06-02T16:46:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.696+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 0x7f6da4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc14c50 0x55665bc17460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bbe7b40 0x55665bbeb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55665bb5edf0 con 0x55665bc15030 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55665bb4e990 con 0x55665bc14c50 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55665bb529d0 con 0x55665bbe7b40 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46956/0 (socket says 172.21.15.52:46956) 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.697+0000 7f6dc5400640 1 -- 172.21.15.52:0/3581399120 learned_addr learned my addr 172.21.15.52:0/3581399120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 0x7f6da4078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6db80015a0 tx=0x7f6db8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 -- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bbe7b40 msgr2=0x55665bbeb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bbe7b40 0x55665bbeb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 -- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc14c50 msgr2=0x55665bc17460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc14c50 0x55665bc17460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 -- 172.21.15.52:0/3581399120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665baef9b0 con 0x55665bc15030 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6dc5400640 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6db007cd00 tx=0x7f6db0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee7111cec8ed58 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6db6a00640 1 -- 172.21.15.52:0/3581399120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0080710 con 0x55665bc15030 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6db6a00640 1 -- 172.21.15.52:0/3581399120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db002ae50 con 0x55665bc15030 2024-06-02T16:46:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.698+0000 7f6db6a00640 1 -- 172.21.15.52:0/3581399120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0089290 con 0x55665bc15030 2024-06-02T16:46:15.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 -- 172.21.15.52:0/3581399120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 msgr2=0x55665bc179a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6db007cd00 tx=0x7f6db0009190 comp rx=0 tx=0).stop 2024-06-02T16:46:15.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 -- 172.21.15.52:0/3581399120 shutdown_connections 2024-06-02T16:46:15.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bbe7b40 0x55665bbeb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc179a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/3581399120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc14c50 0x55665bc17460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 -- 172.21.15.52:0/3581399120 >> 172.21.15.52:0/3581399120 conn(0x55665bbe9db0 msgr2=0x55665bc32460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 -- 172.21.15.52:0/3581399120 shutdown_connections 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.699+0000 7f6dcfd67740 1 -- 172.21.15.52:0/3581399120 wait complete. 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.700+0000 7f6dcfd67740 1 -- start start 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.700+0000 7f6dcfd67740 1 Processor -- start 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc35930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bc2d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55665b834850 con 0x55665bc15030 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55665baf6f20 con 0x55665bc34da0 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55665bbeccd0 con 0x55665bc14c50 2024-06-02T16:46:15.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dcfd67740 10 client.0 _ll_register_callbacks cb 0x55665bb48ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dc5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46964/0 (socket says 172.21.15.52:46964) 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.701+0000 7f6dc5400640 1 -- 172.21.15.52:0/1427969103 learned_addr learned my addr 172.21.15.52:0/1427969103 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc6800640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bc2d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc35930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 -- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 msgr2=0x55665bc35930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc35930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 -- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 msgr2=0x55665bc2d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bc2d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 -- 172.21.15.52:0/1427969103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665bae7d00 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6db00b7010 tx=0x7f6db00b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deba3f80b058d33e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dab400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00b2070 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6db00b70b0 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.702+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db002ae50 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6db00a0050 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 10 client.4932 fetch_fsmap learned FSMap version 17 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55665b8632d0 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db002ae50 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6db007f970 con 0x55665bc15030 2024-06-02T16:46:15.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 10 client.4932 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 10 client.4932 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 20 client.4932 populate_metadata read hostname 'smithi052' 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc2dec0 0x55665bc500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 4 client.4932 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665bb60d40 con 0x55665bc2dec0 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.703+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc2dec0 0x55665bc500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.704+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc2dec0 0x55665bc500e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958899b920287f67 server_cookie=53d6d14f29354a6e in_seq=0 out_seq=0 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.704+0000 7f6dab400640 10 client.4932 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dab400640 1 -- 172.21.15.52:0/1427969103 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55665bb60d40 con 0x55665bc2dec0 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dab400640 10 client.4932 handle_command_reply: tid=0 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 client.4932 shutdown 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 msgr2=0x55665bc0b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6db00b7010 tx=0x7f6db00b7040 comp rx=0 tx=0).stop 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 shutdown_connections 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bc2d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc2dec0 0x55665bc500e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc15030 0x55665bc0b340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1427969103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc35930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 >> 172.21.15.52:0/1427969103 conn(0x55665bbe7b40 msgr2=0x55665bc14040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dab400640 0 client.4932 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.705+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 shutdown_connections 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.706+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1427969103 wait complete. 2024-06-02T16:46:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.706+0000 7f6dcfd67740 20 client.4932 trim_cache size 0 max 16384 2024-06-02T16:46:15.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.726+0000 7f6dcfd67740 1 Processor -- start 2024-06-02T16:46:15.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.726+0000 7f6dcfd67740 1 -- start start 2024-06-02T16:46:15.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc0f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc15030 0x55665bbe6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc82009f0 con 0x55665bc34da0 2024-06-02T16:46:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8160700 con 0x55665bc15030 2024-06-02T16:46:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.727+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc814f6b0 con 0x55665bc14c50 2024-06-02T16:46:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46976/0 (socket says 172.21.15.52:46976) 2024-06-02T16:46:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 -- 172.21.15.52:0/1766923257 learned_addr learned my addr 172.21.15.52:0/1766923257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc15030 0x55665bbe6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc0f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 -- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 msgr2=0x55665bc0f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc0f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 -- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc15030 msgr2=0x55665bbe6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc15030 0x55665bbe6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 -- 172.21.15.52:0/1766923257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665b92d6b0 con 0x55665bc34da0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.728+0000 7f6dc6800640 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0001570 tx=0x7f6dc0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f374f17b3763cc10 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6db6000640 1 -- 172.21.15.52:0/1766923257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00052d0 con 0x55665bc34da0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6db6000640 1 -- 172.21.15.52:0/1766923257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc000e740 con 0x55665bc34da0 2024-06-02T16:46:15.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6db6000640 1 -- 172.21.15.52:0/1766923257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000eb30 con 0x55665bc34da0 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1766923257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 msgr2=0x55665bc2e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0001570 tx=0x7f6dc0001a30 comp rx=0 tx=0).stop 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1766923257 shutdown_connections 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc34da0 0x55665bc2e4b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc15030 0x55665bbe6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1766923257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc14c50 0x55665bc0f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.729+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1766923257 >> 172.21.15.52:0/1766923257 conn(0x55665bbe7b40 msgr2=0x55665bc32460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.730+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1766923257 shutdown_connections 2024-06-02T16:46:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.730+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1766923257 wait complete. 2024-06-02T16:46:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.730+0000 7f6dcfd67740 1 -- start start 2024-06-02T16:46:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.730+0000 7f6dcfd67740 1 Processor -- start 2024-06-02T16:46:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc15030 0x55665bc2e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bcb24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55665b834850 con 0x55665bc14c50 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55665baf6f20 con 0x55665bc34da0 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.731+0000 7f6dcfd67740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55665bc0c7d0 con 0x55665bc15030 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dcfd67740 10 client.0 _ll_register_callbacks cb 0x7f6db0098070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46984/0 (socket says 172.21.15.52:46984) 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 -- 172.21.15.52:0/1335373260 learned_addr learned my addr 172.21.15.52:0/1335373260 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 -- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc15030 msgr2=0x55665bc2e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc15030 0x55665bc2e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 -- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 msgr2=0x55665bcb24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bcb24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 -- 172.21.15.52:0/1335373260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665bc2edf0 con 0x55665bc14c50 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dc5e00640 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55665bc34a90 tx=0x7f6db80013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb83dd4b51476d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.732+0000 7f6dab400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80075a0 con 0x55665bc14c50 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc000e740 con 0x55665bc14c50 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6db8007740 con 0x55665bc14c50 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6db8007940 con 0x55665bc14c50 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 10 client.4938 fetch_fsmap learned FSMap version 17 2024-06-02T16:46:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55665bcb3bc0 con 0x55665bc14c50 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc000e740 con 0x55665bc14c50 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f6db802d430 con 0x55665bc14c50 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 10 client.4938 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 10 client.4938 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.733+0000 7f6dcfd67740 20 client.4938 populate_metadata read hostname 'smithi052' 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc11c70 0x55665bc12050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dcfd67740 4 client.4938 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T16:46:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "status"}) -- 0x55665bc2d210 con 0x55665bc11c70 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc11c70 0x55665bc12050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dc5400640 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc11c70 0x55665bc12050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54c80618dd2ce6f server_cookie=e5fa44f50ba50bdb in_seq=0 out_seq=0 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.734+0000 7f6dab400640 10 client.4938 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dab400640 1 -- 172.21.15.52:0/1335373260 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55665bc2d210 con 0x55665bc11c70 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dab400640 10 client.4938 handle_command_reply: tid=0 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 client.4938 shutdown 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 msgr2=0x55665bc09d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55665bc34a90 tx=0x7f6db80013c0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 shutdown_connections 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55665bc34da0 0x55665bcb24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55665bc15030 0x55665bc2e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55665bc11c70 0x55665bc12050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 --2- 172.21.15.52:0/1335373260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665bc14c50 0x55665bc09d10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 >> 172.21.15.52:0/1335373260 conn(0x55665bbe7b40 msgr2=0x55665bbe6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dab400640 0 client.4938 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 shutdown_connections 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 1 -- 172.21.15.52:0/1335373260 wait complete. 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.735+0000 7f6dcfd67740 20 client.4938 trim_cache size 0 max 16384 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "39df44fa-6b94-46ae-87c4-569eff4461cc", 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-06-02T16:46:15.737 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4740, 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 11.848929654999999, 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 17, 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 35, 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 35, 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 19.937256943000001 2024-06-02T16:46:15.738 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 msgr2=0x7f6da4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 0x7f6da4078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6db80015a0 tx=0x7f6db8009040 comp rx=0 tx=0).stop 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 msgr2=0x7f6dc814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6db00097a0 tx=0x7f6db00046c0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 shutdown_connections 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6da40762d0 0x7f6da4078790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc815f5b0 0x7f6dc80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dc815f1d0 0x7f6dc814d620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 --2- 172.21.15.52:0/3317554877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc80725b0 0x7f6dc81f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 >> 172.21.15.52:0/3317554877 conn(0x7f6dc806c7a0 msgr2=0x7f6dc80b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 shutdown_connections 2024-06-02T16:46:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.736+0000 7f6dcd000640 1 -- 172.21.15.52:0/3317554877 wait complete. 2024-06-02T16:46:15.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:46:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.945+0000 7f43c8400640 1 Processor -- start 2024-06-02T16:46:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.946+0000 7f43c8400640 1 -- start start 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c8400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43c00d3be0 0x7f43c00d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c8400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 0x7f43c00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c8400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c00d61b0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c8400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f43c00d1330 con 0x7f43c00d3be0 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c8400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f43c00d0310 con 0x7f43c00d3fc0 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.947+0000 7f43c5a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43c00d3be0 0x7f43c00d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43c00d3be0 0x7f43c00d3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46988/0 (socket says 172.21.15.52:46988) 2024-06-02T16:46:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 -- 172.21.15.52:0/3158409231 learned_addr learned my addr 172.21.15.52:0/3158409231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5000640 1 --1- 172.21.15.52:0/3158409231 >> v1:172.21.15.52:6789/0 conn(0x7f43c00d5cb0 0x7f43c006d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53972/0 (socket says 172.21.15.52:53972) 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 -- 172.21.15.52:0/3158409231 >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 msgr2=0x7f43c00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c6400640 1 --2- 172.21.15.52:0/3158409231 >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 0x7f43c00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 --2- 172.21.15.52:0/3158409231 >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 0x7f43c00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 -- 172.21.15.52:0/3158409231 >> v1:172.21.15.52:6789/0 conn(0x7f43c00d5cb0 legacy=0x7f43c006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43bfe00640 1 -- 172.21.15.52:0/3158409231 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338055254 0 0) 0x7f43c00d61b0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c5a00640 1 -- 172.21.15.52:0/3158409231 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c00d05f0 con 0x7f43c00d3be0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.948+0000 7f43c6400640 1 --2- 172.21.15.52:0/3158409231 >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 0x7f43c00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.949+0000 7f43c5a00640 1 --2- 172.21.15.52:0/3158409231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d3be0 0x7f43c00d3170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b4860 tx=0x7f43b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c96cdb6cee1cd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43bfe00640 1 -- 172.21.15.52:0/3158409231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4037070 con 0x7f43c00d3be0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43bfe00640 1 -- 172.21.15.52:0/3158409231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b4032440 con 0x7f43c00d3be0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43bfe00640 1 -- 172.21.15.52:0/3158409231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4032810 con 0x7f43c00d3be0 2024-06-02T16:46:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 -- 172.21.15.52:0/3158409231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d3be0 msgr2=0x7f43c00d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 --2- 172.21.15.52:0/3158409231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d3be0 0x7f43c00d3170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b4860 tx=0x7f43b402a270 comp rx=0 tx=0).stop 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 -- 172.21.15.52:0/3158409231 shutdown_connections 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 --2- 172.21.15.52:0/3158409231 >> v2:172.21.15.114:3300/0 conn(0x7f43c00d3fc0 0x7f43c00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 --2- 172.21.15.52:0/3158409231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d3be0 0x7f43c00d3170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 -- 172.21.15.52:0/3158409231 >> 172.21.15.52:0/3158409231 conn(0x7f43c009e6e0 msgr2=0x7f43c00d5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 -- 172.21.15.52:0/3158409231 shutdown_connections 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.950+0000 7f43c8400640 1 -- 172.21.15.52:0/3158409231 wait complete. 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.952+0000 7f43c8400640 1 Processor -- start 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.952+0000 7f43c8400640 1 -- start start 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43c00d3be0 0x7f43c00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43c00d3fc0 0x7f43c01f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00b4aa0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00cffa0 con 0x7f43c00d3be0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c8400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f43c00b4c20 con 0x7f43c00d3fc0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47000/0 (socket says 172.21.15.52:47000) 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.953+0000 7f43c6400640 1 -- 172.21.15.52:0/2747581415 learned_addr learned my addr 172.21.15.52:0/2747581415 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c5000640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43c00d3fc0 0x7f43c01f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c5a00640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43c00d3be0 0x7f43c00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 -- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43c00d3fc0 msgr2=0x7f43c01f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43c00d3fc0 0x7f43c01f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 -- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43c00d3be0 msgr2=0x7f43c00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43c00d3be0 0x7f43c00c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 -- 172.21.15.52:0/2747581415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01f89e0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.954+0000 7f43c6400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f43b800cef0 tx=0x7f43b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.955+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b801a070 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.955+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b800d860 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.955+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b800dc50 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.955+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c01f8cc0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.955+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c01f9280 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.956+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c0069520 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.957+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43b801d070 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.958+0000 7f43bd600640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 0x7f43a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.958+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f43b8097ef0 con 0x7f43c00d5cb0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.959+0000 7f43c5a00640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 0x7f43a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.960+0000 7f43c5a00640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 0x7f43a0078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43b4034000 tx=0x7f43b402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:15.963+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43b8061870 con 0x7f43c00d5cb0 2024-06-02T16:46:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.216+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43c00d3750 con 0x7f43c00d5cb0 2024-06-02T16:46:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.217+0000 7f43bd600640 1 -- 172.21.15.52:0/2747581415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f43b8061170 con 0x7f43c00d5cb0 2024-06-02T16:46:16.216 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 msgr2=0x7f43a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 0x7f43a0078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43b4034000 tx=0x7f43b402e000 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 msgr2=0x7f43c00ba150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f43b800cef0 tx=0x7f43b800a710 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 shutdown_connections 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43a00762d0 0x7f43a0078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c00d5cb0 0x7f43c00ba150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43c00d3fc0 0x7f43c01f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 --2- 172.21.15.52:0/2747581415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43c00d3be0 0x7f43c00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 >> 172.21.15.52:0/2747581415 conn(0x7f43c009e6e0 msgr2=0x7f43c00ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 shutdown_connections 2024-06-02T16:46:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16.220+0000 7f43c8400640 1 -- 172.21.15.52:0/2747581415 wait complete. 2024-06-02T16:46:16.237 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:46:16.238 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:46:16.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.238 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-06-02T16:46:16.292 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-06-02T16:46:16.293 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:46:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 82:0f:40:a3:03:06 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::bcb9:74ff:fea9:58a3/64 scope link 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 86:1a:53:a2:08:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::841a:53ff:fea2:858/64 scope link 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:46:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 82:0f:40:a3:03:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T16:46:16.296 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::800f:40ff:fea3:306/64 scope link 2024-06-02T16:46:16.296 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:46:16.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.297 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:46:16.383 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-06-02T16:46:16.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.387 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-06-02T16:46:16.444 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-06-02T16:46:16.444 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:46:16.444 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T16:46:16.444 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T16:46:16.444 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:46:16.445 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:46:16.445 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:46:16.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T16:46:16.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T16:46:16.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T16:46:16.446 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:46:16.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:46:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:46:16.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.674 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:46:16.724 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T16:46:16.724 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T16:46:16.725 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:46:16.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-06-02T16:46:16.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:46:16.818 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T16:46:16.876 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:46:16.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:46:16.877 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:46:16.933 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:46:16.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:16.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:46:17.073 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:46:17.073 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:46:17.073 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:46:17.096 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:46:17.096 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:46:17.097 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:46:17.097 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:46:17.097 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:46:17.123 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:46:17.125 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-02T16:46:17.125 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:46:17.125 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:46:17.125 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:46:17.125 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:46:17.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:46:17.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:17.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:46:17.206 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:46:17.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:46:17.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:46:17.343 INFO:teuthology.orchestra.run.smithi052.stdout:client4950 2024-06-02T16:46:17.343 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:46:17.343 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:46:17.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-06-02T16:46:17.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.618+0000 7fe872400640 1 Processor -- start 2024-06-02T16:46:17.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.618+0000 7fe872400640 1 -- start start 2024-06-02T16:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.619+0000 7fe872400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 0x7fe86c0d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.619+0000 7fe872400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe86c162f40 0x7fe86c0d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.619+0000 7fe872400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0b30a0 con 0x7fe86c0b51b0 2024-06-02T16:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.619+0000 7fe872400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0b3380 con 0x7fe86c162f40 2024-06-02T16:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.619+0000 7fe872400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c0b3660 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.620+0000 7fe86be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe86c0b51b0 0x7fe86c162830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53978/0 (socket says 172.21.15.52:53978) 2024-06-02T16:46:17.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.620+0000 7fe86be00640 1 -- 172.21.15.52:0/1536093307 learned_addr learned my addr 172.21.15.52:0/1536093307 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:46:17.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.620+0000 7fe871a00640 1 --2- 172.21.15.52:0/1536093307 >> v2:172.21.15.114:3300/0 conn(0x7fe86c162f40 0x7fe86c0d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.620+0000 7fe871000640 1 --2- 172.21.15.52:0/1536093307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 0x7fe86c0d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662965076 0 0) 0x7fe86c0b30a0 con 0x7fe86c0b51b0 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003520 con 0x7fe86c0b51b0 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398729158 0 0) 0x7fe850003520 con 0x7fe86c0b51b0 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe871000640 1 -- 172.21.15.52:0/1536093307 >> v2:172.21.15.114:3300/0 conn(0x7fe86c162f40 msgr2=0x7fe86c0d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe871000640 1 --2- 172.21.15.52:0/1536093307 >> v2:172.21.15.114:3300/0 conn(0x7fe86c162f40 0x7fe86c0d3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe871000640 1 -- 172.21.15.52:0/1536093307 >> v1:172.21.15.52:6789/0 conn(0x7fe86c0b51b0 legacy=0x7fe86c162830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.621+0000 7fe871000640 1 -- 172.21.15.52:0/1536093307 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0b3940 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.623+0000 7fe871000640 1 --2- 172.21.15.52:0/1536093307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 0x7fe86c0d3990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097a0 tx=0x7fe85c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5584d97733b0615d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.623+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037070 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.623+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c02ab10 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.623+0000 7fe86b400640 1 -- 172.21.15.52:0/1536093307 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580016f0 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 -- 172.21.15.52:0/1536093307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 msgr2=0x7fe86c0d3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 --2- 172.21.15.52:0/1536093307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 0x7fe86c0d3990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097a0 tx=0x7fe85c02a080 comp rx=0 tx=0).stop 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 -- 172.21.15.52:0/1536093307 shutdown_connections 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 --2- 172.21.15.52:0/1536093307 >> v2:172.21.15.114:3300/0 conn(0x7fe86c162f40 0x7fe86c0d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 --2- 172.21.15.52:0/1536093307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b4dd0 0x7fe86c0d3990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 -- 172.21.15.52:0/1536093307 >> 172.21.15.52:0/1536093307 conn(0x7fe86c09e600 msgr2=0x7fe86c0d53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 -- 172.21.15.52:0/1536093307 shutdown_connections 2024-06-02T16:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.624+0000 7fe872400640 1 -- 172.21.15.52:0/1536093307 wait complete. 2024-06-02T16:46:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.626+0000 7fe872400640 1 Processor -- start 2024-06-02T16:46:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.626+0000 7fe872400640 1 -- start start 2024-06-02T16:46:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b51b0 0x7fe86c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c162f40 0x7fe86c14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0b5910 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0b5790 con 0x7fe86c162f40 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe872400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c0b5a90 con 0x7fe86c0b51b0 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe871000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe871000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47008/0 (socket says 172.21.15.52:47008) 2024-06-02T16:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe871000640 1 -- 172.21.15.52:0/3390650294 learned_addr learned my addr 172.21.15.52:0/3390650294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe86be00640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b51b0 0x7fe86c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.627+0000 7fe871a00640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c162f40 0x7fe86c14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 -- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b51b0 msgr2=0x7fe86c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b51b0 0x7fe86c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 -- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c162f40 msgr2=0x7fe86c14d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c162f40 0x7fe86c14d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 -- 172.21.15.52:0/3390650294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0ca370 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe871000640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0098c0 tx=0x7fe85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037050 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c038040 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c004490 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.628+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c0ca650 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.629+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c14e730 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.630+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c14e550 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.631+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe85c003610 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.633+0000 7fe868c00640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 0x7fe84c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:46:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.633+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe85c0b7e90 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.633+0000 7fe86be00640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 0x7fe84c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:46:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.635+0000 7fe86be00640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 0x7fe84c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe86c06e3f0 tx=0x7fe858009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:46:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.638+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe86c14e550 con 0x7fe86c0b4dd0 2024-06-02T16:46:17.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:17.895+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe86c0507e0 con 0x7fe86c0b4dd0 2024-06-02T16:46:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.094+0000 7fe868c00640 1 -- 172.21.15.52:0/3390650294 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) ==== 167+0+0 (secure 0 0 0) 0x7fe85c0816d0 con 0x7fe86c0b4dd0 2024-06-02T16:46:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:enabled new snapshots 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 msgr2=0x7fe84c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 0x7fe84c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe86c06e3f0 tx=0x7fe858009040 comp rx=0 tx=0).stop 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 msgr2=0x7fe86c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0098c0 tx=0x7fe85c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 shutdown_connections 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe84c0762d0 0x7fe84c078790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c162f40 0x7fe86c14d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe86c0b51b0 0x7fe86c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 --2- 172.21.15.52:0/3390650294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe86c0b4dd0 0x7fe86c0b60d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:46:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 >> 172.21.15.52:0/3390650294 conn(0x7fe86c09e600 msgr2=0x7fe86c0d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:46:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 shutdown_connections 2024-06-02T16:46:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:46:18.099+0000 7fe872400640 1 -- 172.21.15.52:0/3390650294 wait complete. 2024-06-02T16:46:18.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:46:18.122 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-06-02T16:46:18.189 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:46:18.190 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:46:18.245 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-06-02T16:46:18.245 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> import uuid 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> n = 2000 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = False 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> if 3 > 0: 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = True 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> dpath = os.path.dirname(path) 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> fnameprefix = os.path.basename(path) 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> os.makedirs(dpath, exist_ok=True) 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-06-02T16:46:18.246 DEBUG:teuthology.orchestra.run.smithi052:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> for i in range(n): 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> with open(fpath, '"'"'w'"'"') as f: 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> f.write(f"{i}") 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> f.flush() 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(f.fileno()) 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> os.unlink(fpath) 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-06-02T16:46:18.247 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> if create_hard_links: 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> for j in range(3): 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> finally: 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> os.close(dirfd) 2024-06-02T16:46:18.248 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-06-02T16:46:35.324 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:46:35.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:47:05.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:47:05.456 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:47:16.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:47:16.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:47:16.624 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-06-02T16:47:16.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:47:16.705 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-06-02T16:47:35.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:47:35.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:48:05.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:48:05.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:48:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:16.219 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-06-02T16:48:16.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-06-02T16:48:16.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.493+0000 7f7557200640 1 Processor -- start 2024-06-02T16:48:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.493+0000 7f7557200640 1 -- start start 2024-06-02T16:48:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7557200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7558073390 0x7f75580b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7557200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75580d17b0 0x7f7558070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7557200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75580ceea0 con 0x7f75580ce920 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7557200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f75580cf180 con 0x7f7558073390 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7557200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f75580cf460 con 0x7f75580d17b0 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f754fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75580ce920 0x7f7558073770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:36268/0 (socket says 172.21.15.52:36268) 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f754fe00640 1 -- 172.21.15.52:0/1266443510 learned_addr learned my addr 172.21.15.52:0/1266443510 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7555e00640 1 --2- 172.21.15.52:0/1266443510 >> v2:172.21.15.52:3300/0 conn(0x7f7558073390 0x7f75580b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.495+0000 7f7556800640 1 --2- 172.21.15.52:0/1266443510 >> v2:172.21.15.114:3300/0 conn(0x7f75580d17b0 0x7f7558070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555400640 1 -- 172.21.15.52:0/1266443510 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278657670 0 0) 0x7f75580ceea0 con 0x7f75580ce920 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555400640 1 -- 172.21.15.52:0/1266443510 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c003520 con 0x7f75580ce920 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555e00640 1 -- 172.21.15.52:0/1266443510 >> v2:172.21.15.114:3300/0 conn(0x7f75580d17b0 msgr2=0x7f7558070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555e00640 1 --2- 172.21.15.52:0/1266443510 >> v2:172.21.15.114:3300/0 conn(0x7f75580d17b0 0x7f7558070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555e00640 1 -- 172.21.15.52:0/1266443510 >> v1:172.21.15.52:6789/0 conn(0x7f75580ce920 legacy=0x7f7558073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.496+0000 7f7555e00640 1 -- 172.21.15.52:0/1266443510 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75580cf740 con 0x7f7558073390 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.497+0000 7f7555e00640 1 --2- 172.21.15.52:0/1266443510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7558073390 0x7f75580b4f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f75580cfcf0 tx=0x7f754802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71ec5058dba834c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.497+0000 7f7555400640 1 -- 172.21.15.52:0/1266443510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548037070 con 0x7f7558073390 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.497+0000 7f7555400640 1 -- 172.21.15.52:0/1266443510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7548032440 con 0x7f7558073390 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.497+0000 7f7555400640 1 -- 172.21.15.52:0/1266443510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548032810 con 0x7f7558073390 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 -- 172.21.15.52:0/1266443510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7558073390 msgr2=0x7f75580b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 --2- 172.21.15.52:0/1266443510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7558073390 0x7f75580b4f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f75580cfcf0 tx=0x7f754802a1a0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 -- 172.21.15.52:0/1266443510 shutdown_connections 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 --2- 172.21.15.52:0/1266443510 >> v2:172.21.15.114:3300/0 conn(0x7f75580d17b0 0x7f7558070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 --2- 172.21.15.52:0/1266443510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7558073390 0x7f75580b4f30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 -- 172.21.15.52:0/1266443510 >> 172.21.15.52:0/1266443510 conn(0x7f75580d1f40 msgr2=0x7f75580d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 -- 172.21.15.52:0/1266443510 shutdown_connections 2024-06-02T16:48:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.498+0000 7f7557200640 1 -- 172.21.15.52:0/1266443510 wait complete. 2024-06-02T16:48:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.500+0000 7f7557200640 1 Processor -- start 2024-06-02T16:48:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.500+0000 7f7557200640 1 -- start start 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7558073390 0x7f755815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75580ce920 0x7f755813df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7558145f40 con 0x7f75580d17b0 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7558145dc0 con 0x7f75580ce920 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7557200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f75580710c0 con 0x7f7558073390 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38636/0 (socket says 172.21.15.52:38636) 2024-06-02T16:48:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.501+0000 7f7556800640 1 -- 172.21.15.52:0/3564293422 learned_addr learned my addr 172.21.15.52:0/3564293422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7555e00640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7558073390 0x7f755815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 -- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7558073390 msgr2=0x7f755815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f754fe00640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75580ce920 0x7f755813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7558073390 0x7f755815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 -- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75580ce920 msgr2=0x7f755813df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75580ce920 0x7f755813df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 -- 172.21.15.52:0/3564293422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7558161d80 con 0x7f75580d17b0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.502+0000 7f7556800640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7550007e60 tx=0x7f755000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.503+0000 7f754e000640 1 -- 172.21.15.52:0/3564293422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550014420 con 0x7f75580d17b0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.503+0000 7f754e000640 1 -- 172.21.15.52:0/3564293422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7550019070 con 0x7f75580d17b0 2024-06-02T16:48:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.503+0000 7f754e000640 1 -- 172.21.15.52:0/3564293422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550014820 con 0x7f75580d17b0 2024-06-02T16:48:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.503+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755813eb00 con 0x7f75580d17b0 2024-06-02T16:48:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.503+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755813f0c0 con 0x7f75580d17b0 2024-06-02T16:48:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.505+0000 7f754e000640 1 -- 172.21.15.52:0/3564293422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75500149c0 con 0x7f75580d17b0 2024-06-02T16:48:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.506+0000 7f754e000640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 0x7f7534078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.506+0000 7f754e000640 1 -- 172.21.15.52:0/3564293422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7550097f00 con 0x7f75580d17b0 2024-06-02T16:48:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.506+0000 7f755fb8f740 1 Processor -- start 2024-06-02T16:48:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.507+0000 7f755fb8f740 1 -- start start 2024-06-02T16:48:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.507+0000 7f7555e00640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 0x7f7534078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcfd890 0x560fdbcb0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbcdfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560fdbc270b0 con 0x560fdbce0270 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fdbc16c50 con 0x560fdbcfd890 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fdbc1ac90 con 0x560fdbce09b0 2024-06-02T16:48:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38638/0 (socket says 172.21.15.52:38638) 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 -- 172.21.15.52:0/2606592913 learned_addr learned my addr 172.21.15.52:0/2606592913 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7555e00640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 0x7f7534078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7548034000 tx=0x7f754802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f754fe00640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbcdfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7555e00640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcfd890 0x560fdbcb0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 -- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 msgr2=0x560fdbcdfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbcdfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 -- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcfd890 msgr2=0x560fdbcb0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcfd890 0x560fdbcb0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f7556800640 1 -- 172.21.15.52:0/2606592913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdb9f57d0 con 0x560fdbce0270 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.508+0000 7f754fe00640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbcdfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.509+0000 7f7556800640 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f755000c040 tx=0x7f7550014cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6551b48018fd5d2c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.509+0000 7f7546600640 1 -- 172.21.15.52:0/2606592913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550065470 con 0x560fdbce0270 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.509+0000 7f7546600640 1 -- 172.21.15.52:0/2606592913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7550069e90 con 0x560fdbce0270 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.509+0000 7f7546600640 1 -- 172.21.15.52:0/2606592913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550069a00 con 0x560fdbce0270 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 -- 172.21.15.52:0/2606592913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 msgr2=0x560fdbcb5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f755000c040 tx=0x7f7550014cb0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 -- 172.21.15.52:0/2606592913 shutdown_connections 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce0270 0x560fdbcb5080 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbcdfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 --2- 172.21.15.52:0/2606592913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcfd890 0x560fdbcb0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 -- 172.21.15.52:0/2606592913 >> 172.21.15.52:0/2606592913 conn(0x560fdbcb2490 msgr2=0x560fdbcfad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 -- 172.21.15.52:0/2606592913 shutdown_connections 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.510+0000 7f755fb8f740 1 -- 172.21.15.52:0/2606592913 wait complete. 2024-06-02T16:48:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.511+0000 7f755fb8f740 1 -- start start 2024-06-02T16:48:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.511+0000 7f755fb8f740 1 Processor -- start 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcfc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560fdb8fc970 con 0x560fdbce09b0 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fdbbb5f90 con 0x560fdbcd0ea0 2024-06-02T16:48:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fdbcb4640 con 0x560fdbcfd890 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f755fb8f740 10 client.0 _ll_register_callbacks cb 0x560fdbb9d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f7555e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f7555e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38642/0 (socket says 172.21.15.52:38642) 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f7555e00640 1 -- 172.21.15.52:0/4059113712 learned_addr learned my addr 172.21.15.52:0/4059113712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f754fe00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.512+0000 7f7556800640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcfc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 -- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 msgr2=0x560fdbd0ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 -- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 msgr2=0x560fdbcfc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcfc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 -- 172.21.15.52:0/4059113712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdb8eb0f0 con 0x560fdbce09b0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f7555e00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7548009890 tx=0x7f7548004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c630fb185d5e1f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f753aa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548037040 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7548032de0 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.513+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7550069e90 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f754804a480 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 10 client.4971 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560fdba55f60 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7550069e90 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f754804a620 con 0x560fdbce09b0 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 10 client.4971 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 10 client.4971 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 20 client.4971 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbcddcf0 0x560fdbcde0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 4 client.4971 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:48:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.514+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fdbc29000 con 0x560fdbcddcf0 2024-06-02T16:48:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.515+0000 7f754fe00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbcddcf0 0x560fdbcde0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.515+0000 7f753aa00640 10 client.4971 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.515+0000 7f754fe00640 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbcddcf0 0x560fdbcde0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa88b64f40f6461 server_cookie=855299174e3959f2 in_seq=0 out_seq=0 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f753aa00640 1 -- 172.21.15.52:0/4059113712 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560fdbc29000 con 0x560fdbcddcf0 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f753aa00640 10 client.4971 handle_command_reply: tid=0 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f755fb8f740 1 client.4971 shutdown 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 msgr2=0x560fdbd0e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7548009890 tx=0x7f7548004730 comp rx=0 tx=0).stop 2024-06-02T16:48:16.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 shutdown_connections 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.516+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcfc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbcddcf0 0x560fdbcde0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 --2- 172.21.15.52:0/4059113712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbd0e680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f753aa00640 0 client.4971 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 >> 172.21.15.52:0/4059113712 conn(0x560fdbce0270 msgr2=0x560fdbcfad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 shutdown_connections 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 1 -- 172.21.15.52:0/4059113712 wait complete. 2024-06-02T16:48:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.517+0000 7f755fb8f740 20 client.4971 trim_cache size 0 max 16384 2024-06-02T16:48:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.535+0000 7f755fb8f740 1 Processor -- start 2024-06-02T16:48:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.535+0000 7f755fb8f740 1 -- start start 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcb02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7558201610 con 0x560fdbce09b0 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7558200610 con 0x560fdbcd0ea0 2024-06-02T16:48:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.536+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f75581ff9c0 con 0x560fdbcfd890 2024-06-02T16:48:16.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38652/0 (socket says 172.21.15.52:38652) 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 -- 172.21.15.52:0/3968458471 learned_addr learned my addr 172.21.15.52:0/3968458471 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f7556800640 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f7555e00640 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcb02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 -- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 msgr2=0x560fdbd0d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 -- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 msgr2=0x560fdbcb02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcb02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.537+0000 7f754fe00640 1 -- 172.21.15.52:0/3968458471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdb8c41b0 con 0x560fdbce09b0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.538+0000 7f754fe00640 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7558076b90 tx=0x7f7540001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb40d6122e5343e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.538+0000 7f7545c00640 1 -- 172.21.15.52:0/3968458471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540014a40 con 0x560fdbce09b0 2024-06-02T16:48:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.538+0000 7f7545c00640 1 -- 172.21.15.52:0/3968458471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7540014be0 con 0x560fdbce09b0 2024-06-02T16:48:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.538+0000 7f7545c00640 1 -- 172.21.15.52:0/3968458471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400058b0 con 0x560fdbce09b0 2024-06-02T16:48:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- 172.21.15.52:0/3968458471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 msgr2=0x560fdbcd0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7558076b90 tx=0x7f7540001df0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- 172.21.15.52:0/3968458471 shutdown_connections 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbcfd890 0x560fdbd0d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbce09b0 0x560fdbcd0500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 --2- 172.21.15.52:0/3968458471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbcb02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- 172.21.15.52:0/3968458471 >> 172.21.15.52:0/3968458471 conn(0x560fdbce0270 msgr2=0x560fdbcfd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- 172.21.15.52:0/3968458471 shutdown_connections 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- 172.21.15.52:0/3968458471 wait complete. 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.539+0000 7f755fb8f740 1 -- start start 2024-06-02T16:48:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.540+0000 7f755fb8f740 1 Processor -- start 2024-06-02T16:48:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbce2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbd82170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75581fffc0 con 0x560fdbcfd890 2024-06-02T16:48:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560fdbce15d0 con 0x560fdbcd0ea0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x560fdbce2710 con 0x560fdbce09b0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f755fb8f740 10 client.0 _ll_register_callbacks cb 0x7f7548035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38660/0 (socket says 172.21.15.52:38660) 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 -- 172.21.15.52:0/662126495 learned_addr learned my addr 172.21.15.52:0/662126495 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7555e00640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbce2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f754fe00640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbd82170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 -- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 msgr2=0x560fdbd82170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbd82170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 -- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 msgr2=0x560fdbce2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbce2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7556800640 1 -- 172.21.15.52:0/662126495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdbd6aff0 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.541+0000 7f7555e00640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbce2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f7556800640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f755000efd0 tx=0x7f755001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faee615184b8a996 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f753aa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755005d7c0 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7550069c00 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7540014be0 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7550069e90 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f755fb8f740 10 client.4977 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.542+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560fdbd81c50 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7540014be0 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f75500603d0 con 0x560fdbcfd890 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 10 client.4977 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 10 client.4977 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 20 client.4977 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbce2040 0x560fdbcfbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 4 client.4977 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "perf dump"}) -- 0x560fdbc227e0 con 0x560fdbce2040 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.543+0000 7f7555e00640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbce2040 0x560fdbcfbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.544+0000 7f753aa00640 10 client.4977 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.544+0000 7f7555e00640 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbce2040 0x560fdbcfbe30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04909a3b50f2bf5 server_cookie=c8905864d6f858c4 in_seq=0 out_seq=0 2024-06-02T16:48:16.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.544+0000 7f753aa00640 1 -- 172.21.15.52:0/662126495 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17988 (crc 0 0 0) 0x560fdbc227e0 con 0x560fdbce2040 2024-06-02T16:48:16.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.544+0000 7f753aa00640 10 client.4977 handle_command_reply: tid=0 2024-06-02T16:48:16.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.544+0000 7f755fb8f740 1 client.4977 shutdown 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 msgr2=0x560fdbce1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f755000efd0 tx=0x7f755001e000 comp rx=0 tx=0).stop 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 shutdown_connections 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x560fdbce2040 0x560fdbcfbe30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fdbcfd890 0x560fdbce1b00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x560fdbce09b0 0x560fdbd82170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 --2- 172.21.15.52:0/662126495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560fdbcd0ea0 0x560fdbce2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 >> 172.21.15.52:0/662126495 conn(0x560fdbce0270 msgr2=0x560fdbcde6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f753aa00640 0 client.4977 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 shutdown_connections 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 1 -- 172.21.15.52:0/662126495 wait complete. 2024-06-02T16:48:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.545+0000 7f755fb8f740 20 client.4977 trim_cache size 0 max 16384 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1672, 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1673, 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 422770, 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 37144676, 2024-06-02T16:48:16.549 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 9, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.518150591, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.304529307, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.078756951, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.105671406, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1671, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.700667529, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000419310 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-06-02T16:48:16.550 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000220, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000110 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 27443, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 49288, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 9660864, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 42629715, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 7, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-06-02T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 8.773958457, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 6.241488548, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 3.102340322, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.254472635, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 49288, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 3.568878884, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000072408 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 45950, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.024471894, 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000532 2024-06-02T16:48:16.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 130144, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 30592 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2116, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2144, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 720426, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 32517112, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.559901255, 2024-06-02T16:48:16.553 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.284749509, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.107069414, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.130181797, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2143, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.540428874, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000252183 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.554 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 103440 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1642, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 29.586049571, 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.018018300 2024-06-02T16:48:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1945, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.748747031, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000899098 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25760, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25760, 2024-06-02T16:48:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25760, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 649.438966922, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.025211140 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 19904, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-06-02T16:48:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 19904, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 19903, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 63, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 63, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 47133, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46473, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 127, 2024-06-02T16:48:16.558 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-06-02T16:48:16.559 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 546, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4016, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2547, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2017, 2024-06-02T16:48:16.560 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 68, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14158 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 2000, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 163, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4188, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 1778, 2024-06-02T16:48:16.561 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2251, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-06-02T16:48:16.562 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 23725, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 23725, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 32, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 32, 2024-06-02T16:48:16.563 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 3, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 94540854, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2732, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 140.369243393, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.051379664 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-06-02T16:48:16.564 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 2014, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2014, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 19904, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19905, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 1, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 63, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 9058, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 8995, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 109272, 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-06-02T16:48:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28893, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25760, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 8, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.151679872, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002075839 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 30, 2024-06-02T16:48:16.566 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007188896, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000239629 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 17.042404811, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002840400 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-06-02T16:48:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7465, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 8.659870357, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001160063 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000159891, 2024-06-02T16:48:16.569 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000159891 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005096194, 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005096194 2024-06-02T16:48:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.006186284, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006186284 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000140424, 2024-06-02T16:48:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000140424 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.147248928, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.018406116 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2251, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 578.115105828, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.256825902 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.572 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.573 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.011340586, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.011340586 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000700548, 2024-06-02T16:48:16.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000700548 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-06-02T16:48:16.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.576 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 41.291844303, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005161480 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-06-02T16:48:16.577 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 14217, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 14217, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 118, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T16:48:16.578 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-06-02T16:48:16.579 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-06-02T16:48:16.580 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 16474786, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 6145, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-06-02T16:48:16.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5312, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 75, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 21748700, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 888119, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-06-02T16:48:16.582 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 4886, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 90812799, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 31, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 4886, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4886, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 42.305477756, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.008658509 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-06-02T16:48:16.583 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4886, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 5038 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 4886, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 82, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 4804, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 82, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2814, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 51, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-06-02T16:48:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1778, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 33, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-06-02T16:48:16.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-06-02T16:48:16.586 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 35, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 1, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-06-02T16:48:16.587 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 209, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 38 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-06-02T16:48:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 1778, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 1778, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:16.589 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 31227, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 8408048, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 31227, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 31227, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8408048, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.590 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4886, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 91006601, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4886, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 91006601, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.591 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4886, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 4886, 2024-06-02T16:48:16.592 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4886, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 4886, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 1778, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 193802, 2024-06-02T16:48:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 1778, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 82, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 193802, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x55bd2bb5e500": { 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 84, 2024-06-02T16:48:16.594 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 23725, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 90346550, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 23725, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2732, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 90346466, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:16.595 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.596 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:16.596 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 msgr2=0x7f7534078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 0x7f7534078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7548034000 tx=0x7f754802e000 comp rx=0 tx=0).stop 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 msgr2=0x7f755813e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7550007e60 tx=0x7f755000e4b0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 shutdown_connections 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75340762d0 0x7f7534078790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75580d17b0 0x7f755813e4a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75580ce920 0x7f755813df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 --2- 172.21.15.52:0/3564293422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7558073390 0x7f755815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 >> 172.21.15.52:0/3564293422 conn(0x7f75580d1f40 msgr2=0x7f7558143b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 shutdown_connections 2024-06-02T16:48:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.546+0000 7f7557200640 1 -- 172.21.15.52:0/3564293422 wait complete. 2024-06-02T16:48:16.598 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-06-02T16:48:16.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:16.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-06-02T16:48:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.807+0000 7fb6ab200640 1 Processor -- start 2024-06-02T16:48:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.807+0000 7fb6ab200640 1 -- start start 2024-06-02T16:48:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d1fa0 0x7fb6a40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6ab200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6a40d2380 0x7fb6a415f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6ab200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a40d3210 con 0x7fb6a40d1050 2024-06-02T16:48:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6ab200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a40d2fc0 con 0x7fb6a40d2380 2024-06-02T16:48:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6ab200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a406e240 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb69b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6a40d2380 0x7fb6a415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb69b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6a40d2380 0x7fb6a415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38662/0 (socket says 172.21.15.52:38662) 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb69b400640 1 -- 172.21.15.52:0/149423219 learned_addr learned my addr 172.21.15.52:0/149423219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.809+0000 7fb6a9200640 1 --1- 172.21.15.52:0/149423219 >> v1:172.21.15.52:6789/0 conn(0x7fb6a40d1050 0x7fb6a415f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:36276/0 (socket says 172.21.15.52:36276) 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.810+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d1fa0 0x7fb6a40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.810+0000 7fb69b400640 1 -- 172.21.15.52:0/149423219 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d1fa0 msgr2=0x7fb6a40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.810+0000 7fb69b400640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d1fa0 0x7fb6a40d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.810+0000 7fb69b400640 1 -- 172.21.15.52:0/149423219 >> v1:172.21.15.52:6789/0 conn(0x7fb6a40d1050 legacy=0x7fb6a415f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.810+0000 7fb69b400640 1 -- 172.21.15.52:0/149423219 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a40d34f0 con 0x7fb6a40d2380 2024-06-02T16:48:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.811+0000 7fb69b400640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d2380 0x7fb6a415f040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009870 tx=0x7fb68c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6c41e327043f29 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.811+0000 7fb6a3400640 1 -- 172.21.15.52:0/149423219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c037070 con 0x7fb6a40d2380 2024-06-02T16:48:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.811+0000 7fb6a3400640 1 -- 172.21.15.52:0/149423219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c032440 con 0x7fb6a40d2380 2024-06-02T16:48:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.811+0000 7fb6a3400640 1 -- 172.21.15.52:0/149423219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c032810 con 0x7fb6a40d2380 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 -- 172.21.15.52:0/149423219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d2380 msgr2=0x7fb6a415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d2380 0x7fb6a415f040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009870 tx=0x7fb68c02a250 comp rx=0 tx=0).stop 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 -- 172.21.15.52:0/149423219 shutdown_connections 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d2380 0x7fb6a415f040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 --2- 172.21.15.52:0/149423219 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d1fa0 0x7fb6a40d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 -- 172.21.15.52:0/149423219 >> 172.21.15.52:0/149423219 conn(0x7fb6a40d53f0 msgr2=0x7fb6a40d5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 -- 172.21.15.52:0/149423219 shutdown_connections 2024-06-02T16:48:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.812+0000 7fb6ab200640 1 -- 172.21.15.52:0/149423219 wait complete. 2024-06-02T16:48:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.814+0000 7fb6ab200640 1 Processor -- start 2024-06-02T16:48:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.814+0000 7fb6ab200640 1 -- start start 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a40d1050 0x7fb6a4162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 0x7fb6a40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40d3d90 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40d3ab0 con 0x7fb6a40d1050 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb6ab200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40d42b0 con 0x7fb6a40d2380 2024-06-02T16:48:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38678/0 (socket says 172.21.15.52:38678) 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.815+0000 7fb69b400640 1 -- 172.21.15.52:0/2714829898 learned_addr learned my addr 172.21.15.52:0/2714829898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a40d1050 0x7fb6a4162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a9200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 0x7fb6a40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 -- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 msgr2=0x7fb6a40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 0x7fb6a40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 -- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a40d1050 msgr2=0x7fb6a4162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a40d1050 0x7fb6a4162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 -- 172.21.15.52:0/2714829898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4160a70 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a9200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 0x7fb6a40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb69b400640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb68c02a290 tx=0x7fb68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a0c00640 1 -- 172.21.15.52:0/2714829898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c041020 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a0c00640 1 -- 172.21.15.52:0/2714829898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0306e0 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6a0c00640 1 -- 172.21.15.52:0/2714829898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c037040 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.816+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a4160d50 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.817+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a4161310 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.819+0000 7fb6a0c00640 1 -- 172.21.15.52:0/2714829898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb68c044020 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.820+0000 7fb6a0c00640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 0x7fb6800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.820+0000 7fb6a0c00640 1 -- 172.21.15.52:0/2714829898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb68c0b7e30 con 0x7fb6a40d1fa0 2024-06-02T16:48:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.821+0000 7fb6ae07d740 1 Processor -- start 2024-06-02T16:48:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.821+0000 7fb6ae07d740 1 -- start start 2024-06-02T16:48:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.821+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 0x7fb6800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfbd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 0x563accfb5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563accf03170 con 0x563accfbdd00 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x563accef2d10 con 0x563accf8d9a0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x563accef6d50 con 0x563accfbd2e0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 0x7fb6800787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb694006fd0 tx=0x7fb694008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38680/0 (socket says 172.21.15.52:38680) 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.822+0000 7fb69b400640 1 -- 172.21.15.52:0/1229927530 learned_addr learned my addr 172.21.15.52:0/1229927530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfbd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb6a9200640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 0x563accfb5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 -- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 msgr2=0x563accfbd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfbd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 -- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 msgr2=0x563accfb5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 0x563accfb5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 -- 172.21.15.52:0/1229927530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563acceabf10 con 0x563accfbdd00 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb6a9200640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 0x563accfb5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb69b400640 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb68c07d0f0 tx=0x7fb68c0807e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f37f4c9a878f88 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb698c00640 1 -- 172.21.15.52:0/1229927530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c081070 con 0x563accfbdd00 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb698c00640 1 -- 172.21.15.52:0/1229927530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c085420 con 0x563accfbdd00 2024-06-02T16:48:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.823+0000 7fb698c00640 1 -- 172.21.15.52:0/1229927530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c089e40 con 0x563accfbdd00 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 -- 172.21.15.52:0/1229927530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 msgr2=0x563accf8d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb68c07d0f0 tx=0x7fb68c0807e0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 -- 172.21.15.52:0/1229927530 shutdown_connections 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accf8d9a0 0x563accfb5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbdd00 0x563accf8d460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/1229927530 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfbd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 -- 172.21.15.52:0/1229927530 >> 172.21.15.52:0/1229927530 conn(0x563accf8f6d0 msgr2=0x563accfd80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 -- 172.21.15.52:0/1229927530 shutdown_connections 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.824+0000 7fb6ae07d740 1 -- 172.21.15.52:0/1229927530 wait complete. 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.825+0000 7fb6ae07d740 1 -- start start 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.825+0000 7fb6ae07d740 1 Processor -- start 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbdd00 0x563accf92e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfa21c0 0x563accfa2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563accbd8ab0 con 0x563accfbd2e0 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x563acce91360 con 0x563accfa21c0 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x563accf03170 con 0x563accfbdd00 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.826+0000 7fb6ae07d740 10 client.0 _ll_register_callbacks cb 0x563accebbd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38696/0 (socket says 172.21.15.52:38696) 2024-06-02T16:48:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 -- 172.21.15.52:0/152430011 learned_addr learned my addr 172.21.15.52:0/152430011 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a9200640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfa21c0 0x563accfa2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb69b400640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbdd00 0x563accf92e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 -- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbdd00 msgr2=0x563accf92e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbdd00 0x563accf92e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 -- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfa21c0 msgr2=0x563accfa2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfa21c0 0x563accfa2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 -- 172.21.15.52:0/152430011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563acccd3940 con 0x563accfbd2e0 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb69400efe0 tx=0x7fb694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9a09edeb9e797f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.827+0000 7fb691600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69400f040 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb694015da0 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb68c085420 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb69402d050 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb6ae07d740 10 client.4992 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563accd340d0 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.828+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c085420 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fb694030020 con 0x563accfbd2e0 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 10 client.4992 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 10 client.4992 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 20 client.4992 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563accfa2b80 0x563accfbe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 4 client.4992 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:48:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563accf050c0 con 0x563accfa2b80 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb69b400640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563accfa2b80 0x563accfbe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb69b400640 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563accfa2b80 0x563accfbe5d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf157511d74c10f server_cookie=98b862ed7fee8959 in_seq=0 out_seq=0 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.829+0000 7fb691600640 10 client.4992 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.830+0000 7fb691600640 1 -- 172.21.15.52:0/152430011 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x563accf050c0 con 0x563accfa2b80 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.830+0000 7fb691600640 10 client.4992 handle_command_reply: tid=0 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.830+0000 7fb6ae07d740 1 client.4992 shutdown 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.830+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 msgr2=0x563accf928d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.830+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb69400efe0 tx=0x7fb694004730 comp rx=0 tx=0).stop 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 shutdown_connections 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfa21c0 0x563accfa2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbdd00 0x563accf92e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563accfa2b80 0x563accfbe5d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/152430011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf928d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 >> 172.21.15.52:0/152430011 conn(0x563accf8d9a0 msgr2=0x563accfdb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb691600640 0 client.4992 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 shutdown_connections 2024-06-02T16:48:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 1 -- 172.21.15.52:0/152430011 wait complete. 2024-06-02T16:48:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.831+0000 7fb6ae07d740 20 client.4992 trim_cache size 0 max 16384 2024-06-02T16:48:16.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.851+0000 7fb6ae07d740 1 Processor -- start 2024-06-02T16:48:16.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.851+0000 7fb6ae07d740 1 -- start start 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfd7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accf942e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4201af0 con 0x563accfa21c0 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4200be0 con 0x563accfbdd00 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40cd2f0 con 0x563accfbd2e0 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38698/0 (socket says 172.21.15.52:38698) 2024-06-02T16:48:16.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.852+0000 7fb6a3e00640 1 -- 172.21.15.52:0/2285505498 learned_addr learned my addr 172.21.15.52:0/2285505498 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 -- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 msgr2=0x563accfd7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb69b400640 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfd7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfd7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 -- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 msgr2=0x563accf942e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accf942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 -- 172.21.15.52:0/2285505498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563accbc7230 con 0x563accfa21c0 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb69400e710 tx=0x7fb69401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0ded3ae86f96af server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.853+0000 7fb693e00640 1 -- 172.21.15.52:0/2285505498 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694015da0 con 0x563accfa21c0 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb693e00640 1 -- 172.21.15.52:0/2285505498 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb694036070 con 0x563accfa21c0 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb693e00640 1 -- 172.21.15.52:0/2285505498 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694020b30 con 0x563accfa21c0 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 -- 172.21.15.52:0/2285505498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 msgr2=0x563accfea7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb69400e710 tx=0x7fb69401e000 comp rx=0 tx=0).stop 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 -- 172.21.15.52:0/2285505498 shutdown_connections 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accf942e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfbd2e0 0x563accfd7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/2285505498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfa21c0 0x563accfea7f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 -- 172.21.15.52:0/2285505498 >> 172.21.15.52:0/2285505498 conn(0x563accf8d9a0 msgr2=0x563accfd7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 -- 172.21.15.52:0/2285505498 shutdown_connections 2024-06-02T16:48:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.854+0000 7fb6ae07d740 1 -- 172.21.15.52:0/2285505498 wait complete. 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.855+0000 7fb6ae07d740 1 -- start start 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.855+0000 7fb6ae07d740 1 Processor -- start 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfa21c0 0x563accff1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accffabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563accf90600 con 0x563accfbd2e0 2024-06-02T16:48:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a41f6420 con 0x563accfbdd00 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x563acd059920 con 0x563accfa21c0 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb6ae07d740 10 client.0 _ll_register_callbacks cb 0x7fb6940095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.856+0000 7fb69b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38702/0 (socket says 172.21.15.52:38702) 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 -- 172.21.15.52:0/322052311 learned_addr learned my addr 172.21.15.52:0/322052311 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 -- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfa21c0 msgr2=0x563accff1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfa21c0 0x563accff1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 -- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 msgr2=0x563accffabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accffabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 -- 172.21.15.52:0/322052311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563accf915b0 con 0x563accfbd2e0 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb69b400640 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb68c07d0a0 tx=0x7fb68c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c466589124ec2d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb691600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c09e070 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb68c07d300 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.857+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb694036070 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb68c085420 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 10 client.4998 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563accff23e0 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb694036070 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fb68c03a030 con 0x563accfbd2e0 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 10 client.4998 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 10 client.4998 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 20 client.4998 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563acd059180 0x563accffb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 4 client.4998 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-06-02T16:48:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x563accefe8a0 con 0x563acd059180 2024-06-02T16:48:16.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.858+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563acd059180 0x563accffb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:16.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.859+0000 7fb6a3e00640 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563acd059180 0x563accffb0f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174235319a5c0e51 server_cookie=a4723a517cdf45ee in_seq=0 out_seq=0 2024-06-02T16:48:16.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.859+0000 7fb691600640 10 client.4998 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb691600640 1 -- 172.21.15.52:0/322052311 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563accefe8a0 con 0x563acd059180 2024-06-02T16:48:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb691600640 10 client.4998 handle_command_reply: tid=0 2024-06-02T16:48:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 client.4998 shutdown 2024-06-02T16:48:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 msgr2=0x563accf9f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb68c07d0a0 tx=0x7fb68c03e000 comp rx=0 tx=0).stop 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 shutdown_connections 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563accfbdd00 0x563accffabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x563acd059180 0x563accffb0f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563accfbd2e0 0x563accf9f5c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 --2- 172.21.15.52:0/322052311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563accfa21c0 0x563accff1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.865+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 >> 172.21.15.52:0/322052311 conn(0x563accf8d9a0 msgr2=0x563accfb9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.866+0000 7fb691600640 0 client.4998 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.866+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 shutdown_connections 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.866+0000 7fb6ae07d740 1 -- 172.21.15.52:0/322052311 wait complete. 2024-06-02T16:48:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.866+0000 7fb6ae07d740 20 client.4998 trim_cache size 0 max 16384 2024-06-02T16:48:16.867 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:48:16.867 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-06-02T16:48:16.867 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "1f4dd0c4-b06c-4181-8fba-3952b4dc6a0a", 2024-06-02T16:48:16.867 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-06-02T16:48:16.867 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 msgr2=0x7fb6800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 0x7fb6800787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb694006fd0 tx=0x7fb694008040 comp rx=0 tx=0).stop 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 msgr2=0x7fb6a40ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb68c02a290 tx=0x7fb68c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 shutdown_connections 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb680076320 0x7fb6800787e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6a40d2380 0x7fb6a40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6a40d1fa0 0x7fb6a40ce130 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 --2- 172.21.15.52:0/2714829898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a40d1050 0x7fb6a4162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 >> 172.21.15.52:0/2714829898 conn(0x7fb6a40d53f0 msgr2=0x7fb6a40b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 shutdown_connections 2024-06-02T16:48:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:16.867+0000 7fb6ab200640 1 -- 172.21.15.52:0/2714829898 wait complete. 2024-06-02T16:48:16.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:16.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-06-02T16:48:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.120+0000 7f13ed600640 1 Processor -- start 2024-06-02T16:48:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.120+0000 7f13ed600640 1 -- start start 2024-06-02T16:48:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13ed600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13e80b7130 0x7f13e80b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13ed600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13e80d5f10 0x7f13e80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13ed600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e80b7b20 con 0x7f13e8162ae0 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13ed600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f13e80b7e00 con 0x7f13e80d5f10 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13ed600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f13e806ee90 con 0x7f13e80b7130 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.122+0000 7f13e6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13e80d5f10 0x7f13e80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13e80d5f10 0x7f13e80b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38714/0 (socket says 172.21.15.52:38714) 2024-06-02T16:48:17.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 -- 172.21.15.52:0/4090640181 learned_addr learned my addr 172.21.15.52:0/4090640181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 -- 172.21.15.52:0/4090640181 >> v2:172.21.15.114:3300/0 conn(0x7f13e80b7130 msgr2=0x7f13e80b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 --2- 172.21.15.52:0/4090640181 >> v2:172.21.15.114:3300/0 conn(0x7f13e80b7130 0x7f13e80b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 -- 172.21.15.52:0/4090640181 >> v1:172.21.15.114:6789/0 conn(0x7f13e8162ae0 legacy=0x7f13e806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.123+0000 7f13e6000640 1 -- 172.21.15.52:0/4090640181 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e806f170 con 0x7f13e80d5f10 2024-06-02T16:48:17.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.125+0000 7f13e6000640 1 --2- 172.21.15.52:0/4090640181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80d5f10 0x7f13e80b42b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13e8063e20 tx=0x7f13d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a22a15ca6cd2db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.125+0000 7f13e5600640 1 -- 172.21.15.52:0/4090640181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4037070 con 0x7f13e80d5f10 2024-06-02T16:48:17.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.126+0000 7f13e5600640 1 -- 172.21.15.52:0/4090640181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d4032440 con 0x7f13e80d5f10 2024-06-02T16:48:17.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.126+0000 7f13e5600640 1 -- 172.21.15.52:0/4090640181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4032810 con 0x7f13e80d5f10 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.126+0000 7f13ed600640 1 -- 172.21.15.52:0/4090640181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80d5f10 msgr2=0x7f13e80b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.126+0000 7f13ed600640 1 --2- 172.21.15.52:0/4090640181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80d5f10 0x7f13e80b42b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13e8063e20 tx=0x7f13d402a140 comp rx=0 tx=0).stop 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 -- 172.21.15.52:0/4090640181 shutdown_connections 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 --2- 172.21.15.52:0/4090640181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80d5f10 0x7f13e80b42b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 --2- 172.21.15.52:0/4090640181 >> v2:172.21.15.114:3300/0 conn(0x7f13e80b7130 0x7f13e80b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 -- 172.21.15.52:0/4090640181 >> 172.21.15.52:0/4090640181 conn(0x7f13e808cf50 msgr2=0x7f13e80d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 -- 172.21.15.52:0/4090640181 shutdown_connections 2024-06-02T16:48:17.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.127+0000 7f13ed600640 1 -- 172.21.15.52:0/4090640181 wait complete. 2024-06-02T16:48:17.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.129+0000 7f13ed600640 1 Processor -- start 2024-06-02T16:48:17.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.129+0000 7f13ed600640 1 -- start start 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.130+0000 7f13ed600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 0x7f13e80bab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.130+0000 7f13ed600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 0x7f13e80ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.130+0000 7f13ed600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13e8162ae0 0x7f13e80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.130+0000 7f13ed600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80d0ed0 con 0x7f13e80b7130 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.130+0000 7f13ed600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80b49f0 con 0x7f13e80d5f10 2024-06-02T16:48:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.131+0000 7f13ed600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80d1050 con 0x7f13e8162ae0 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.131+0000 7f13e6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 0x7f13e80ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.131+0000 7f13e6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 0x7f13e80ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:42878/0 (socket says 172.21.15.52:42878) 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.131+0000 7f13e6000640 1 -- 172.21.15.52:0/842674349 learned_addr learned my addr 172.21.15.52:0/842674349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.131+0000 7f13e6a00640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 0x7f13e80bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e7400640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13e8162ae0 0x7f13e80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e6a00640 1 -- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13e8162ae0 msgr2=0x7f13e80cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e6a00640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13e8162ae0 0x7f13e80cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e6a00640 1 -- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 msgr2=0x7f13e80ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e6a00640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 0x7f13e80ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.132+0000 7f13e6a00640 1 -- 172.21.15.52:0/842674349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e81f5830 con 0x7f13e80b7130 2024-06-02T16:48:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13e6a00640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 0x7f13e80bab60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b3f0 tx=0x7f13d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13dea00640 1 -- 172.21.15.52:0/842674349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8015020 con 0x7f13e80b7130 2024-06-02T16:48:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13dea00640 1 -- 172.21.15.52:0/842674349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8011830 con 0x7f13e80b7130 2024-06-02T16:48:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e81f5b10 con 0x7f13e80b7130 2024-06-02T16:48:17.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81f5490 con 0x7f13e80b7130 2024-06-02T16:48:17.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.133+0000 7f13dea00640 1 -- 172.21.15.52:0/842674349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8015020 con 0x7f13e80b7130 2024-06-02T16:48:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.138+0000 7f13dea00640 1 -- 172.21.15.52:0/842674349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13d8018020 con 0x7f13e80b7130 2024-06-02T16:48:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.138+0000 7f13f0365740 1 Processor -- start 2024-06-02T16:48:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.138+0000 7f13f0365740 1 -- start start 2024-06-02T16:48:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aedfe3eb0 0x556aee02a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556aedf553a0 con 0x556aee00e1d0 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556aedf44f40 con 0x556aee02ba70 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x556aedf48f80 con 0x556aedfe3eb0 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.139+0000 7f13dea00640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 0x7f13c8078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13dea00640 1 -- 172.21.15.52:0/842674349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f13d8096ce0 con 0x7f13e80b7130 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38740/0 (socket says 172.21.15.52:38740) 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 -- 172.21.15.52:0/2370251558 learned_addr learned my addr 172.21.15.52:0/2370251558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e6000640 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aedfe3eb0 0x556aee02a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 0x7f13c8078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e6a00640 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 -- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aedfe3eb0 msgr2=0x556aee02a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aedfe3eb0 0x556aee02a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 -- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 msgr2=0x556aee02bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.140+0000 7f13e7400640 1 -- 172.21.15.52:0/2370251558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aedd237d0 con 0x556aee00e1d0 2024-06-02T16:48:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.141+0000 7f13e7400640 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f13e000e960 tx=0x7f13e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530b093fa6ed86a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13d3000640 1 -- 172.21.15.52:0/2370251558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e000e370 con 0x556aee00e1d0 2024-06-02T16:48:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13d3000640 1 -- 172.21.15.52:0/2370251558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e001f070 con 0x556aee00e1d0 2024-06-02T16:48:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13d3000640 1 -- 172.21.15.52:0/2370251558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e001a9f0 con 0x556aee00e1d0 2024-06-02T16:48:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13e7400640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 0x7f13c8078990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f13e001e000 tx=0x7f13e001a000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13f0365740 1 -- 172.21.15.52:0/2370251558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 msgr2=0x556aee00e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.142+0000 7f13f0365740 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f13e000e960 tx=0x7f13e000ee20 comp rx=0 tx=0).stop 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 -- 172.21.15.52:0/2370251558 shutdown_connections 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aedfe3eb0 0x556aee02a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 --2- 172.21.15.52:0/2370251558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aee00e5b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 -- 172.21.15.52:0/2370251558 >> 172.21.15.52:0/2370251558 conn(0x556aedfe07e0 msgr2=0x556aee028fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 -- 172.21.15.52:0/2370251558 shutdown_connections 2024-06-02T16:48:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.143+0000 7f13f0365740 1 -- 172.21.15.52:0/2370251558 wait complete. 2024-06-02T16:48:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.144+0000 7f13f0365740 1 -- start start 2024-06-02T16:48:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.144+0000 7f13f0365740 1 Processor -- start 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.146+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.146+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee02ba70 0x556aee0115f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.146+0000 7f13f0365740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee021920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13f0365740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556aede80950 con 0x556aee011b30 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556aedeecef0 con 0x556aee00e1d0 2024-06-02T16:48:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x556aedfe4c50 con 0x556aee02ba70 2024-06-02T16:48:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13f0365740 10 client.0 _ll_register_callbacks cb 0x556aedeea150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee021920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.147+0000 7f13e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:42882/0 (socket says 172.21.15.52:42882) 2024-06-02T16:48:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e6a00640 1 -- 172.21.15.52:0/1786254694 learned_addr learned my addr 172.21.15.52:0/1786254694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e6000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee02ba70 0x556aee0115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e7400640 1 -- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee02ba70 msgr2=0x556aee0115f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e7400640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee02ba70 0x556aee0115f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e7400640 1 -- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 msgr2=0x556aee009dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e7400640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e7400640 1 -- 172.21.15.52:0/1786254694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aedc593f0 con 0x556aee011b30 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.148+0000 7f13e6a00640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.149+0000 7f13e7400640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee021920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f13e000efd0 tx=0x7f13e00049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa38de9fee600d0d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.149+0000 7f13c7400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:17.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.149+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e000e370 con 0x556aee011b30 2024-06-02T16:48:17.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.149+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f13e002daf0 con 0x556aee011b30 2024-06-02T16:48:17.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.149+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e001f070 con 0x556aee011b30 2024-06-02T16:48:17.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.150+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f13e001aa00 con 0x556aee011b30 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.150+0000 7f13f0365740 10 client.5010 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.150+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556aedc190f0 con 0x556aee011b30 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e001f070 con 0x556aee011b30 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f13e002a070 con 0x556aee011b30 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 10 client.5010 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 10 client.5010 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 20 client.5010 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee03cb40 0x556aee03cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 4 client.5010 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:48:17.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aedecd120 con 0x556aee03cb40 2024-06-02T16:48:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.151+0000 7f13e6a00640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee03cb40 0x556aee03cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.152+0000 7f13c7400640 10 client.5010 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.152+0000 7f13e6a00640 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee03cb40 0x556aee03cf50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b378e3273d31a534 server_cookie=a36509956f1eb8dc in_seq=0 out_seq=0 2024-06-02T16:48:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.153+0000 7f13c7400640 1 -- 172.21.15.52:0/1786254694 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x556aedecd120 con 0x556aee03cb40 2024-06-02T16:48:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.153+0000 7f13c7400640 10 client.5010 handle_command_reply: tid=0 2024-06-02T16:48:17.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.153+0000 7f13f0365740 1 client.5010 shutdown 2024-06-02T16:48:17.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 msgr2=0x556aee021920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee021920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f13e000efd0 tx=0x7f13e00049c0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 shutdown_connections 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee03cb40 0x556aee03cf50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee021920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee02ba70 0x556aee0115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 --2- 172.21.15.52:0/1786254694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee00e1d0 0x556aee009dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 >> 172.21.15.52:0/1786254694 conn(0x556aedfe3eb0 msgr2=0x556aedfe3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.154+0000 7f13c7400640 0 client.5010 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.155+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 shutdown_connections 2024-06-02T16:48:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.155+0000 7f13f0365740 1 -- 172.21.15.52:0/1786254694 wait complete. 2024-06-02T16:48:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.155+0000 7f13f0365740 20 client.5010 trim_cache size 0 max 16384 2024-06-02T16:48:17.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.185+0000 7f13f0365740 1 Processor -- start 2024-06-02T16:48:17.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.185+0000 7f13f0365740 1 -- start start 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee011b30 0x556aee04d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13c000c7d0 con 0x556aee00e1d0 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13c000b7b0 con 0x556aee02ba70 2024-06-02T16:48:17.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.186+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f13c000aa90 con 0x556aee011b30 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38750/0 (socket says 172.21.15.52:38750) 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 -- 172.21.15.52:0/532963895 learned_addr learned my addr 172.21.15.52:0/532963895 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e7400640 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6000640 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee011b30 0x556aee04d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 -- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee011b30 msgr2=0x556aee04d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee011b30 0x556aee04d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 -- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 msgr2=0x556aee02c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.187+0000 7f13e6a00640 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.188+0000 7f13e6a00640 1 -- 172.21.15.52:0/532963895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aee0113b0 con 0x556aee00e1d0 2024-06-02T16:48:17.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.188+0000 7f13e6a00640 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13d805fa00 tx=0x7f13d805fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87075e2fcd55de47 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.188+0000 7f13d2600640 1 -- 172.21.15.52:0/532963895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8068d10 con 0x556aee00e1d0 2024-06-02T16:48:17.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.188+0000 7f13d2600640 1 -- 172.21.15.52:0/532963895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d807e070 con 0x556aee00e1d0 2024-06-02T16:48:17.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.188+0000 7f13d2600640 1 -- 172.21.15.52:0/532963895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d805c1d0 con 0x556aee00e1d0 2024-06-02T16:48:17.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.189+0000 7f13f0365740 1 -- 172.21.15.52:0/532963895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 msgr2=0x556aedfddf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.189+0000 7f13f0365740 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13d805fa00 tx=0x7f13d805fa50 comp rx=0 tx=0).stop 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 -- 172.21.15.52:0/532963895 shutdown_connections 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee011b30 0x556aee04d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 --2- 172.21.15.52:0/532963895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee00e1d0 0x556aedfddf50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 -- 172.21.15.52:0/532963895 >> 172.21.15.52:0/532963895 conn(0x556aedfe3eb0 msgr2=0x556aee022cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 -- 172.21.15.52:0/532963895 shutdown_connections 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.190+0000 7f13f0365740 1 -- 172.21.15.52:0/532963895 wait complete. 2024-06-02T16:48:17.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.191+0000 7f13f0365740 1 -- start start 2024-06-02T16:48:17.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.191+0000 7f13f0365740 1 Processor -- start 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee0a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee00da20 0x556aee0aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13c000b0e0 con 0x556aee011b30 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556aedec5320 con 0x556aee02ba70 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x556aee0a7f10 con 0x556aee00da20 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13f0365740 10 client.0 _ll_register_callbacks cb 0x7f13e000e730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13e6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13e7400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee00da20 0x556aee0aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13e6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:42902/0 (socket says 172.21.15.52:42902) 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13e6000640 1 -- 172.21.15.52:0/190233156 learned_addr learned my addr 172.21.15.52:0/190233156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:17.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.193+0000 7f13e6a00640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee0a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6a00640 1 -- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee00da20 msgr2=0x556aee0aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6a00640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee00da20 0x556aee0aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6a00640 1 -- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 msgr2=0x556aee02c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6a00640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6a00640 1 -- 172.21.15.52:0/190233156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aee0233e0 con 0x556aee011b30 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.194+0000 7f13e6000640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.196+0000 7f13e6a00640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee0a79d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f13d805bfc0 tx=0x7f13d80950e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabbdd8ffcb27e8a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:17.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.196+0000 7f13c7400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.196+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d805f3a0 con 0x556aee011b30 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.196+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f13d805b8b0 con 0x556aee011b30 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.196+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d807e070 con 0x556aee011b30 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.197+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f13d8068d10 con 0x556aee011b30 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.197+0000 7f13f0365740 10 client.5016 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.197+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556aee0a71d0 con 0x556aee011b30 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.197+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d807e070 con 0x556aee011b30 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f13d805bab0 con 0x556aee011b30 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 10 client.5016 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 10 client.5016 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 20 client.5016 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee0aaa80 0x556aee0a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 4 client.5016 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T16:48:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556aedf572f0 con 0x556aee0aaa80 2024-06-02T16:48:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.198+0000 7f13e6000640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee0aaa80 0x556aee0a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.199+0000 7f13e6000640 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee0aaa80 0x556aee0a3f50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc8c5596d094e68 server_cookie=9aed2cf8269493cb in_seq=0 out_seq=0 2024-06-02T16:48:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.199+0000 7f13c7400640 10 client.5016 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13c7400640 1 -- 172.21.15.52:0/190233156 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+274 (crc 0 0 0) 0x556aedf572f0 con 0x556aee0aaa80 2024-06-02T16:48:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13c7400640 10 client.5016 handle_command_reply: tid=0 2024-06-02T16:48:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 client.5016 shutdown 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 msgr2=0x556aee0a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee0a79d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f13d805bfc0 tx=0x7f13d80950e0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 shutdown_connections 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x556aee00da20 0x556aee0aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556aee02ba70 0x556aee02c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x556aee0aaa80 0x556aee0a3f50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 --2- 172.21.15.52:0/190233156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556aee011b30 0x556aee0a79d0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f13d805bfc0 tx=0x7f13d80950e0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 >> 172.21.15.52:0/190233156 conn(0x556aedfe3eb0 msgr2=0x556aedfe51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.200+0000 7f13c7400640 0 client.5016 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.201+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 shutdown_connections 2024-06-02T16:48:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.202+0000 7f13f0365740 1 -- 172.21.15.52:0/190233156 wait complete. 2024-06-02T16:48:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.202+0000 7f13f0365740 20 client.5016 trim_cache size 0 max 16384 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "scrub active (386 inodes in the stack)", 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "1f4dd0c4-b06c-4181-8fba-3952b4dc6a0a": { 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "1f4dd0c4-b06c-4181-8fba-3952b4dc6a0a", 2024-06-02T16:48:17.202 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,scrub_mdsdir" 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.203+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 msgr2=0x7f13c8078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.203+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 0x7f13c8078990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f13e001e000 tx=0x7f13e001a000 comp rx=0 tx=0).stop 2024-06-02T16:48:17.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.203+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 msgr2=0x7f13e80bab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.203+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 0x7f13e80bab60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b3f0 tx=0x7f13d800b8b0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 shutdown_connections 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f13c80764d0 0x7f13c8078990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13e8162ae0 0x7f13e80cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13e80d5f10 0x7f13e80ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 --2- 172.21.15.52:0/842674349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13e80b7130 0x7f13e80bab60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 >> 172.21.15.52:0/842674349 conn(0x7f13e808cf50 msgr2=0x7f13e80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 shutdown_connections 2024-06-02T16:48:17.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:17.204+0000 7f13ed600640 1 -- 172.21.15.52:0/842674349 wait complete. 2024-06-02T16:48:17.225 INFO:tasks.cephfs.filesystem:scrub status for tag:1f4dd0c4-b06c-4181-8fba-3952b4dc6a0a - {'path': '/', 'tag': '1f4dd0c4-b06c-4181-8fba-3952b4dc6a0a', 'options': 'recursive,scrub_mdsdir'} 2024-06-02T16:48:35.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:48:35.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:48:47.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:47.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-06-02T16:48:47.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.443+0000 7f4408400640 1 Processor -- start 2024-06-02T16:48:47.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.444+0000 7f4408400640 1 -- start start 2024-06-02T16:48:47.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4408400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44000b0610 0x7f44000adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4408400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f440015ec80 0x7f44000ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4408400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440009eec0 con 0x7f440015d8b0 2024-06-02T16:48:47.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4408400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f440006ebd0 con 0x7f44000b0610 2024-06-02T16:48:47.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4408400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f440015e490 con 0x7f440015ec80 2024-06-02T16:48:47.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4405a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44000b0610 0x7f44000adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4405a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44000b0610 0x7f44000adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52598/0 (socket says 172.21.15.52:52598) 2024-06-02T16:48:47.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4405a00640 1 -- 172.21.15.52:0/1144037551 learned_addr learned my addr 172.21.15.52:0/1144037551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.446+0000 7f4405000640 1 --2- 172.21.15.52:0/1144037551 >> v2:172.21.15.114:3300/0 conn(0x7f440015ec80 0x7f44000ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.447+0000 7f4405a00640 1 -- 172.21.15.52:0/1144037551 >> v2:172.21.15.114:3300/0 conn(0x7f440015ec80 msgr2=0x7f44000ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.447+0000 7f4405a00640 1 --2- 172.21.15.52:0/1144037551 >> v2:172.21.15.114:3300/0 conn(0x7f440015ec80 0x7f44000ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.447+0000 7f4405a00640 1 -- 172.21.15.52:0/1144037551 >> v1:172.21.15.114:6789/0 conn(0x7f440015d8b0 legacy=0x7f440015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.447+0000 7f4405a00640 1 -- 172.21.15.52:0/1144037551 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440015e770 con 0x7f44000b0610 2024-06-02T16:48:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.448+0000 7f4405a00640 1 --2- 172.21.15.52:0/1144037551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000b0610 0x7f44000adeb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f44000b3c20 tx=0x7f43f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a1561de3b59f28 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.448+0000 7f43ffe00640 1 -- 172.21.15.52:0/1144037551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4037070 con 0x7f44000b0610 2024-06-02T16:48:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.448+0000 7f43ffe00640 1 -- 172.21.15.52:0/1144037551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4032440 con 0x7f44000b0610 2024-06-02T16:48:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.448+0000 7f43ffe00640 1 -- 172.21.15.52:0/1144037551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f402ae60 con 0x7f44000b0610 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 -- 172.21.15.52:0/1144037551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000b0610 msgr2=0x7f44000adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 --2- 172.21.15.52:0/1144037551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000b0610 0x7f44000adeb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f44000b3c20 tx=0x7f43f402a110 comp rx=0 tx=0).stop 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 -- 172.21.15.52:0/1144037551 shutdown_connections 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 --2- 172.21.15.52:0/1144037551 >> v2:172.21.15.114:3300/0 conn(0x7f440015ec80 0x7f44000ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 --2- 172.21.15.52:0/1144037551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44000b0610 0x7f44000adeb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 -- 172.21.15.52:0/1144037551 >> 172.21.15.52:0/1144037551 conn(0x7f44000b3200 msgr2=0x7f44000d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 -- 172.21.15.52:0/1144037551 shutdown_connections 2024-06-02T16:48:47.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.449+0000 7f4408400640 1 -- 172.21.15.52:0/1144037551 wait complete. 2024-06-02T16:48:47.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.451+0000 7f4408400640 1 Processor -- start 2024-06-02T16:48:47.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.451+0000 7f4408400640 1 -- start start 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44000b0610 0x7f44000b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440015ec80 0x7f440009b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44001600e0 con 0x7f440015d8b0 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f440006e860 con 0x7f440015ec80 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4408400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4400160260 con 0x7f44000b0610 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52602/0 (socket says 172.21.15.52:52602) 2024-06-02T16:48:47.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.452+0000 7f4405000640 1 -- 172.21.15.52:0/3170800803 learned_addr learned my addr 172.21.15.52:0/3170800803 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405a00640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44000b0610 0x7f44000b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4406400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440015ec80 0x7f440009b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 -- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44000b0610 msgr2=0x7f44000b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44000b0610 0x7f44000b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 -- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440015ec80 msgr2=0x7f440009b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440015ec80 0x7f440009b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 -- 172.21.15.52:0/3170800803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4400072e20 con 0x7f440015d8b0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f4405000640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00d5f0 tx=0x7f43ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.453+0000 7f43fd600640 1 -- 172.21.15.52:0/3170800803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0125f0 con 0x7f440015d8b0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.454+0000 7f43fd600640 1 -- 172.21.15.52:0/3170800803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec019070 con 0x7f440015d8b0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.454+0000 7f43fd600640 1 -- 172.21.15.52:0/3170800803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0129d0 con 0x7f440015d8b0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.454+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440009c380 con 0x7f440015d8b0 2024-06-02T16:48:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.454+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44000733c0 con 0x7f440015d8b0 2024-06-02T16:48:47.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.456+0000 7f43fd600640 1 -- 172.21.15.52:0/3170800803 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43ec012b70 con 0x7f440015d8b0 2024-06-02T16:48:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.457+0000 7f43fd600640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 0x7f43e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.458+0000 7f43fd600640 1 -- 172.21.15.52:0/3170800803 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f43ec097af0 con 0x7f440015d8b0 2024-06-02T16:48:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.458+0000 7f440b204740 1 Processor -- start 2024-06-02T16:48:47.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.458+0000 7f4405a00640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 0x7f43e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.458+0000 7f440b204740 1 -- start start 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707edd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707eb2eb0 0x55a707ef9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a707e243a0 con 0x55a707efaa70 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a707e13f40 con 0x55a707edd1d0 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55a707e17f80 con 0x55a707eb2eb0 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.459+0000 7f4405a00640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 0x7f43e0078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43f4034000 tx=0x7f43f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52608/0 (socket says 172.21.15.52:52608) 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 -- 172.21.15.52:0/2248130142 learned_addr learned my addr 172.21.15.52:0/2248130142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4406400640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707eb2eb0 0x55a707ef9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405a00640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707edd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 -- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707eb2eb0 msgr2=0x55a707ef9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707eb2eb0 0x55a707ef9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 -- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 msgr2=0x55a707edd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707edd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 -- 172.21.15.52:0/2248130142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a707bf27d0 con 0x55a707efaa70 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405a00640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707edd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.460+0000 7f4405000640 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f43ec05cd10 tx=0x7f43ec060b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2164b2272e4619d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f43f2000640 1 -- 172.21.15.52:0/2248130142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec061390 con 0x55a707efaa70 2024-06-02T16:48:47.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f43f2000640 1 -- 172.21.15.52:0/2248130142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec060c90 con 0x55a707efaa70 2024-06-02T16:48:47.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f43f2000640 1 -- 172.21.15.52:0/2248130142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec065040 con 0x55a707efaa70 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f440b204740 1 -- 172.21.15.52:0/2248130142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 msgr2=0x55a707efafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f440b204740 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f43ec05cd10 tx=0x7f43ec060b90 comp rx=0 tx=0).stop 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.461+0000 7f440b204740 1 -- 172.21.15.52:0/2248130142 shutdown_connections 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707eb2eb0 0x55a707ef9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707efaa70 0x55a707efafc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 --2- 172.21.15.52:0/2248130142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707edd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 -- 172.21.15.52:0/2248130142 >> 172.21.15.52:0/2248130142 conn(0x55a707eaf7e0 msgr2=0x55a707ef7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 -- 172.21.15.52:0/2248130142 shutdown_connections 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 -- 172.21.15.52:0/2248130142 wait complete. 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.462+0000 7f440b204740 1 -- start start 2024-06-02T16:48:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.463+0000 7f440b204740 1 Processor -- start 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707eceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eefaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a707d4f950 con 0x55a707ee0a80 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a707dbbef0 con 0x55a707edd1d0 2024-06-02T16:48:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55a707eb3c50 con 0x55a707efaa70 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f440b204740 10 client.0 _ll_register_callbacks cb 0x55a707db9150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52610/0 (socket says 172.21.15.52:52610) 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 -- 172.21.15.52:0/2036235341 learned_addr learned my addr 172.21.15.52:0/2036235341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4405a00640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707eceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4405000640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eefaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 -- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 msgr2=0x55a707eefaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eefaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 -- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 msgr2=0x55a707eceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.464+0000 7f4406400640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707eceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f4406400640 1 -- 172.21.15.52:0/2036235341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a707b283f0 con 0x55a707ee0a80 2024-06-02T16:48:47.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f4406400640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43f8010540 tx=0x7f43f8010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d8a7d35882cb42 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f43e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003de0 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f43f8015670 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec060c90 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f43f8022050 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f440b204740 10 client.5028 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.465+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a707ae80f0 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec060c90 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f43f8025020 con 0x55a707ee0a80 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 10 client.5028 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 10 client.5028 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 20 client.5028 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707edf240 0x55a707edf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 4 client.5028 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:48:47.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a707d9c120 con 0x55a707edf240 2024-06-02T16:48:47.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.466+0000 7f4405a00640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707edf240 0x55a707edf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.467+0000 7f4405a00640 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707edf240 0x55a707edf650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40b640b4f7cc5aa6 server_cookie=a78a3a5429d0916 in_seq=0 out_seq=0 2024-06-02T16:48:47.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.467+0000 7f43e6a00640 10 client.5028 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f43e6a00640 1 -- 172.21.15.52:0/2036235341 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55a707d9c120 con 0x55a707edf240 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f43e6a00640 10 client.5028 handle_command_reply: tid=0 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 client.5028 shutdown 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 msgr2=0x55a707ef8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43f8010540 tx=0x7f43f8010a00 comp rx=0 tx=0).stop 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 shutdown_connections 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707edf240 0x55a707edf650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707ef8f60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eefaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 --2- 172.21.15.52:0/2036235341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707eceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 >> 172.21.15.52:0/2036235341 conn(0x55a707eb2eb0 msgr2=0x55a707eb23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f43e6a00640 0 client.5028 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 shutdown_connections 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 1 -- 172.21.15.52:0/2036235341 wait complete. 2024-06-02T16:48:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.468+0000 7f440b204740 20 client.5028 trim_cache size 0 max 16384 2024-06-02T16:48:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.488+0000 7f440b204740 1 Processor -- start 2024-06-02T16:48:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.488+0000 7f440b204740 1 -- start start 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707ee0a80 0x55a707eb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eb37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4400201bb0 con 0x55a707edd1d0 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44001f9920 con 0x55a707ee0a80 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.489+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f44001f8c80 con 0x55a707efaa70 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52618/0 (socket says 172.21.15.52:52618) 2024-06-02T16:48:47.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 -- 172.21.15.52:0/789385830 learned_addr learned my addr 172.21.15.52:0/789385830 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 -- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 msgr2=0x55a707eb37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eb37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 -- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707ee0a80 msgr2=0x55a707eb3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707ee0a80 0x55a707eb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 -- 172.21.15.52:0/789385830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a707edfc10 con 0x55a707edd1d0 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.490+0000 7f4405a00640 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009930 tx=0x7f43f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56baacbb985b4042 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f43f1600640 1 -- 172.21.15.52:0/789385830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4037040 con 0x55a707edd1d0 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f43f1600640 1 -- 172.21.15.52:0/789385830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f404b480 con 0x55a707edd1d0 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f43f1600640 1 -- 172.21.15.52:0/789385830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f404b830 con 0x55a707edd1d0 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 -- 172.21.15.52:0/789385830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 msgr2=0x55a707ef7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009930 tx=0x7f43f402c000 comp rx=0 tx=0).stop 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 -- 172.21.15.52:0/789385830 shutdown_connections 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707eb37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707ee0a80 0x55a707eb3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 --2- 172.21.15.52:0/789385830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707edd1d0 0x55a707ef7140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.491+0000 7f440b204740 1 -- 172.21.15.52:0/789385830 >> 172.21.15.52:0/789385830 conn(0x55a707eb2eb0 msgr2=0x55a707ee0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.492+0000 7f440b204740 1 -- 172.21.15.52:0/789385830 shutdown_connections 2024-06-02T16:48:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.492+0000 7f440b204740 1 -- 172.21.15.52:0/789385830 wait complete. 2024-06-02T16:48:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.492+0000 7f440b204740 1 -- start start 2024-06-02T16:48:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.492+0000 7f440b204740 1 Processor -- start 2024-06-02T16:48:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707ede860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707f11a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44001f92d0 con 0x55a707ee0a80 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a707d9c120 con 0x55a707edd1d0 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.493+0000 7f440b204740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55a707eb1810 con 0x55a707efaa70 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f440b204740 10 client.0 _ll_register_callbacks cb 0x7f43f8004e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52634/0 (socket says 172.21.15.52:52634) 2024-06-02T16:48:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 -- 172.21.15.52:0/266516622 learned_addr learned my addr 172.21.15.52:0/266516622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 -- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 msgr2=0x55a707f11a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707f11a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 -- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 msgr2=0x55a707ede860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707ede860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.494+0000 7f4405000640 1 -- 172.21.15.52:0/266516622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a707eda000 con 0x55a707ee0a80 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f4405000640 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43ec05cd10 tx=0x7f43ec095e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e89dc767fd7afa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec06e060 con 0x55a707ee0a80 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f43ec011bc0 con 0x55a707ee0a80 2024-06-02T16:48:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43f404b480 con 0x55a707ee0a80 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f43ec061390 con 0x55a707ee0a80 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 10 client.5034 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a707ef6770 con 0x55a707ee0a80 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f404b480 con 0x55a707ee0a80 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f43ec094050 con 0x55a707ee0a80 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 10 client.5034 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 10 client.5034 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 20 client.5034 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707f11f40 0x55a707eb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 4 client.5034 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.495+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a707e262f0 con 0x55a707f11f40 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.496+0000 7f4405a00640 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707f11f40 0x55a707eb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.496+0000 7f43e6a00640 10 client.5034 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.496+0000 7f4405a00640 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707f11f40 0x55a707eb3290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1ae10e54f0d068 server_cookie=416deaa128d77f40 in_seq=0 out_seq=0 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f43e6a00640 1 -- 172.21.15.52:0/266516622 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a707e262f0 con 0x55a707f11f40 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f43e6a00640 10 client.5034 handle_command_reply: tid=0 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 client.5034 shutdown 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 msgr2=0x55a707eb0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43ec05cd10 tx=0x7f43ec095e30 comp rx=0 tx=0).stop 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 shutdown_connections 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55a707efaa70 0x55a707f11a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x55a707f11f40 0x55a707eb3290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a707ee0a80 0x55a707eb0e00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 --2- 172.21.15.52:0/266516622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a707edd1d0 0x55a707ede860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f43e6a00640 0 client.5034 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 >> 172.21.15.52:0/266516622 conn(0x55a707eb2eb0 msgr2=0x55a707ee0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 shutdown_connections 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 1 -- 172.21.15.52:0/266516622 wait complete. 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.497+0000 7f440b204740 20 client.5034 trim_cache size 0 max 16384 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-06-02T16:48:47.499 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:48:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 msgr2=0x7f43e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 0x7f43e0078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43f4034000 tx=0x7f43f402e000 comp rx=0 tx=0).stop 2024-06-02T16:48:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 msgr2=0x7f44001f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00d5f0 tx=0x7f43ec00dab0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 shutdown_connections 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f43e00762d0 0x7f43e0078790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440015ec80 0x7f440009b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f440015d8b0 0x7f44001f2a10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 --2- 172.21.15.52:0/3170800803 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44000b0610 0x7f44000b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 >> 172.21.15.52:0/3170800803 conn(0x7f44000b3200 msgr2=0x7f44000b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 shutdown_connections 2024-06-02T16:48:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.498+0000 7f4408400640 1 -- 172.21.15.52:0/3170800803 wait complete. 2024-06-02T16:48:47.514 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-02T16:48:47.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-06-02T16:48:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.728+0000 7fda3da00640 1 Processor -- start 2024-06-02T16:48:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.729+0000 7fda3da00640 1 -- start start 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.730+0000 7fda3da00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda380d4cb0 0x7fda380b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.730+0000 7fda3da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda380b7170 0x7fda380b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.730+0000 7fda3da00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380d3940 con 0x7fda3815f530 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.730+0000 7fda3da00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fda3815f910 con 0x7fda380b7170 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.730+0000 7fda3da00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fda380b75e0 con 0x7fda380d4cb0 2024-06-02T16:48:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda3d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda380b7170 0x7fda380b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda37e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fda3815f530 0x7fda380d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46100/0 (socket says 172.21.15.52:46100) 2024-06-02T16:48:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda37e00640 1 -- 172.21.15.52:0/1382694383 learned_addr learned my addr 172.21.15.52:0/1382694383 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda37400640 1 --2- 172.21.15.52:0/1382694383 >> v2:172.21.15.114:3300/0 conn(0x7fda380d4cb0 0x7fda380b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda3d000640 1 -- 172.21.15.52:0/1382694383 >> v2:172.21.15.114:3300/0 conn(0x7fda380d4cb0 msgr2=0x7fda380b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda3d000640 1 --2- 172.21.15.52:0/1382694383 >> v2:172.21.15.114:3300/0 conn(0x7fda380d4cb0 0x7fda380b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda3d000640 1 -- 172.21.15.52:0/1382694383 >> v1:172.21.15.52:6789/0 conn(0x7fda3815f530 legacy=0x7fda380d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda3d000640 1 -- 172.21.15.52:0/1382694383 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380d3c10 con 0x7fda380b7170 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.731+0000 7fda36a00640 1 -- 172.21.15.52:0/1382694383 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879370910 0 0) 0x7fda380d3940 con 0x7fda3815f530 2024-06-02T16:48:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.732+0000 7fda3d000640 1 --2- 172.21.15.52:0/1382694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda380b7170 0x7fda380b82e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1b90 tx=0x7fda3002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cd9a5f716f8c1f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda36a00640 1 -- 172.21.15.52:0/1382694383 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30007740 con 0x7fda380b7170 2024-06-02T16:48:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda36a00640 1 -- 172.21.15.52:0/1382694383 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda300078e0 con 0x7fda380b7170 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda36a00640 1 -- 172.21.15.52:0/1382694383 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30007cb0 con 0x7fda380b7170 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 -- 172.21.15.52:0/1382694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda380b7170 msgr2=0x7fda380b82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 --2- 172.21.15.52:0/1382694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda380b7170 0x7fda380b82e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1b90 tx=0x7fda3002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 -- 172.21.15.52:0/1382694383 shutdown_connections 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 --2- 172.21.15.52:0/1382694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda380b7170 0x7fda380b82e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 --2- 172.21.15.52:0/1382694383 >> v2:172.21.15.114:3300/0 conn(0x7fda380d4cb0 0x7fda380b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 -- 172.21.15.52:0/1382694383 >> 172.21.15.52:0/1382694383 conn(0x7fda380d1c30 msgr2=0x7fda380d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 -- 172.21.15.52:0/1382694383 shutdown_connections 2024-06-02T16:48:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.733+0000 7fda3da00640 1 -- 172.21.15.52:0/1382694383 wait complete. 2024-06-02T16:48:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.735+0000 7fda3da00640 1 Processor -- start 2024-06-02T16:48:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.735+0000 7fda3da00640 1 -- start start 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 0x7fda380cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 0x7fda380ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda380d44b0 con 0x7fda3815f530 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda380d41d0 con 0x7fda380b7170 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.736+0000 7fda3da00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fda380d4790 con 0x7fda380d4cb0 2024-06-02T16:48:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52652/0 (socket says 172.21.15.52:52652) 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 -- 172.21.15.52:0/4216648092 learned_addr learned my addr 172.21.15.52:0/4216648092 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda37e00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 0x7fda380cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda37400640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 0x7fda380ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 -- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 msgr2=0x7fda380ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 0x7fda380ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 -- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 msgr2=0x7fda380cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 0x7fda380cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda3d000640 1 -- 172.21.15.52:0/4216648092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380cba50 con 0x7fda3815f530 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda37e00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 0x7fda380cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.737+0000 7fda37400640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 0x7fda380ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda3d000640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda30009d90 tx=0x7fda30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda2fe00640 1 -- 172.21.15.52:0/4216648092 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30040070 con 0x7fda3815f530 2024-06-02T16:48:47.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda2fe00640 1 -- 172.21.15.52:0/4216648092 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30031c40 con 0x7fda3815f530 2024-06-02T16:48:47.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda2fe00640 1 -- 172.21.15.52:0/4216648092 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30009450 con 0x7fda3815f530 2024-06-02T16:48:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3815abc0 con 0x7fda3815f530 2024-06-02T16:48:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.738+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3815b180 con 0x7fda3815f530 2024-06-02T16:48:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.740+0000 7fda2fe00640 1 -- 172.21.15.52:0/4216648092 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda30039040 con 0x7fda3815f530 2024-06-02T16:48:47.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.742+0000 7fda2fe00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.742+0000 7fda2fe00640 1 -- 172.21.15.52:0/4216648092 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fda300b8590 con 0x7fda3815f530 2024-06-02T16:48:47.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.743+0000 7fda41e4a740 1 Processor -- start 2024-06-02T16:48:47.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.743+0000 7fda37e00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.743+0000 7fda41e4a740 1 -- start start 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55811373f890 0x5581136f2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x558113721d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5581136690b0 con 0x558113722270 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558113658c50 con 0x5581137229b0 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55811365cc90 con 0x55811373f890 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52666/0 (socket says 172.21.15.52:52666) 2024-06-02T16:48:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 -- 172.21.15.52:0/4252028198 learned_addr learned my addr 172.21.15.52:0/4252028198 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda37e00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda28000f60 tx=0x7fda28009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 -- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55811373f890 msgr2=0x5581136f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55811373f890 0x5581136f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 -- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 msgr2=0x558113721d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.744+0000 7fda3d000640 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x558113721d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.745+0000 7fda3d000640 1 -- 172.21.15.52:0/4252028198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581134377d0 con 0x558113722270 2024-06-02T16:48:47.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.745+0000 7fda3d000640 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda300816c0 tx=0x7fda30081300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f25d6e0fde6fa4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.745+0000 7fda2cc00640 1 -- 172.21.15.52:0/4252028198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30049040 con 0x558113722270 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.745+0000 7fda2cc00640 1 -- 172.21.15.52:0/4252028198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30085ae0 con 0x558113722270 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.745+0000 7fda2cc00640 1 -- 172.21.15.52:0/4252028198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300b6e60 con 0x558113722270 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 -- 172.21.15.52:0/4252028198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 msgr2=0x5581136f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda300816c0 tx=0x7fda30081300 comp rx=0 tx=0).stop 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 -- 172.21.15.52:0/4252028198 shutdown_connections 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558113722270 0x5581136f7080 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x558113721d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4252028198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55811373f890 0x5581136f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 -- 172.21.15.52:0/4252028198 >> 172.21.15.52:0/4252028198 conn(0x5581136f4490 msgr2=0x55811373cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 -- 172.21.15.52:0/4252028198 shutdown_connections 2024-06-02T16:48:47.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.746+0000 7fda41e4a740 1 -- 172.21.15.52:0/4252028198 wait complete. 2024-06-02T16:48:47.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.747+0000 7fda41e4a740 1 -- start start 2024-06-02T16:48:47.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.747+0000 7fda41e4a740 1 Processor -- start 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 0x55811370f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137129c0 0x558113723b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55811333e970 con 0x55811373f890 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5581135f7f90 con 0x5581137129c0 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x558113658c50 con 0x5581137229b0 2024-06-02T16:48:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda41e4a740 10 client.0 _ll_register_callbacks cb 0x5581135df3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52678/0 (socket says 172.21.15.52:52678) 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda37400640 1 -- 172.21.15.52:0/521665192 learned_addr learned my addr 172.21.15.52:0/521665192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.748+0000 7fda37e00640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 0x55811370f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda3d000640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137129c0 0x558113723b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 -- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 msgr2=0x55811370f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 0x55811370f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 -- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137129c0 msgr2=0x558113723b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137129c0 0x558113723b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 -- 172.21.15.52:0/521665192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811332d0f0 con 0x55811373f890 2024-06-02T16:48:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37e00640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 0x55811370f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda37400640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fda3806e0d0 tx=0x7fda2000e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b13e3ab6153d92 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda25600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20017030 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fda20004020 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda30085ae0 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda20020050 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda41e4a740 10 client.5049 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.749+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558113497f60 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30085ae0 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda20023020 con 0x55811373f890 2024-06-02T16:48:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 10 client.5049 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 10 client.5049 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 20 client.5049 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x558113724060 0x5581136f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 4 client.5049 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55811366b000 con 0x558113724060 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.750+0000 7fda37e00640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x558113724060 0x5581136f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.751+0000 7fda37e00640 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x558113724060 0x5581136f6e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fe2e4dd52c0b55 server_cookie=9bc6bba0b9780adf in_seq=0 out_seq=0 2024-06-02T16:48:47.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.751+0000 7fda25600640 10 client.5049 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda25600640 1 -- 172.21.15.52:0/521665192 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55811366b000 con 0x558113724060 2024-06-02T16:48:47.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda25600640 10 client.5049 handle_command_reply: tid=0 2024-06-02T16:48:47.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 client.5049 shutdown 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 msgr2=0x558113724af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fda3806e0d0 tx=0x7fda2000e680 comp rx=0 tx=0).stop 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 shutdown_connections 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137129c0 0x558113723b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x558113724060 0x5581136f6e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x558113724af0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 --2- 172.21.15.52:0/521665192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137229b0 0x55811370f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda25600640 0 client.5049 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 >> 172.21.15.52:0/521665192 conn(0x558113722270 msgr2=0x5581136f1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 shutdown_connections 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.752+0000 7fda41e4a740 1 -- 172.21.15.52:0/521665192 wait complete. 2024-06-02T16:48:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.753+0000 7fda41e4a740 20 client.5049 trim_cache size 0 max 16384 2024-06-02T16:48:47.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.771+0000 7fda41e4a740 1 Processor -- start 2024-06-02T16:48:47.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.771+0000 7fda41e4a740 1 -- start start 2024-06-02T16:48:47.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581136f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x55811373bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda38201760 con 0x55811373f890 2024-06-02T16:48:47.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda38200800 con 0x5581137229b0 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fda380ccea0 con 0x5581137129c0 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda3d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52688/0 (socket says 172.21.15.52:52688) 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.772+0000 7fda3d000640 1 -- 172.21.15.52:0/4177847702 learned_addr learned my addr 172.21.15.52:0/4177847702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda37e00640 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581136f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 -- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 msgr2=0x5581136f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581136f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 -- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 msgr2=0x55811373bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda37400640 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x55811373bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x55811373bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 -- 172.21.15.52:0/4177847702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581133061b0 con 0x55811373f890 2024-06-02T16:48:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda3d000640 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda30084040 tx=0x7fda30045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1238d77d5ab3d71f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.773+0000 7fda27e00640 1 -- 172.21.15.52:0/4177847702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30049040 con 0x55811373f890 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda27e00640 1 -- 172.21.15.52:0/4177847702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30085ae0 con 0x55811373f890 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda27e00640 1 -- 172.21.15.52:0/4177847702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30009a30 con 0x55811373f890 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 -- 172.21.15.52:0/4177847702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 msgr2=0x5581137244d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda30084040 tx=0x7fda30045000 comp rx=0 tx=0).stop 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 -- 172.21.15.52:0/4177847702 shutdown_connections 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811373f890 0x5581137244d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5581137229b0 0x55811373bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 --2- 172.21.15.52:0/4177847702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581136f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 -- 172.21.15.52:0/4177847702 >> 172.21.15.52:0/4177847702 conn(0x558113722270 msgr2=0x55811371ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 -- 172.21.15.52:0/4177847702 shutdown_connections 2024-06-02T16:48:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.774+0000 7fda41e4a740 1 -- 172.21.15.52:0/4177847702 wait complete. 2024-06-02T16:48:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.775+0000 7fda41e4a740 1 -- start start 2024-06-02T16:48:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.775+0000 7fda41e4a740 1 Processor -- start 2024-06-02T16:48:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581137ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55811373f890 0x55811371fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5581136690b0 con 0x5581137229b0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda380cd4f0 con 0x55811373f890 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55811374cb60 con 0x5581137129c0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.776+0000 7fda41e4a740 10 client.0 _ll_register_callbacks cb 0x7fda20009120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52698/0 (socket says 172.21.15.52:52698) 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 -- 172.21.15.52:0/3852476027 learned_addr learned my addr 172.21.15.52:0/3852476027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37e00640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581137ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda3d000640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55811373f890 0x55811371fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 -- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 msgr2=0x5581137ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581137ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 -- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55811373f890 msgr2=0x55811371fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55811373f890 0x55811371fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 -- 172.21.15.52:0/3852476027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558113724670 con 0x5581137229b0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda37400640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda20004700 tx=0x7fda20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83891da330087d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.777+0000 7fda25600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20028020 con 0x5581137229b0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fda2001c420 con 0x5581137229b0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda30085ae0 con 0x5581137229b0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda20017070 con 0x5581137229b0 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda41e4a740 10 client.5055 fetch_fsmap learned FSMap version 18 2024-06-02T16:48:47.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55811371e8e0 con 0x5581137229b0 2024-06-02T16:48:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.778+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30085ae0 con 0x5581137229b0 2024-06-02T16:48:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fda20035020 con 0x5581137229b0 2024-06-02T16:48:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 10 client.5055 fetch_fsmap finished waiting for FSMap version 18 2024-06-02T16:48:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 10 client.5055 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 20 client.5055 populate_metadata read hostname 'smithi052' 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x5581136f62c0 0x5581136f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 4 client.5055 mds_command: new command op to 4740 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 --> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5581136647e0 con 0x5581136f62c0 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda37e00640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x5581136f62c0 0x5581136f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda37e00640 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x5581136f62c0 0x5581136f66a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95dd2f640132442c server_cookie=99d3a9a347001d18 in_seq=0 out_seq=0 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.779+0000 7fda25600640 10 client.5055 ms_handle_connect on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda25600640 1 -- 172.21.15.52:0/3852476027 <== mds.0 v2:172.21.15.52:6834/3573924540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18000 (crc 0 0 0) 0x5581136647e0 con 0x5581136f62c0 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda25600640 10 client.5055 handle_command_reply: tid=0 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 client.5055 shutdown 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 msgr2=0x55811371e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda20004700 tx=0x7fda20008040 comp rx=0 tx=0).stop 2024-06-02T16:48:47.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 shutdown_connections 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55811373f890 0x55811371fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:6834/3573924540,v1:172.21.15.52:6835/3573924540] conn(0x5581136f62c0 0x5581136f66a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581137229b0 0x55811371e2a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 --2- 172.21.15.52:0/3852476027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5581137129c0 0x5581137ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda25600640 0 client.5055 ms_handle_reset on v2:172.21.15.52:6834/3573924540 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.780+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 >> 172.21.15.52:0/3852476027 conn(0x558113722270 msgr2=0x5581137212c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 shutdown_connections 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda41e4a740 1 -- 172.21.15.52:0/3852476027 wait complete. 2024-06-02T16:48:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda41e4a740 20 client.5055 trim_cache size 0 max 16384 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3120, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3121, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 790692, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 37734173, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 17, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.686217851, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.375260900, 2024-06-02T16:48:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.118624088, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.148925502, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3119, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.012218421, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000324532 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 10, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000001212, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000121 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T16:48:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 28478, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 50291, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 9930184, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 44170977, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 7, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 8.924045675, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 6.311070627, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 3.134721028, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.292575218, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 50291, 2024-06-02T16:48:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 3.757212170, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000074709 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 45952, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.024474101, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000532 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 134176, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 37088 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3574, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3609, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 1293242, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 33211072, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.701244269, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.332171676, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.142578089, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.176523510, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3608, 2024-06-02T16:48:47.787 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.845951412, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000234465 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 116096 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.788 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3154, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 30.025821381, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.009519918 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3622, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.139890859, 2024-06-02T16:48:47.789 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000590803 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25760, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25760, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25760, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 649.438966922, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.025211140 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-06-02T16:48:47.790 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 17904, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 17904, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 17903, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 2, 2024-06-02T16:48:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 2, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 47134, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46474, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 127, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-06-02T16:48:47.792 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 1852, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 1852, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 13, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 2, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 11, 2024-06-02T16:48:47.793 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 1839, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 546, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4016, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2547, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2017, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 69, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14158 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-06-02T16:48:47.794 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4188, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 3778, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2251, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-06-02T16:48:47.795 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 1, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-06-02T16:48:47.796 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 25732, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 25732, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 36, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 36, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 4, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-06-02T16:48:47.797 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 95750782, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2735, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 140.405537863, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.051336576 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 14, 2024-06-02T16:48:47.798 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2016, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 2002, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 17904, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19905, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 2001, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 2, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 9058, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 9056, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 99244, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.799 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28893, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25760, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 10, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.151679872, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002075839 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 30, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007188896, 2024-06-02T16:48:47.800 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000239629 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 17.042404811, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002840400 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7465, 2024-06-02T16:48:47.801 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 8.659870357, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001160063 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-06-02T16:48:47.802 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000159891, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000159891 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.803 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005096194, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005096194 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.804 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.006186284, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006186284 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000140424, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000140424 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-06-02T16:48:47.805 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.147248928, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.018406116 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2251, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 578.115105828, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.256825902 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.806 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.011340586, 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.011340586 2024-06-02T16:48:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000700548, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000700548 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-06-02T16:48:47.809 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 41.291844303, 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005161480 2024-06-02T16:48:47.810 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-06-02T16:48:47.811 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 14217, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 14217, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 148, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T16:48:47.812 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T16:48:47.813 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T16:48:47.814 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 250849, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 92, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-06-02T16:48:47.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5416, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 77, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 13483141, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 661852, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-06-02T16:48:47.816 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 8771, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 92236575, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 31, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 8771, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8771, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 58.720275281, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006694821 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-06-02T16:48:47.817 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8771, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 8924 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 8771, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 1947, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 6824, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 93, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2826, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 57, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-06-02T16:48:47.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1778, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 2033, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 1854, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-06-02T16:48:47.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-06-02T16:48:47.820 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 37, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 3, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-06-02T16:48:47.821 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 211, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 39 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-06-02T16:48:47.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 3778, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 3778, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-06-02T16:48:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 35168, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 9263297, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 35168, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 35168, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 9263297, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.824 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8771, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 92632377, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8771, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 92632377, 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:47.825 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-06-02T16:48:47.826 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8771, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 8771, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8771, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8771, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:47.827 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 3778, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 395802, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 3778, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 91, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 395802, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:48:47.828 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x55bd2bb5e500": { 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 25732, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 91556478, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 25732, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2735, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 91556478, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-06-02T16:48:47.829 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-06-02T16:48:47.830 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-06-02T16:48:47.830 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.830 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:48:47.830 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:48:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 msgr2=0x7fda14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda28000f60 tx=0x7fda28009040 comp rx=0 tx=0).stop 2024-06-02T16:48:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 msgr2=0x7fda38159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda30009d90 tx=0x7fda30004a40 comp rx=0 tx=0).stop 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 shutdown_connections 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fda140762d0 0x7fda14078790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda3815f530 0x7fda38159e80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda380d4cb0 0x7fda380ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 --2- 172.21.15.52:0/4216648092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda380b7170 0x7fda380cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.781+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 >> 172.21.15.52:0/4216648092 conn(0x7fda380d1c30 msgr2=0x7fda380b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.782+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 shutdown_connections 2024-06-02T16:48:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:47.782+0000 7fda3da00640 1 -- 172.21.15.52:0/4216648092 wait complete. 2024-06-02T16:48:47.833 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T16:48:47.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:48:47.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:48:48.054 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T16:48:48.054 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:48:48.055 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:48:48.055 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:48:48.115 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:48:48.116 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:48:48.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:48:48.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.388+0000 7f26fac00640 1 Processor -- start 2024-06-02T16:48:48.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.389+0000 7f26fac00640 1 -- start start 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.390+0000 7f26fac00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26f415f590 0x7f26f40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.390+0000 7f26fac00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f40b9e90 con 0x7f26f40b77a0 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.390+0000 7f26fac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f40ba170 con 0x7f26f40b92d0 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.390+0000 7f26fac00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f26f40ba450 con 0x7f26f415f590 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f8e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f26f40b77a0 0x7f26f40d3950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46104/0 (socket says 172.21.15.52:46104) 2024-06-02T16:48:48.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f8e00640 1 -- 172.21.15.52:0/4153960999 learned_addr learned my addr 172.21.15.52:0/4153960999 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f9800640 1 --2- 172.21.15.52:0/4153960999 >> v2:172.21.15.52:3300/0 conn(0x7f26f415f590 0x7f26f40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f3e00640 1 -- 172.21.15.52:0/4153960999 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364499039 0 0) 0x7f26f40b9e90 con 0x7f26f40b77a0 2024-06-02T16:48:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f9800640 1 -- 172.21.15.52:0/4153960999 >> v1:172.21.15.114:6789/0 conn(0x7f26f40b92d0 legacy=0x7f26f40d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f9800640 1 -- 172.21.15.52:0/4153960999 >> v1:172.21.15.52:6789/0 conn(0x7f26f40b77a0 legacy=0x7f26f40d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.391+0000 7f26f9800640 1 -- 172.21.15.52:0/4153960999 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f40d3430 con 0x7f26f415f590 2024-06-02T16:48:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.393+0000 7f26f9800640 1 --2- 172.21.15.52:0/4153960999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40b7260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097a0 tx=0x7f26e802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf24e9f68491525 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.393+0000 7f26f3e00640 1 -- 172.21.15.52:0/4153960999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8037070 con 0x7f26f415f590 2024-06-02T16:48:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.393+0000 7f26f3e00640 1 -- 172.21.15.52:0/4153960999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e802ae50 con 0x7f26f415f590 2024-06-02T16:48:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.393+0000 7f26f3e00640 1 -- 172.21.15.52:0/4153960999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8032660 con 0x7f26f415f590 2024-06-02T16:48:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 -- 172.21.15.52:0/4153960999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 msgr2=0x7f26f40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 --2- 172.21.15.52:0/4153960999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40b7260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097a0 tx=0x7f26e802a100 comp rx=0 tx=0).stop 2024-06-02T16:48:48.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 -- 172.21.15.52:0/4153960999 shutdown_connections 2024-06-02T16:48:48.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 --2- 172.21.15.52:0/4153960999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40b7260 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 -- 172.21.15.52:0/4153960999 >> 172.21.15.52:0/4153960999 conn(0x7f26f4073ea0 msgr2=0x7f26f40742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:48.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 -- 172.21.15.52:0/4153960999 shutdown_connections 2024-06-02T16:48:48.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.394+0000 7f26fac00640 1 -- 172.21.15.52:0/4153960999 wait complete. 2024-06-02T16:48:48.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.396+0000 7f26fac00640 1 Processor -- start 2024-06-02T16:48:48.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.396+0000 7f26fac00640 1 -- start start 2024-06-02T16:48:48.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26f40b77a0 0x7f26f41f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 0x7f26f41e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40d48f0 con 0x7f26f415f590 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40d4770 con 0x7f26f40b92d0 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fac00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f26f40d4a70 con 0x7f26f40b77a0 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fa200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.397+0000 7f26fa200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52720/0 (socket says 172.21.15.52:52720) 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 -- 172.21.15.52:0/1649656419 learned_addr learned my addr 172.21.15.52:0/1649656419 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26f9800640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26f40b77a0 0x7f26f41f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26f8e00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 0x7f26f41e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 -- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26f40b77a0 msgr2=0x7f26f41f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26f40b77a0 0x7f26f41f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 -- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 msgr2=0x7f26f41e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 0x7f26f41e9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 -- 172.21.15.52:0/1649656419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f41e9b10 con 0x7f26f415f590 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26f8e00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 0x7f26f41e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.398+0000 7f26fa200640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c780 tx=0x7f26ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:48.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.399+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec004b60 con 0x7f26f415f590 2024-06-02T16:48:48.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.399+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec004d00 con 0x7f26f415f590 2024-06-02T16:48:48.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.399+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00aa90 con 0x7f26f415f590 2024-06-02T16:48:48.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.399+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f41e9df0 con 0x7f26f415f590 2024-06-02T16:48:48.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.399+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f41ea3b0 con 0x7f26f415f590 2024-06-02T16:48:48.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.400+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f40507e0 con 0x7f26f415f590 2024-06-02T16:48:48.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.401+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f26ec00ac30 con 0x7f26f415f590 2024-06-02T16:48:48.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.402+0000 7f26f1600640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 0x7f26d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:48.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.402+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f26ec097940 con 0x7f26f415f590 2024-06-02T16:48:48.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.403+0000 7f26f9800640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 0x7f26d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:48.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.404+0000 7f26f9800640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 0x7f26d4078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26e8034000 tx=0x7f26e802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:48.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.409+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f26ec020070 con 0x7f26f415f590 2024-06-02T16:48:48.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.635+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26f40b51a0 con 0x7f26f415f590 2024-06-02T16:48:48.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.636+0000 7f26f1600640 1 -- 172.21.15.52:0/1649656419 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f26ec0611e0 con 0x7f26f415f590 2024-06-02T16:48:48.634 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 msgr2=0x7f26d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 0x7f26d4078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26e8034000 tx=0x7f26e802e000 comp rx=0 tx=0).stop 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 msgr2=0x7f26f40d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c780 tx=0x7f26ec00cc40 comp rx=0 tx=0).stop 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 shutdown_connections 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f26d40762d0 0x7f26d4078790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f415f590 0x7f26f40d3950 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40b92d0 0x7f26f41e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 --2- 172.21.15.52:0/1649656419 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26f40b77a0 0x7f26f41f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 >> 172.21.15.52:0/1649656419 conn(0x7f26f4073ea0 msgr2=0x7f26f40d4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 shutdown_connections 2024-06-02T16:48:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:48.639+0000 7f26fac00640 1 -- 172.21.15.52:0/1649656419 wait complete. 2024-06-02T16:48:48.658 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-02T16:48:48.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:48.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-02T16:48:48.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:48:48.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:48:48.765 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T16:48:48.828 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:48:48.829 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:48:48.829 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:48:48.869 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:48:48.869 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:48:48.869 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:48:48.869 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:48:48.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:48:48.909 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:48:48.909 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:48:48.909 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:48:48.960 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:48:48.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:48:49.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.165+0000 7f9fba200640 1 Processor -- start 2024-06-02T16:48:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.165+0000 7f9fba200640 1 -- start start 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fba200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 0x7f9fb406e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fba200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fb4163520 0x7f9fb406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fba200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb415fa10 con 0x7f9fb41604d0 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fba200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb4163ab0 con 0x7f9fb4163520 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fba200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb415fcd0 con 0x7f9fb415cce0 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fb9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fb4163520 0x7f9fb406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fb9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fb4163520 0x7f9fb406e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52728/0 (socket says 172.21.15.52:52728) 2024-06-02T16:48:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.167+0000 7f9fb9800640 1 -- 172.21.15.52:0/323899698 learned_addr learned my addr 172.21.15.52:0/323899698 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb8e00640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 0x7f9fb406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb9800640 1 -- 172.21.15.52:0/323899698 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 msgr2=0x7f9fb406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb9800640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 0x7f9fb406e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb9800640 1 -- 172.21.15.52:0/323899698 >> v1:172.21.15.52:6789/0 conn(0x7f9fb41604d0 legacy=0x7f9fb4162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb9800640 1 -- 172.21.15.52:0/323899698 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb415ffb0 con 0x7f9fb4163520 2024-06-02T16:48:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb8e00640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 0x7f9fb406e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:49.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.168+0000 7f9fb3400640 1 -- 172.21.15.52:0/323899698 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723564269 0 0) 0x7f9fb415fa10 con 0x7f9fb41604d0 2024-06-02T16:48:49.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.169+0000 7f9fb9800640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb4163520 0x7f9fb406e670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009e50 tx=0x7f9fac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e7e28793f41ef2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.169+0000 7f9fb3400640 1 -- 172.21.15.52:0/323899698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac036070 con 0x7f9fb4163520 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.169+0000 7f9fb3400640 1 -- 172.21.15.52:0/323899698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac031600 con 0x7f9fb4163520 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.169+0000 7f9fb3400640 1 -- 172.21.15.52:0/323899698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0319d0 con 0x7f9fb4163520 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 -- 172.21.15.52:0/323899698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb4163520 msgr2=0x7f9fb406e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb4163520 0x7f9fb406e670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009e50 tx=0x7f9fac02a730 comp rx=0 tx=0).stop 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 -- 172.21.15.52:0/323899698 shutdown_connections 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb4163520 0x7f9fb406e670 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 --2- 172.21.15.52:0/323899698 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb415cce0 0x7f9fb406e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 -- 172.21.15.52:0/323899698 >> 172.21.15.52:0/323899698 conn(0x7f9fb406c380 msgr2=0x7f9fb406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 -- 172.21.15.52:0/323899698 shutdown_connections 2024-06-02T16:48:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.170+0000 7f9fba200640 1 -- 172.21.15.52:0/323899698 wait complete. 2024-06-02T16:48:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.172+0000 7f9fba200640 1 Processor -- start 2024-06-02T16:48:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.172+0000 7f9fba200640 1 -- start start 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb415cce0 0x7f9fb415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb4163520 0x7f9fb4161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40b5390 con 0x7f9fb41604d0 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40b5210 con 0x7f9fb415cce0 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.173+0000 7f9fba200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb40b5510 con 0x7f9fb4163520 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52730/0 (socket says 172.21.15.52:52730) 2024-06-02T16:48:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 -- 172.21.15.52:0/4102893437 learned_addr learned my addr 172.21.15.52:0/4102893437 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb9800640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb4163520 0x7f9fb4161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb8e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb415cce0 0x7f9fb415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 -- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb4163520 msgr2=0x7f9fb4161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb4163520 0x7f9fb4161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 -- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb415cce0 msgr2=0x7f9fb415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb415cce0 0x7f9fb415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.174+0000 7f9fb3e00640 1 -- 172.21.15.52:0/4102893437 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb415c0e0 con 0x7f9fb41604d0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fb3e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c500 tx=0x7f9fa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0017070 con 0x7f9fb41604d0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa00035f0 con 0x7f9fb41604d0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0003a20 con 0x7f9fb41604d0 2024-06-02T16:48:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb41e9680 con 0x7f9fb41604d0 2024-06-02T16:48:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.175+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb40cda60 con 0x7f9fb41604d0 2024-06-02T16:48:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.176+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4075ea0 con 0x7f9fb41604d0 2024-06-02T16:48:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.177+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9fa001a070 con 0x7f9fb41604d0 2024-06-02T16:48:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.178+0000 7f9fb0c00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 0x7f9f94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.178+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f9fa0096b00 con 0x7f9fb41604d0 2024-06-02T16:48:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.179+0000 7f9fb8e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 0x7f9f94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.180+0000 7f9fb8e00640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 0x7f9f94078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8008850 tx=0x7f9fa8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.183+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9fa0060430 con 0x7f9fb41604d0 2024-06-02T16:48:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.434+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb40af840 con 0x7f9fb41604d0 2024-06-02T16:48:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.435+0000 7f9fb0c00640 1 -- 172.21.15.52:0/4102893437 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f9fa0096e20 con 0x7f9fb41604d0 2024-06-02T16:48:49.434 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:49.434 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:17.897113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:48:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-06-02T16:48:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 msgr2=0x7f9f94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 0x7f9f94078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8008850 tx=0x7f9fa8008040 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 msgr2=0x7f9fb41e8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c500 tx=0x7f9fa000c9c0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 shutdown_connections 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9f940762d0 0x7f9f94078790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9fb4163520 0x7f9fb4161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fb41604d0 0x7f9fb41e8c30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 --2- 172.21.15.52:0/4102893437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb415cce0 0x7f9fb415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 >> 172.21.15.52:0/4102893437 conn(0x7f9fb406c380 msgr2=0x7f9fb415d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:49.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 shutdown_connections 2024-06-02T16:48:49.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.438+0000 7f9fba200640 1 -- 172.21.15.52:0/4102893437 wait complete. 2024-06-02T16:48:49.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:48:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.672+0000 7fadbea00640 1 Processor -- start 2024-06-02T16:48:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.672+0000 7fadbea00640 1 -- start start 2024-06-02T16:48:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.674+0000 7fadbea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadb815cce0 0x7fadb806e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.674+0000 7fadbea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.674+0000 7fadbea00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb815fa10 con 0x7fadb81604d0 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.674+0000 7fadbea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fadb8163ab0 con 0x7fadb815cce0 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.674+0000 7fadbea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fadb815fcd0 con 0x7fadb8163520 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbe000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbd600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadb815cce0 0x7fadb806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbe000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:39896/0 (socket says 172.21.15.52:39896) 2024-06-02T16:48:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbe000640 1 -- 172.21.15.52:0/724172608 learned_addr learned my addr 172.21.15.52:0/724172608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbd600640 1 -- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 msgr2=0x7fadb806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbd600640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbd600640 1 -- 172.21.15.52:0/724172608 >> v1:172.21.15.114:6789/0 conn(0x7fadb81604d0 legacy=0x7fadb8162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbd600640 1 -- 172.21.15.52:0/724172608 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb815ffb0 con 0x7fadb815cce0 2024-06-02T16:48:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.675+0000 7fadbe000640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:48:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.677+0000 7fadbd600640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cce0 0x7fadb806e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fadac0097a0 tx=0x7fadac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5acc1772b278d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.677+0000 7fadb7e00640 1 -- 172.21.15.52:0/724172608 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac037070 con 0x7fadb815cce0 2024-06-02T16:48:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.677+0000 7fadb7e00640 1 -- 172.21.15.52:0/724172608 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac032440 con 0x7fadb815cce0 2024-06-02T16:48:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.677+0000 7fadb7e00640 1 -- 172.21.15.52:0/724172608 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac032810 con 0x7fadb815cce0 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 -- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cce0 msgr2=0x7fadb806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cce0 0x7fadb806e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fadac0097a0 tx=0x7fadac02a180 comp rx=0 tx=0).stop 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 -- 172.21.15.52:0/724172608 shutdown_connections 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb8163520 0x7fadb806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 --2- 172.21.15.52:0/724172608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cce0 0x7fadb806e130 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 -- 172.21.15.52:0/724172608 >> 172.21.15.52:0/724172608 conn(0x7fadb806c380 msgr2=0x7fadb806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 -- 172.21.15.52:0/724172608 shutdown_connections 2024-06-02T16:48:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.678+0000 7fadbea00640 1 -- 172.21.15.52:0/724172608 wait complete. 2024-06-02T16:48:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.680+0000 7fadbea00640 1 Processor -- start 2024-06-02T16:48:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.680+0000 7fadbea00640 1 -- start start 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb815cce0 0x7fadb80d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb81604d0 0x7fadb81428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadb80b5390 con 0x7fadb8163520 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fadb80b5210 con 0x7fadb81604d0 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fadb80b5510 con 0x7fadb815cce0 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbe000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbe000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52738/0 (socket says 172.21.15.52:52738) 2024-06-02T16:48:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbe000640 1 -- 172.21.15.52:0/1239360778 learned_addr learned my addr 172.21.15.52:0/1239360778 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbd600640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb815cce0 0x7fadb80d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.681+0000 7fadbcc00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb81604d0 0x7fadb81428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 -- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb815cce0 msgr2=0x7fadb80d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb815cce0 0x7fadb80d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 -- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb81604d0 msgr2=0x7fadb81428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb81604d0 0x7fadb81428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 -- 172.21.15.52:0/1239360778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb8143200 con 0x7fadb8163520 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbe000640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009e70 tx=0x7fadb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000cbe0 con 0x7fadb8163520 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb000cd80 con 0x7fadb8163520 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb81434e0 con 0x7fadb8163520 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.682+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0003bb0 con 0x7fadb8163520 2024-06-02T16:48:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.683+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb81453e0 con 0x7fadb8163520 2024-06-02T16:48:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.684+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8075ea0 con 0x7fadb8163520 2024-06-02T16:48:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.685+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fadb0005d10 con 0x7fadb8163520 2024-06-02T16:48:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.686+0000 7fadb5600640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 0x7fad98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.686+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fadb0097860 con 0x7fadb8163520 2024-06-02T16:48:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.687+0000 7fadbd600640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 0x7fad98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.688+0000 7fadbd600640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 0x7fad98078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fadac034000 tx=0x7fadac02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.691+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fadb0022020 con 0x7fadb8163520 2024-06-02T16:48:49.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.954+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadb80507e0 con 0x7fadb8163520 2024-06-02T16:48:49.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.955+0000 7fadb5600640 1 -- 172.21.15.52:0/1239360778 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7fadb0010040 con 0x7fadb8163520 2024-06-02T16:48:49.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:49.954 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:17.897113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:48:49.954 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-06-02T16:48:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 msgr2=0x7fad98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 0x7fad98078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fadac034000 tx=0x7fadac02e000 comp rx=0 tx=0).stop 2024-06-02T16:48:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 msgr2=0x7fadb8144cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009e70 tx=0x7fadb000c490 comp rx=0 tx=0).stop 2024-06-02T16:48:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 shutdown_connections 2024-06-02T16:48:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fad980762d0 0x7fad98078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8163520 0x7fadb8144cc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb81604d0 0x7fadb81428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.958+0000 7fadbea00640 1 --2- 172.21.15.52:0/1239360778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadb815cce0 0x7fadb80d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.959+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 >> 172.21.15.52:0/1239360778 conn(0x7fadb806c380 msgr2=0x7fadb80cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.959+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 shutdown_connections 2024-06-02T16:48:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:49.959+0000 7fadbea00640 1 -- 172.21.15.52:0/1239360778 wait complete. 2024-06-02T16:48:50.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:48:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.300+0000 7f75df200640 1 Processor -- start 2024-06-02T16:48:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.300+0000 7f75df200640 1 -- start start 2024-06-02T16:48:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75df200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75e006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75df200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e0160c80 con 0x7f75e0072340 2024-06-02T16:48:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75df200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e0160f60 con 0x7f75e01577f0 2024-06-02T16:48:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75df200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f75e0161240 con 0x7f75e006e130 2024-06-02T16:48:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75de800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75e0072340 0x7f75e00727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46118/0 (socket says 172.21.15.52:46118) 2024-06-02T16:48:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.302+0000 7f75de800640 1 -- 172.21.15.52:0/4011278229 learned_addr learned my addr 172.21.15.52:0/4011278229 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dd400640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75e006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566760155 0 0) 0x7f75e0160c80 con 0x7f75e0072340 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75c4003520 con 0x7f75e0072340 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1364576694 0 0) 0x7f75c4003520 con 0x7f75e0072340 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 msgr2=0x7f75e006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75e006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 >> v1:172.21.15.114:6789/0 conn(0x7f75e01577f0 legacy=0x7f75e0073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e0161520 con 0x7f75e0072340 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f75d8001a70 con 0x7f75e0072340 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 >> v1:172.21.15.52:6789/0 conn(0x7f75e0072340 legacy=0x7f75e00727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75c4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c4004000 0x7f75c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0161240 con 0x7f75c4004d40 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75c400bb50 con 0x7f75c4004000 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.303+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f75c400bd50 con 0x7f75e006e130 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75dde00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75c4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75dd400640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c4004000 0x7f75c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 -- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 msgr2=0x7f75c4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75c4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 -- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c4004000 msgr2=0x7f75c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c4004000 0x7f75c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75de800640 1 -- 172.21.15.52:0/4011278229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4003520 con 0x7f75c4004d40 2024-06-02T16:48:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75dde00640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e006e130 0x7f75c4003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.304+0000 7f75dd400640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c4004000 0x7f75c4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.305+0000 7f75de800640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75c40051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a8b0 tx=0x7f75c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a909ade4d0d0d21 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.305+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d800a4d0 con 0x7f75c4004d40 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.305+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d802f070 con 0x7f75c4004d40 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.305+0000 7f75dca00640 1 -- 172.21.15.52:0/4011278229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d802bc20 con 0x7f75c4004d40 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 -- 172.21.15.52:0/4011278229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 msgr2=0x7f75c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 --2- 172.21.15.52:0/4011278229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75c40051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a8b0 tx=0x7f75c4005830 comp rx=0 tx=0).stop 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75de800640 1 -- 172.21.15.52:0/4011278229 reap_dead start 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 -- 172.21.15.52:0/4011278229 shutdown_connections 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 -- 172.21.15.52:0/4011278229 >> 172.21.15.52:0/4011278229 conn(0x7f75e006c380 msgr2=0x7f75e006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 -- 172.21.15.52:0/4011278229 shutdown_connections 2024-06-02T16:48:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.306+0000 7f75df200640 1 -- 172.21.15.52:0/4011278229 wait complete. 2024-06-02T16:48:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.308+0000 7f75df200640 1 Processor -- start 2024-06-02T16:48:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.308+0000 7f75df200640 1 -- start start 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 0x7f75e0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 0x7f75e013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0074580 con 0x7f75c4004d40 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0161a40 con 0x7f75e01553a0 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75df200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f75e0074180 con 0x7f75e0155d60 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75dde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75dde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52756/0 (socket says 172.21.15.52:52756) 2024-06-02T16:48:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.309+0000 7f75dde00640 1 -- 172.21.15.52:0/2799003232 learned_addr learned my addr 172.21.15.52:0/2799003232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75de800640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 0x7f75e013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dd400640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 0x7f75e0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 -- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 msgr2=0x7f75e013ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 0x7f75e013ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 -- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 msgr2=0x7f75e0155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 0x7f75e0155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 -- 172.21.15.52:0/2799003232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e01545e0 con 0x7f75c4004d40 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75de800640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 0x7f75e013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dd400640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 0x7f75e0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.310+0000 7f75dde00640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75d000d7d0 tx=0x7f75d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.311+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0005270 con 0x7f75c4004d40 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.311+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d0017070 con 0x7f75c4004d40 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.311+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e01548c0 con 0x7f75c4004d40 2024-06-02T16:48:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.311+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d000b6b0 con 0x7f75c4004d40 2024-06-02T16:48:50.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.311+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e0154e80 con 0x7f75c4004d40 2024-06-02T16:48:50.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.312+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e0075ea0 con 0x7f75c4004d40 2024-06-02T16:48:50.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.313+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75d000b850 con 0x7f75c4004d40 2024-06-02T16:48:50.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.314+0000 7f75d6000640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 0x7f75c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.314+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f75d0097560 con 0x7f75c4004d40 2024-06-02T16:48:50.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.315+0000 7f75dd400640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 0x7f75c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.316+0000 7f75dd400640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 0x7f75c0078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75e015f720 tx=0x7f75cc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.319+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75d0060e00 con 0x7f75c4004d40 2024-06-02T16:48:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.527+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75e00507e0 con 0x7f75c4004d40 2024-06-02T16:48:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.529+0000 7f75d6000640 1 -- 172.21.15.52:0/2799003232 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16734 (secure 0 0 0) 0x7f75d0060700 con 0x7f75c4004d40 2024-06-02T16:48:50.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:50.528 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:48:31.585804+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:46:01.311582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-06-02T16:46:02.318550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:48:50.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 msgr2=0x7f75c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 0x7f75c0078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75e015f720 tx=0x7f75cc008040 comp rx=0 tx=0).stop 2024-06-02T16:48:50.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 msgr2=0x7f75e013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75d000d7d0 tx=0x7f75d000dc90 comp rx=0 tx=0).stop 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 shutdown_connections 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f75c00762d0 0x7f75c0078790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75e0155d60 0x7f75e013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e01553a0 0x7f75e0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 --2- 172.21.15.52:0/2799003232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4004d40 0x7f75e013c510 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 >> 172.21.15.52:0/2799003232 conn(0x7f75e006c380 msgr2=0x7f75e0157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.531+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 shutdown_connections 2024-06-02T16:48:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.532+0000 7f75df200640 1 -- 172.21.15.52:0/2799003232 wait complete. 2024-06-02T16:48:50.548 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T16:48:50.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:48:50.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.756+0000 7fa40f200640 1 Processor -- start 2024-06-02T16:48:50.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.756+0000 7fa40f200640 1 -- start start 2024-06-02T16:48:50.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.757+0000 7fa40f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 0x7fa4080b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4080ba430 0x7fa4080ba890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4081607c0 con 0x7fa40815d060 2024-06-02T16:48:50.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa408163c50 con 0x7fa4080ba430 2024-06-02T16:48:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fa408163040 con 0x7fa4080b6c80 2024-06-02T16:48:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4080ba430 0x7fa4080ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa40815d060 0x7fa4080d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46132/0 (socket says 172.21.15.52:46132) 2024-06-02T16:48:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40de00640 1 -- 172.21.15.52:0/2948737380 learned_addr learned my addr 172.21.15.52:0/2948737380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40d400640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 0x7fa4080b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.758+0000 7fa40e800640 1 -- 172.21.15.52:0/2948737380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 msgr2=0x7fa4080b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:50.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.759+0000 7fa40e800640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 0x7fa4080b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.759+0000 7fa40e800640 1 -- 172.21.15.52:0/2948737380 >> v1:172.21.15.52:6789/0 conn(0x7fa40815d060 legacy=0x7fa4080d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.759+0000 7fa40e800640 1 -- 172.21.15.52:0/2948737380 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa408163320 con 0x7fa4080ba430 2024-06-02T16:48:50.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.759+0000 7fa40d400640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 0x7fa4080b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:50.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40e800640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4080ba430 0x7fa4080ba890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa404009d90 tx=0x7fa40402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe05accc551eb14 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40ca00640 1 -- 172.21.15.52:0/2948737380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404007740 con 0x7fa4080ba430 2024-06-02T16:48:50.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40ca00640 1 -- 172.21.15.52:0/2948737380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4040078e0 con 0x7fa4080ba430 2024-06-02T16:48:50.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40ca00640 1 -- 172.21.15.52:0/2948737380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404007cb0 con 0x7fa4080ba430 2024-06-02T16:48:50.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40f200640 1 -- 172.21.15.52:0/2948737380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4080ba430 msgr2=0x7fa4080ba890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.760+0000 7fa40f200640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4080ba430 0x7fa4080ba890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa404009d90 tx=0x7fa40402a660 comp rx=0 tx=0).stop 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 -- 172.21.15.52:0/2948737380 shutdown_connections 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4080ba430 0x7fa4080ba890 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 --2- 172.21.15.52:0/2948737380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080b6c80 0x7fa4080b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 -- 172.21.15.52:0/2948737380 >> 172.21.15.52:0/2948737380 conn(0x7fa4080740e0 msgr2=0x7fa4080d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 -- 172.21.15.52:0/2948737380 shutdown_connections 2024-06-02T16:48:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.761+0000 7fa40f200640 1 -- 172.21.15.52:0/2948737380 wait complete. 2024-06-02T16:48:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.762+0000 7fa40f200640 1 Processor -- start 2024-06-02T16:48:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.763+0000 7fa40f200640 1 -- start start 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.763+0000 7fa40f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080b6c80 0x7fa4081f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.763+0000 7fa40f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 0x7fa4080ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4080d0880 con 0x7fa40815d060 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4081638e0 con 0x7fa4080b6c80 2024-06-02T16:48:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fa4080d0a00 con 0x7fa4080ba430 2024-06-02T16:48:50.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52776/0 (socket says 172.21.15.52:52776) 2024-06-02T16:48:50.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40e800640 1 -- 172.21.15.52:0/1084401123 learned_addr learned my addr 172.21.15.52:0/1084401123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:50.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40d400640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 0x7fa4080ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.764+0000 7fa40de00640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080b6c80 0x7fa4081f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 -- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 msgr2=0x7fa4080ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 0x7fa4080ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 -- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080b6c80 msgr2=0x7fa4081f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080b6c80 0x7fa4081f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 -- 172.21.15.52:0/1084401123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4081f8380 con 0x7fa40815d060 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40d400640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 0x7fa4080ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40e800640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa40402ac50 tx=0x7fa404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404040070 con 0x7fa40815d060 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa404031c90 con 0x7fa40815d060 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404045680 con 0x7fa40815d060 2024-06-02T16:48:50.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4081f8660 con 0x7fa40815d060 2024-06-02T16:48:50.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.765+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4081f8c20 con 0x7fa40815d060 2024-06-02T16:48:50.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.766+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4080507e0 con 0x7fa40815d060 2024-06-02T16:48:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.768+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa404039040 con 0x7fa40815d060 2024-06-02T16:48:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.769+0000 7fa402000640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 0x7fa3ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.769+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fa4040b9090 con 0x7fa40815d060 2024-06-02T16:48:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.770+0000 7fa40de00640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 0x7fa3ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.771+0000 7fa40de00640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 0x7fa3ec078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc000f60 tx=0x7fa3fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:50.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:50.774+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4040829f0 con 0x7fa40815d060 2024-06-02T16:48:51.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.015+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4080008d0 con 0x7fa40815d060 2024-06-02T16:48:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.016+0000 7fa402000640 1 -- 172.21.15.52:0/1084401123 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7fa4040822f0 con 0x7fa40815d060 2024-06-02T16:48:51.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:17.897113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:48:51.015 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-06-02T16:48:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.018+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 msgr2=0x7fa3ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.018+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 0x7fa3ec078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc000f60 tx=0x7fa3fc009040 comp rx=0 tx=0).stop 2024-06-02T16:48:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.018+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 msgr2=0x7fa408161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.018+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa40402ac50 tx=0x7fa404004a40 comp rx=0 tx=0).stop 2024-06-02T16:48:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 shutdown_connections 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fa3ec0762d0 0x7fa3ec078790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40815d060 0x7fa408161260 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080ba430 0x7fa4080ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 --2- 172.21.15.52:0/1084401123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080b6c80 0x7fa4081f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 >> 172.21.15.52:0/1084401123 conn(0x7fa4080740e0 msgr2=0x7fa4080b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 shutdown_connections 2024-06-02T16:48:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.019+0000 7fa40f200640 1 -- 172.21.15.52:0/1084401123 wait complete. 2024-06-02T16:48:51.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:48:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.237+0000 7f6a09000640 1 Processor -- start 2024-06-02T16:48:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.238+0000 7f6a09000640 1 -- start start 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.239+0000 7f6a09000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a0415d2d0 0x7f6a040ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.239+0000 7f6a09000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040ae8e0 con 0x7f6a040d1b60 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.239+0000 7f6a09000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040ae600 con 0x7f6a0406fed0 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.239+0000 7f6a09000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0415d6b0 con 0x7f6a0415d2d0 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a01e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a0415d2d0 0x7f6a040ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a02800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6a040d1b60 0x7f6a040727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46140/0 (socket says 172.21.15.52:46140) 2024-06-02T16:48:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a02800640 1 -- 172.21.15.52:0/1805191702 learned_addr learned my addr 172.21.15.52:0/1805191702 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a01e00640 1 -- 172.21.15.52:0/1805191702 >> v1:172.21.15.114:6789/0 conn(0x7f6a0406fed0 legacy=0x7f6a040d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a01e00640 1 -- 172.21.15.52:0/1805191702 >> v1:172.21.15.52:6789/0 conn(0x7f6a040d1b60 legacy=0x7f6a040727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.240+0000 7f6a01e00640 1 -- 172.21.15.52:0/1805191702 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0406e740 con 0x7f6a0415d2d0 2024-06-02T16:48:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.241+0000 7f6a01e00640 1 --2- 172.21.15.52:0/1805191702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0415d2d0 0x7f6a040ae020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097a0 tx=0x7f69f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecbbfcd8a0df7eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a01400640 1 -- 172.21.15.52:0/1805191702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4037070 con 0x7f6a0415d2d0 2024-06-02T16:48:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a01400640 1 -- 172.21.15.52:0/1805191702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f4032440 con 0x7f6a0415d2d0 2024-06-02T16:48:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a01400640 1 -- 172.21.15.52:0/1805191702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4032810 con 0x7f6a0415d2d0 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 -- 172.21.15.52:0/1805191702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0415d2d0 msgr2=0x7f6a040ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 --2- 172.21.15.52:0/1805191702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0415d2d0 0x7f6a040ae020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097a0 tx=0x7f69f402a180 comp rx=0 tx=0).stop 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 -- 172.21.15.52:0/1805191702 shutdown_connections 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 --2- 172.21.15.52:0/1805191702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0415d2d0 0x7f6a040ae020 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 -- 172.21.15.52:0/1805191702 >> 172.21.15.52:0/1805191702 conn(0x7f6a0406c7a0 msgr2=0x7f6a0406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 -- 172.21.15.52:0/1805191702 shutdown_connections 2024-06-02T16:48:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.242+0000 7f6a09000640 1 -- 172.21.15.52:0/1805191702 wait complete. 2024-06-02T16:48:51.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.244+0000 7f6a09000640 1 Processor -- start 2024-06-02T16:48:51.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.244+0000 7f6a09000640 1 -- start start 2024-06-02T16:48:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a0406fed0 0x7f6a0414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0415d2d0 0x7f6a04150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040741b0 con 0x7f6a040d1b60 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0406ed90 con 0x7f6a0415d2d0 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f6a09000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6a041f1290 con 0x7f6a0406fed0 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f69fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f69fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52802/0 (socket says 172.21.15.52:52802) 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.245+0000 7f69fbe00640 1 -- 172.21.15.52:0/2795705590 learned_addr learned my addr 172.21.15.52:0/2795705590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 -- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a0406fed0 msgr2=0x7f6a0414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f6a01e00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a0406fed0 0x7f6a0414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a0406fed0 0x7f6a0414f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 -- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0415d2d0 msgr2=0x7f6a04150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0415d2d0 0x7f6a04150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 -- 172.21.15.52:0/2795705590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040cfc70 con 0x7f6a040d1b60 2024-06-02T16:48:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fbe00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c460 tx=0x7f69ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.246+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011790 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.247+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec017070 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.247+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011bb0 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.247+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a04151610 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.247+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a04151bd0 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.248+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a04069520 con 0x7f6a040d1b60 2024-06-02T16:48:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.249+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69ec01c460 con 0x7f6a040d1b60 2024-06-02T16:48:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.250+0000 7f69fa000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 0x7f69e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.250+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f69ec0974b0 con 0x7f6a040d1b60 2024-06-02T16:48:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.251+0000 7f6a01e00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 0x7f69e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.252+0000 7f6a01e00640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 0x7f69e0078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.255+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69ec060d50 con 0x7f6a040d1b60 2024-06-02T16:48:51.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.509+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a0415ef00 con 0x7f6a040d1b60 2024-06-02T16:48:51.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.510+0000 7f69fa000640 1 -- 172.21.15.52:0/2795705590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f69ec060650 con 0x7f6a040d1b60 2024-06-02T16:48:51.508 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:51.508 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-06-02T16:46:03.340986+0000","modified":"2024-06-02T16:46:17.897113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4740":{"gid":4740,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3573924540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3573924540},{"type":"v1","addr":"172.21.15.52:6835","nonce":3573924540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4740,"qdb_cluster":[4740]},"id":2}]} 2024-06-02T16:48:51.509 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 msgr2=0x7f69e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 0x7f69e0078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f402e000 comp rx=0 tx=0).stop 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 msgr2=0x7f6a04150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c460 tx=0x7f69ec00c920 comp rx=0 tx=0).stop 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 shutdown_connections 2024-06-02T16:48:51.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69e00762d0 0x7f69e0078790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0415d2d0 0x7f6a04150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a040d1b60 0x7f6a04150aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 --2- 172.21.15.52:0/2795705590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a0406fed0 0x7f6a0414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 >> 172.21.15.52:0/2795705590 conn(0x7f6a0406c7a0 msgr2=0x7f6a04161110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 shutdown_connections 2024-06-02T16:48:51.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.513+0000 7f6a09000640 1 -- 172.21.15.52:0/2795705590 wait complete. 2024-06-02T16:48:51.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:48:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.742+0000 7fbabdc00640 1 Processor -- start 2024-06-02T16:48:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.743+0000 7fbabdc00640 1 -- start start 2024-06-02T16:48:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.744+0000 7fbabdc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbab80d3be0 0x7fbab80d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.744+0000 7fbabdc00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.744+0000 7fbabdc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab80d61b0 con 0x7fbab80d5cb0 2024-06-02T16:48:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.744+0000 7fbabdc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbab80d1330 con 0x7fbab80d3be0 2024-06-02T16:48:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.744+0000 7fbabdc00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbab80d0310 con 0x7fbab80d3fc0 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.745+0000 7fbab7400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.745+0000 7fbab7400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:39970/0 (socket says 172.21.15.52:39970) 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.745+0000 7fbab7400640 1 -- 172.21.15.52:0/3362166873 learned_addr learned my addr 172.21.15.52:0/3362166873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.745+0000 7fbab6a00640 1 --2- 172.21.15.52:0/3362166873 >> v2:172.21.15.114:3300/0 conn(0x7fbab80d3be0 0x7fbab80d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.746+0000 7fbab7400640 1 -- 172.21.15.52:0/3362166873 >> v2:172.21.15.114:3300/0 conn(0x7fbab80d3be0 msgr2=0x7fbab80d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.746+0000 7fbab7400640 1 --2- 172.21.15.52:0/3362166873 >> v2:172.21.15.114:3300/0 conn(0x7fbab80d3be0 0x7fbab80d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.746+0000 7fbab7400640 1 -- 172.21.15.52:0/3362166873 >> v1:172.21.15.114:6789/0 conn(0x7fbab80d5cb0 legacy=0x7fbab806d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.746+0000 7fbab7400640 1 -- 172.21.15.52:0/3362166873 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab80d05f0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.747+0000 7fbab7400640 1 --2- 172.21.15.52:0/3362166873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009e50 tx=0x7fbab002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28779c44678ae61c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbab6000640 1 -- 172.21.15.52:0/3362166873 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0036070 con 0x7fbab80d3fc0 2024-06-02T16:48:51.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbab6000640 1 -- 172.21.15.52:0/3362166873 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab0031600 con 0x7fbab80d3fc0 2024-06-02T16:48:51.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbab6000640 1 -- 172.21.15.52:0/3362166873 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00319d0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 -- 172.21.15.52:0/3362166873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 msgr2=0x7fbab80d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 --2- 172.21.15.52:0/3362166873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009e50 tx=0x7fbab002a680 comp rx=0 tx=0).stop 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 -- 172.21.15.52:0/3362166873 shutdown_connections 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 --2- 172.21.15.52:0/3362166873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3fc0 0x7fbab80d0df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 --2- 172.21.15.52:0/3362166873 >> v2:172.21.15.114:3300/0 conn(0x7fbab80d3be0 0x7fbab80d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.748+0000 7fbabdc00640 1 -- 172.21.15.52:0/3362166873 >> 172.21.15.52:0/3362166873 conn(0x7fbab809e6e0 msgr2=0x7fbab80d5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.749+0000 7fbabdc00640 1 -- 172.21.15.52:0/3362166873 shutdown_connections 2024-06-02T16:48:51.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.749+0000 7fbabdc00640 1 -- 172.21.15.52:0/3362166873 wait complete. 2024-06-02T16:48:51.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.750+0000 7fbabdc00640 1 Processor -- start 2024-06-02T16:48:51.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.751+0000 7fbabdc00640 1 -- start start 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.751+0000 7fbabdc00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3be0 0x7fbab80b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.751+0000 7fbabdc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.751+0000 7fbabdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 0x7fbab8154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbabdc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbab80b4aa0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbabdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbab80cffa0 con 0x7fbab80d5cb0 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbabdc00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbab80b4c20 con 0x7fbab80d3be0 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52806/0 (socket says 172.21.15.52:52806) 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 -- 172.21.15.52:0/2174440000 learned_addr learned my addr 172.21.15.52:0/2174440000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbab6a00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3be0 0x7fbab80b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbab7400640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 0x7fbab8154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 -- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3be0 msgr2=0x7fbab80b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3be0 0x7fbab80b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 -- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 msgr2=0x7fbab8154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 0x7fbab8154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbaafe00640 1 -- 172.21.15.52:0/2174440000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab815e960 con 0x7fbab80d3fc0 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.752+0000 7fbab7400640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 0x7fbab8154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbaafe00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c400 tx=0x7fbaa000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011790 con 0x7fbab80d3fc0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0017070 con 0x7fbab80d3fc0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011bb0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab80b89f0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.753+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab80c9430 con 0x7fbab80d3fc0 2024-06-02T16:48:51.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.754+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab8069520 con 0x7fbab80d3fc0 2024-06-02T16:48:51.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.756+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbaa001c460 con 0x7fbab80d3fc0 2024-06-02T16:48:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.757+0000 7fbaaea00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 0x7fba94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.757+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7fbaa00974d0 con 0x7fbab80d3fc0 2024-06-02T16:48:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.757+0000 7fbab6a00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 0x7fba94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:51.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.758+0000 7fbab6a00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 0x7fba94078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006fd0 tx=0x7fbaa8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:51.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.762+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbab815e960 con 0x7fbab80d3fc0 2024-06-02T16:48:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.972+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbab80d3750 con 0x7fbab80d3fc0 2024-06-02T16:48:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.975+0000 7fbaaea00640 1 -- 172.21.15.52:0/2174440000 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16734 (secure 0 0 0) 0x7fbaa0060e00 con 0x7fbab80d3fc0 2024-06-02T16:48:51.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:51.975 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:48:31.585804+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:46:01.311582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-06-02T16:46:02.318550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.978+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 msgr2=0x7fba94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.978+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 0x7fba94078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006fd0 tx=0x7fbaa8008040 comp rx=0 tx=0).stop 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.978+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 msgr2=0x7fbab80b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.978+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c400 tx=0x7fbaa000c8c0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 shutdown_connections 2024-06-02T16:48:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fba940762d0 0x7fba94078790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbab80d5cb0 0x7fbab8154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80d3fc0 0x7fbab80b84b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 --2- 172.21.15.52:0/2174440000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbab80d3be0 0x7fbab80b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 >> 172.21.15.52:0/2174440000 conn(0x7fbab809e6e0 msgr2=0x7fbab806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 shutdown_connections 2024-06-02T16:48:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:51.979+0000 7fbabdc00640 1 -- 172.21.15.52:0/2174440000 wait complete. 2024-06-02T16:48:51.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T16:48:52.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.208+0000 7f8187e00640 1 Processor -- start 2024-06-02T16:48:52.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.208+0000 7f8187e00640 1 -- start start 2024-06-02T16:48:52.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.209+0000 7f8187e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8188162910 0x7f81880d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81880d5aa0 0x7f81880d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81880d3800 con 0x7f8188162cf0 2024-06-02T16:48:52.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f81880d3ae0 con 0x7f81880d5aa0 2024-06-02T16:48:52.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f81880d3dc0 con 0x7f8188162910 2024-06-02T16:48:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81880d5aa0 0x7f81880d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81880d5aa0 0x7f81880d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52818/0 (socket says 172.21.15.52:52818) 2024-06-02T16:48:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8187400640 1 -- 172.21.15.52:0/4294395898 learned_addr learned my addr 172.21.15.52:0/4294395898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.210+0000 7f8186a00640 1 --2- 172.21.15.52:0/4294395898 >> v2:172.21.15.114:3300/0 conn(0x7f8188162910 0x7f81880d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.211+0000 7f8187400640 1 -- 172.21.15.52:0/4294395898 >> v2:172.21.15.114:3300/0 conn(0x7f8188162910 msgr2=0x7f81880d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.211+0000 7f8187400640 1 --2- 172.21.15.52:0/4294395898 >> v2:172.21.15.114:3300/0 conn(0x7f8188162910 0x7f81880d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.211+0000 7f8187400640 1 -- 172.21.15.52:0/4294395898 >> v1:172.21.15.114:6789/0 conn(0x7f8188162cf0 legacy=0x7f81880b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.211+0000 7f8187400640 1 -- 172.21.15.52:0/4294395898 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880b62b0 con 0x7f81880d5aa0 2024-06-02T16:48:52.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.212+0000 7f8187400640 1 --2- 172.21.15.52:0/4294395898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81880d5aa0 0x7f81880d2090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f818809eaa0 tx=0x7f818002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e21733453dddbd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.212+0000 7f8185600640 1 -- 172.21.15.52:0/4294395898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180036070 con 0x7f81880d5aa0 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.212+0000 7f8185600640 1 -- 172.21.15.52:0/4294395898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180031600 con 0x7f81880d5aa0 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.212+0000 7f8185600640 1 -- 172.21.15.52:0/4294395898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800319d0 con 0x7f81880d5aa0 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 -- 172.21.15.52:0/4294395898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81880d5aa0 msgr2=0x7f81880d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 --2- 172.21.15.52:0/4294395898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81880d5aa0 0x7f81880d2090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f818809eaa0 tx=0x7f818002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 -- 172.21.15.52:0/4294395898 shutdown_connections 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 --2- 172.21.15.52:0/4294395898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81880d5aa0 0x7f81880d2090 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 --2- 172.21.15.52:0/4294395898 >> v2:172.21.15.114:3300/0 conn(0x7f8188162910 0x7f81880d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 -- 172.21.15.52:0/4294395898 >> 172.21.15.52:0/4294395898 conn(0x7f818809e4f0 msgr2=0x7f81880d5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 -- 172.21.15.52:0/4294395898 shutdown_connections 2024-06-02T16:48:52.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.213+0000 7f8187e00640 1 -- 172.21.15.52:0/4294395898 wait complete. 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.215+0000 7f8187e00640 1 Processor -- start 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.215+0000 7f8187e00640 1 -- start start 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f81880d5aa0 0x7f81881f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8188162910 0x7f81881593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81880d0f20 con 0x7f8188162cf0 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f81880d0da0 con 0x7f8188162910 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f81880d10a0 con 0x7f81880d5aa0 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52824/0 (socket says 172.21.15.52:52824) 2024-06-02T16:48:52.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 -- 172.21.15.52:0/159032295 learned_addr learned my addr 172.21.15.52:0/159032295 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8186a00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f81880d5aa0 0x7f81881f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8186000640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8188162910 0x7f81881593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 -- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f81880d5aa0 msgr2=0x7f81881f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f81880d5aa0 0x7f81881f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 -- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8188162910 msgr2=0x7f81881593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8188162910 0x7f81881593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.216+0000 7f8187400640 1 -- 172.21.15.52:0/159032295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880c9b30 con 0x7f8188162cf0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f8187400640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f818002ac90 tx=0x7f8180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180036050 con 0x7f8188162cf0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180042070 con 0x7f8188162cf0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81881f5880 con 0x7f8188162cf0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180009510 con 0x7f8188162cf0 2024-06-02T16:48:52.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.217+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881f5e40 con 0x7f8188162cf0 2024-06-02T16:48:52.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.218+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818808f280 con 0x7f8188162cf0 2024-06-02T16:48:52.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.219+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8180007bd0 con 0x7f8188162cf0 2024-06-02T16:48:52.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.221+0000 7f817ea00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 0x7f8168078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.221+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5737+0+0 (secure 0 0 0) 0x7f81800b8520 con 0x7f8188162cf0 2024-06-02T16:48:52.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.221+0000 7f8186a00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 0x7f8168078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.222+0000 7f8186a00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 0x7f8168078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8178006fd0 tx=0x7f8178008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.225+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8180081dc0 con 0x7f8188162cf0 2024-06-02T16:48:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.480+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8188160ab0 con 0x7f8188162cf0 2024-06-02T16:48:52.480 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-06-02T16:48:52.481+0000 7f30fc200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T16:48:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.485+0000 7f817ea00640 1 -- 172.21.15.52:0/159032295 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f81800816c0 con 0x7f8188162cf0 2024-06-02T16:48:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T16:48:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 msgr2=0x7f8168078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 0x7f8168078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8178006fd0 tx=0x7f8178008040 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 msgr2=0x7f81880c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f818002ac90 tx=0x7f8180004a40 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 shutdown_connections 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f81680762d0 0x7f8168078790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8188162cf0 0x7f81880c95f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8188162910 0x7f81881593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 --2- 172.21.15.52:0/159032295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f81880d5aa0 0x7f81881f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.488+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 >> 172.21.15.52:0/159032295 conn(0x7f818809e4f0 msgr2=0x7f818806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:52.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.489+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 shutdown_connections 2024-06-02T16:48:52.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.490+0000 7f8187e00640 1 -- 172.21.15.52:0/159032295 wait complete. 2024-06-02T16:48:52.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T16:48:52.580 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-06-02T16:48:52.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.704+0000 7f3527e00640 1 Processor -- start 2024-06-02T16:48:52.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.704+0000 7f3527e00640 1 -- start start 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f352806e840 0x7f352815fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3528160320 0x7f35280cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352813f4d0 con 0x7f352813f0f0 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f352815c7b0 con 0x7f3528160320 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f352815ca90 con 0x7f352806e840 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3528160320 0x7f35280cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3528160320 0x7f35280cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52842/0 (socket says 172.21.15.52:52842) 2024-06-02T16:48:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.706+0000 7f3527400640 1 -- 172.21.15.52:0/3890733006 learned_addr learned my addr 172.21.15.52:0/3890733006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.707+0000 7f3527400640 1 -- 172.21.15.52:0/3890733006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f352806e840 msgr2=0x7f352815fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.707+0000 7f351e000640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f352806e840 0x7f352815fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.707+0000 7f3527400640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f352806e840 0x7f352815fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.707+0000 7f3527400640 1 -- 172.21.15.52:0/3890733006 >> v1:172.21.15.114:6789/0 conn(0x7f352813f0f0 legacy=0x7f352806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.707+0000 7f3527400640 1 -- 172.21.15.52:0/3890733006 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352815cd70 con 0x7f3528160320 2024-06-02T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.708+0000 7f3527400640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3528160320 0x7f35280cf9d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa34eae5e7836b45 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.708+0000 7f3526000640 1 -- 172.21.15.52:0/3890733006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520037070 con 0x7f3528160320 2024-06-02T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.708+0000 7f3526000640 1 -- 172.21.15.52:0/3890733006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520032440 con 0x7f3528160320 2024-06-02T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.708+0000 7f3526000640 1 -- 172.21.15.52:0/3890733006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520032810 con 0x7f3528160320 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 -- 172.21.15.52:0/3890733006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3528160320 msgr2=0x7f35280cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3528160320 0x7f35280cf9d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002a270 comp rx=0 tx=0).stop 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 -- 172.21.15.52:0/3890733006 shutdown_connections 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3528160320 0x7f35280cf9d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 --2- 172.21.15.52:0/3890733006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f352806e840 0x7f352815fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 -- 172.21.15.52:0/3890733006 >> 172.21.15.52:0/3890733006 conn(0x7f352806fca0 msgr2=0x7f352806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 -- 172.21.15.52:0/3890733006 shutdown_connections 2024-06-02T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.709+0000 7f3527e00640 1 -- 172.21.15.52:0/3890733006 wait complete. 2024-06-02T16:48:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.711+0000 7f3527e00640 1 Processor -- start 2024-06-02T16:48:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.711+0000 7f3527e00640 1 -- start start 2024-06-02T16:48:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806e840 0x7f35281f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3528160320 0x7f35281f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f352815d570 con 0x7f352813f0f0 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3528160b30 con 0x7f352806e840 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f3527e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f35281607d0 con 0x7f3528160320 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f351e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f351e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52858/0 (socket says 172.21.15.52:52858) 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.712+0000 7f351e000640 1 -- 172.21.15.52:0/1087091192 learned_addr learned my addr 172.21.15.52:0/1087091192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f3526a00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806e840 0x7f35281f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 -- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3528160320 msgr2=0x7f35281f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f3527400640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3528160320 0x7f35281f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3528160320 0x7f35281f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 -- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806e840 msgr2=0x7f35281f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806e840 0x7f35281f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 -- 172.21.15.52:0/1087091192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35281f5bc0 con 0x7f352813f0f0 2024-06-02T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.713+0000 7f351e000640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f351000c7f0 tx=0x7f351000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.714+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510015070 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.714+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510004240 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.714+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35281f5ea0 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.714+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510007620 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.714+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35281f8be0 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.715+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35280507e0 con 0x7f352813f0f0 2024-06-02T16:48:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.716+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35100079d0 con 0x7f352813f0f0 2024-06-02T16:48:52.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.717+0000 7f351f400640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 0x7f3504078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:52.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.717+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5795+0+0 (secure 0 0 0) 0x7f3510097b20 con 0x7f352813f0f0 2024-06-02T16:48:52.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.718+0000 7f3526a00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 0x7f3504078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:52.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.719+0000 7f3526a00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 0x7f3504078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3518001d80 tx=0x7f3518009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:52.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.722+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3510061380 con 0x7f352813f0f0 2024-06-02T16:48:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:52.973+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f352806f140 con 0x7f352813f0f0 2024-06-02T16:48:53.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.488+0000 7f351f400640 1 -- 172.21.15.52:0/1087091192 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f3510060c80 con 0x7f352813f0f0 2024-06-02T16:48:53.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 msgr2=0x7f3504078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:53.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 0x7f3504078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3518001d80 tx=0x7f3518009040 comp rx=0 tx=0).stop 2024-06-02T16:48:53.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 msgr2=0x7f35280b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:53.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f351000c7f0 tx=0x7f351000ccb0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 shutdown_connections 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f35040762d0 0x7f3504078790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3528160320 0x7f35281f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352813f0f0 0x7f35280b5770 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 --2- 172.21.15.52:0/1087091192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806e840 0x7f35281f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.493+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 >> 172.21.15.52:0/1087091192 conn(0x7f352806fca0 msgr2=0x7f35280cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.494+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 shutdown_connections 2024-06-02T16:48:53.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.494+0000 7f3527e00640 1 -- 172.21.15.52:0/1087091192 wait complete. 2024-06-02T16:48:53.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T16:48:53.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.739+0000 7f8370c00640 1 Processor -- start 2024-06-02T16:48:53.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.739+0000 7f8370c00640 1 -- start start 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f8370c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f836c0afce0 0x7f836c073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f8370c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836c15e150 0x7f836c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f8370c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836c074650 con 0x7f836c0adeb0 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f8370c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f836c0ae400 con 0x7f836c15e150 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f8370c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f836c072990 con 0x7f836c0afce0 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.741+0000 7f836be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836c15e150 0x7f836c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836c15e150 0x7f836c06e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56042/0 (socket says 172.21.15.52:56042) 2024-06-02T16:48:53.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 -- 172.21.15.52:0/3513872149 learned_addr learned my addr 172.21.15.52:0/3513872149 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:53.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 -- 172.21.15.52:0/3513872149 >> v2:172.21.15.114:3300/0 conn(0x7f836c0afce0 msgr2=0x7f836c073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:53.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 --2- 172.21.15.52:0/3513872149 >> v2:172.21.15.114:3300/0 conn(0x7f836c0afce0 0x7f836c073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 -- 172.21.15.52:0/3513872149 >> v1:172.21.15.114:6789/0 conn(0x7f836c0adeb0 legacy=0x7f836c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:53.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.742+0000 7f836be00640 1 -- 172.21.15.52:0/3513872149 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c072c70 con 0x7f836c15e150 2024-06-02T16:48:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.743+0000 7f836be00640 1 --2- 172.21.15.52:0/3513872149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c15e150 0x7f836c06e350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f836c0d1e90 tx=0x7f836402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3710a79970be876 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.743+0000 7f836aa00640 1 -- 172.21.15.52:0/3513872149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364036070 con 0x7f836c15e150 2024-06-02T16:48:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f836aa00640 1 -- 172.21.15.52:0/3513872149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364031600 con 0x7f836c15e150 2024-06-02T16:48:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f836aa00640 1 -- 172.21.15.52:0/3513872149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640319d0 con 0x7f836c15e150 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 -- 172.21.15.52:0/3513872149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c15e150 msgr2=0x7f836c06e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 --2- 172.21.15.52:0/3513872149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c15e150 0x7f836c06e350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f836c0d1e90 tx=0x7f836402a610 comp rx=0 tx=0).stop 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 -- 172.21.15.52:0/3513872149 shutdown_connections 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 --2- 172.21.15.52:0/3513872149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c15e150 0x7f836c06e350 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 --2- 172.21.15.52:0/3513872149 >> v2:172.21.15.114:3300/0 conn(0x7f836c0afce0 0x7f836c073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 -- 172.21.15.52:0/3513872149 >> 172.21.15.52:0/3513872149 conn(0x7f836c0b2bd0 msgr2=0x7f836c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.744+0000 7f8370c00640 1 -- 172.21.15.52:0/3513872149 shutdown_connections 2024-06-02T16:48:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.745+0000 7f8370c00640 1 -- 172.21.15.52:0/3513872149 wait complete. 2024-06-02T16:48:53.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.746+0000 7f8370c00640 1 Processor -- start 2024-06-02T16:48:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.746+0000 7f8370c00640 1 -- start start 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f836c0adeb0 0x7f836c1f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 0x7f836c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f836c15e580 con 0x7f836c0afce0 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f836c0ae6e0 con 0x7f836c15e150 2024-06-02T16:48:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.747+0000 7f8370c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f836c15d3c0 con 0x7f836c0adeb0 2024-06-02T16:48:53.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56044/0 (socket says 172.21.15.52:56044) 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 -- 172.21.15.52:0/3691147076 learned_addr learned my addr 172.21.15.52:0/3691147076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f836be00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 0x7f836c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f836b400640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f836c0adeb0 0x7f836c1f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 -- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f836c0adeb0 msgr2=0x7f836c1f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f836c0adeb0 0x7f836c1f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 -- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 msgr2=0x7f836c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 0x7f836c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f8363e00640 1 -- 172.21.15.52:0/3691147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c0c6190 con 0x7f836c0afce0 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.748+0000 7f836be00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 0x7f836c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:48:53.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8363e00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f835400c410 tx=0x7f835400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354017070 con 0x7f836c0afce0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83540035f0 con 0x7f836c0afce0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354003a20 con 0x7f836c0afce0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c09ba00 con 0x7f836c0afce0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.749+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c09bfc0 con 0x7f836c0afce0 2024-06-02T16:48:53.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.751+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c0507e0 con 0x7f836c0afce0 2024-06-02T16:48:53.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.752+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8354003bc0 con 0x7f836c0afce0 2024-06-02T16:48:53.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.753+0000 7f8363400640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 0x7f8348078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:53.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.753+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5795+0+0 (secure 0 0 0) 0x7f8354096a00 con 0x7f836c0afce0 2024-06-02T16:48:53.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.754+0000 7f836b400640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 0x7f8348078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.755+0000 7f836b400640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 0x7f8348078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f835c009890 tx=0x7f835c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:53.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.758+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8354060260 con 0x7f836c0afce0 2024-06-02T16:48:53.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:53.972+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f836c15a090 con 0x7f836c0afce0 2024-06-02T16:48:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.708+0000 7f8363400640 1 -- 172.21.15.52:0/3691147076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7f835405fb60 con 0x7f836c0afce0 2024-06-02T16:48:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-06-02T16:48:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.711+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 msgr2=0x7f8348078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.711+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 0x7f8348078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f835c009890 tx=0x7f835c008040 comp rx=0 tx=0).stop 2024-06-02T16:48:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.711+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 msgr2=0x7f836c149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.711+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f835400c410 tx=0x7f835400c8d0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 shutdown_connections 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f83480762d0 0x7f8348078790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f836c15e150 0x7f836c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836c0afce0 0x7f836c149a90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 --2- 172.21.15.52:0/3691147076 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f836c0adeb0 0x7f836c1f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.712+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 >> 172.21.15.52:0/3691147076 conn(0x7f836c0b2bd0 msgr2=0x7f836c073470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.713+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 shutdown_connections 2024-06-02T16:48:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.713+0000 7f8370c00640 1 -- 172.21.15.52:0/3691147076 wait complete. 2024-06-02T16:48:54.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T16:48:54.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.953+0000 7f01a7e00640 1 Processor -- start 2024-06-02T16:48:54.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.954+0000 7f01a7e00640 1 -- start start 2024-06-02T16:48:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.955+0000 7f01a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01a806f950 0x7f01a80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.955+0000 7f01a7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01a8072aa0 0x7f01a806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.955+0000 7f01a7e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a80b54b0 con 0x7f01a80b58b0 2024-06-02T16:48:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f01a80b3ed0 con 0x7f01a806f950 2024-06-02T16:48:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f01a80b41b0 con 0x7f01a8072aa0 2024-06-02T16:48:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01a806f950 0x7f01a80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f019fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f01a80b58b0 0x7f01a8072390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49486/0 (socket says 172.21.15.52:49486) 2024-06-02T16:48:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f019fe00640 1 -- 172.21.15.52:0/4148988306 learned_addr learned my addr 172.21.15.52:0/4148988306 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a7400640 1 --2- 172.21.15.52:0/4148988306 >> v2:172.21.15.114:3300/0 conn(0x7f01a8072aa0 0x7f01a806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a6a00640 1 -- 172.21.15.52:0/4148988306 >> v2:172.21.15.114:3300/0 conn(0x7f01a8072aa0 msgr2=0x7f01a806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:54.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a6a00640 1 --2- 172.21.15.52:0/4148988306 >> v2:172.21.15.114:3300/0 conn(0x7f01a8072aa0 0x7f01a806e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a6a00640 1 -- 172.21.15.52:0/4148988306 >> v1:172.21.15.52:6789/0 conn(0x7f01a80b58b0 legacy=0x7f01a8072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.956+0000 7f01a6a00640 1 -- 172.21.15.52:0/4148988306 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80b4490 con 0x7f01a806f950 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.957+0000 7f01a6a00640 1 --2- 172.21.15.52:0/4148988306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a80b4f70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f01a80d0900 tx=0x7f019802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f1b1645ba522b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.958+0000 7f01a6000640 1 -- 172.21.15.52:0/4148988306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198037070 con 0x7f01a806f950 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.958+0000 7f01a6000640 1 -- 172.21.15.52:0/4148988306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198032440 con 0x7f01a806f950 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.958+0000 7f01a6000640 1 -- 172.21.15.52:0/4148988306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198032810 con 0x7f01a806f950 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.958+0000 7f01a7e00640 1 -- 172.21.15.52:0/4148988306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 msgr2=0x7f01a80b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.958+0000 7f01a7e00640 1 --2- 172.21.15.52:0/4148988306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a80b4f70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f01a80d0900 tx=0x7f019802a1a0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 -- 172.21.15.52:0/4148988306 shutdown_connections 2024-06-02T16:48:54.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 --2- 172.21.15.52:0/4148988306 >> v2:172.21.15.114:3300/0 conn(0x7f01a8072aa0 0x7f01a806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 --2- 172.21.15.52:0/4148988306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a80b4f70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 -- 172.21.15.52:0/4148988306 >> 172.21.15.52:0/4148988306 conn(0x7f01a80b2bd0 msgr2=0x7f01a80b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:54.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 -- 172.21.15.52:0/4148988306 shutdown_connections 2024-06-02T16:48:54.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.959+0000 7f01a7e00640 1 -- 172.21.15.52:0/4148988306 wait complete. 2024-06-02T16:48:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.960+0000 7f01a7e00640 1 Processor -- start 2024-06-02T16:48:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.960+0000 7f01a7e00640 1 -- start start 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a8072aa0 0x7f01a80b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 0x7f01a81fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01a806fd30 con 0x7f01a806f950 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80b4a50 con 0x7f01a80b58b0 2024-06-02T16:48:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.961+0000 7f01a7e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f01a81fd590 con 0x7f01a8072aa0 2024-06-02T16:48:54.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56058/0 (socket says 172.21.15.52:56058) 2024-06-02T16:48:54.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 -- 172.21.15.52:0/1537885674 learned_addr learned my addr 172.21.15.52:0/1537885674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a7400640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 0x7f01a81fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f019fe00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a8072aa0 0x7f01a80b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 -- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a8072aa0 msgr2=0x7f01a80b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a8072aa0 0x7f01a80b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 -- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 msgr2=0x7f01a81fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 0x7f01a81fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a6a00640 1 -- 172.21.15.52:0/1537885674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a81fd870 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.962+0000 7f01a7400640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 0x7f01a81fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f01a6a00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0198009890 tx=0x7f01980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198037040 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198042070 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198030a50 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a8156570 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.963+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a814efb0 con 0x7f01a806f950 2024-06-02T16:48:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.965+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a81fda40 con 0x7f01a806f950 2024-06-02T16:48:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.966+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0198030bf0 con 0x7f01a806f950 2024-06-02T16:48:54.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.967+0000 7f019ea00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 0x7f0184078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:54.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.967+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5357+0+0 (secure 0 0 0) 0x7f01980b7fc0 con 0x7f01a806f950 2024-06-02T16:48:54.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.968+0000 7f019fe00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 0x7f0184078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:54.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.969+0000 7f019fe00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 0x7f0184078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b2780 tx=0x7f0190009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:54.972+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f01a81fda40 con 0x7f01a806f950 2024-06-02T16:48:55.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.182+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01a80507e0 con 0x7f01a806f950 2024-06-02T16:48:55.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.720+0000 7f019ea00640 1 -- 172.21.15.52:0/1537885674 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7f01980819e0 con 0x7f01a806f950 2024-06-02T16:48:55.719 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-06-02T16:48:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 msgr2=0x7f0184078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 0x7f0184078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b2780 tx=0x7f0190009040 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 msgr2=0x7f01a8153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0198009890 tx=0x7f01980046c0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 shutdown_connections 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f01840762d0 0x7f0184078790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a80b58b0 0x7f01a81fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a8072aa0 0x7f01a80b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 --2- 172.21.15.52:0/1537885674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a806f950 0x7f01a8153d50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 >> 172.21.15.52:0/1537885674 conn(0x7f01a80b2bd0 msgr2=0x7f01a8160860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 shutdown_connections 2024-06-02T16:48:55.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.724+0000 7f01a7e00640 1 -- 172.21.15.52:0/1537885674 wait complete. 2024-06-02T16:48:55.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-02T16:48:55.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.953+0000 7f99f4800640 1 Processor -- start 2024-06-02T16:48:55.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.953+0000 7f99f4800640 1 -- start start 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f4800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99ec15d8a0 0x7f99ec15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f4800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99ec15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f4800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ec160c10 con 0x7f99ec0adf20 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f4800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f99ec072540 con 0x7f99ec15d8a0 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f4800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec072b00 con 0x7f99ec15a500 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f1e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99ec0adf20 0x7f99ec0ae300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49490/0 (socket says 172.21.15.52:49490) 2024-06-02T16:48:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.955+0000 7f99f1e00640 1 -- 172.21.15.52:0/1660133175 learned_addr learned my addr 172.21.15.52:0/1660133175 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f2800640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99ec15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f1400640 1 --2- 172.21.15.52:0/1660133175 >> v2:172.21.15.114:3300/0 conn(0x7f99ec15d8a0 0x7f99ec15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001622097 0 0) 0x7f99ec160c10 con 0x7f99ec0adf20 2024-06-02T16:48:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99d8003520 con 0x7f99ec0adf20 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1820441249 0 0) 0x7f99d8003520 con 0x7f99ec0adf20 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 msgr2=0x7f99ec15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99ec15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 >> v2:172.21.15.114:3300/0 conn(0x7f99ec15d8a0 msgr2=0x7f99ec15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 --2- 172.21.15.52:0/1660133175 >> v2:172.21.15.114:3300/0 conn(0x7f99ec15d8a0 0x7f99ec15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec15e370 con 0x7f99ec0adf20 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f99e4001a70 con 0x7f99ec0adf20 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 >> v1:172.21.15.52:6789/0 conn(0x7f99ec0adf20 legacy=0x7f99ec0ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.956+0000 7f99f0a00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99d8003a50 0x7f99d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f0a00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8004800 0x7f99d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f0a00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec072540 con 0x7f99d8003a50 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec072b00 con 0x7f99d8004800 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f99d800ba40 con 0x7f99ec15a500 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99d8003a50 0x7f99d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1400640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8004800 0x7f99d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f2800640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 -- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 msgr2=0x7f99d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 -- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8004800 msgr2=0x7f99d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8004800 0x7f99d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.957+0000 7f99f1e00640 1 -- 172.21.15.52:0/1660133175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8003520 con 0x7f99d8003a50 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.958+0000 7f99f2800640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec15a500 0x7f99d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f1e00640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99d8003a50 0x7f99d8003e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f99e400a800 tx=0x7f99d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb7400652bc96f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e400a450 con 0x7f99d8003a50 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e402f070 con 0x7f99d8003a50 2024-06-02T16:48:55.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f0a00640 1 -- 172.21.15.52:0/1660133175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e402bbc0 con 0x7f99d8003a50 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f4800640 1 -- 172.21.15.52:0/1660133175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99d8003a50 msgr2=0x7f99d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f4800640 1 --2- 172.21.15.52:0/1660133175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99d8003a50 0x7f99d8003e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f99e400a800 tx=0x7f99d8005830 comp rx=0 tx=0).stop 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.959+0000 7f99f2800640 1 -- 172.21.15.52:0/1660133175 reap_dead start 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.960+0000 7f99f4800640 1 -- 172.21.15.52:0/1660133175 shutdown_connections 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.960+0000 7f99f4800640 1 -- 172.21.15.52:0/1660133175 >> 172.21.15.52:0/1660133175 conn(0x7f99ec0b32a0 msgr2=0x7f99ec0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.960+0000 7f99f4800640 1 -- 172.21.15.52:0/1660133175 shutdown_connections 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.960+0000 7f99f4800640 1 -- 172.21.15.52:0/1660133175 wait complete. 2024-06-02T16:48:55.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.961+0000 7f99f4800640 1 Processor -- start 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.962+0000 7f99f4800640 1 -- start start 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 0x7f99ec1f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 0x7f99ec0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec09ee20 con 0x7f99ec15c080 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec072790 con 0x7f99d8003a50 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f4800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec15ec50 con 0x7f99ec0cf280 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56082/0 (socket says 172.21.15.52:56082) 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 -- 172.21.15.52:0/977253640 learned_addr learned my addr 172.21.15.52:0/977253640 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f2800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 0x7f99ec0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1e00640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 0x7f99ec1f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 -- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 msgr2=0x7f99ec0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 0x7f99ec0cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 -- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 msgr2=0x7f99ec1f8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 0x7f99ec1f8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1400640 1 -- 172.21.15.52:0/977253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec0ce4e0 con 0x7f99ec15c080 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f2800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 0x7f99ec0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.963+0000 7f99f1e00640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 0x7f99ec1f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99f1400640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0115d0 tx=0x7f99dc011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc015870 con 0x7f99ec15c080 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc015a10 con 0x7f99ec15c080 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc015e00 con 0x7f99ec15c080 2024-06-02T16:48:55.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec15cb00 con 0x7f99ec15c080 2024-06-02T16:48:55.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.964+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec0cea80 con 0x7f99ec15c080 2024-06-02T16:48:55.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.965+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec069520 con 0x7f99ec15c080 2024-06-02T16:48:55.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.967+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99dc00f480 con 0x7f99ec15c080 2024-06-02T16:48:55.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.968+0000 7f99e2000640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 0x7f99d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:55.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.968+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f99dc097a90 con 0x7f99ec15c080 2024-06-02T16:48:55.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.968+0000 7f99f1e00640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 0x7f99d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:55.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.970+0000 7f99f1e00640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 0x7f99d0078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99e400a800 tx=0x7f99e4007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:55.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:55.972+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99dc019030 con 0x7f99ec15c080 2024-06-02T16:48:56.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.198+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f99ec0d1d00 con 0x7f99ec15c080 2024-06-02T16:48:56.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.206+0000 7f99e2000640 1 -- 172.21.15.52:0/977253640 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f99dc061780 con 0x7f99ec15c080 2024-06-02T16:48:56.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.208+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 msgr2=0x7f99d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.208+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 0x7f99d0078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99e400a800 tx=0x7f99e4007000 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 msgr2=0x7f99ec15c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0115d0 tx=0x7f99dc011a90 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 shutdown_connections 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f99d00762d0 0x7f99d0078790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99ec0cf280 0x7f99ec0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99ec15c080 0x7f99ec15c4e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 --2- 172.21.15.52:0/977253640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d8003a50 0x7f99ec1f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 >> 172.21.15.52:0/977253640 conn(0x7f99ec0b32a0 msgr2=0x7f99ec0b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 shutdown_connections 2024-06-02T16:48:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.209+0000 7f99f4800640 1 -- 172.21.15.52:0/977253640 wait complete. 2024-06-02T16:48:56.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-06-02T16:48:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.425+0000 7f5b3f200640 1 Processor -- start 2024-06-02T16:48:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.426+0000 7f5b3f200640 1 -- start start 2024-06-02T16:48:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.427+0000 7f5b3f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b400b6c80 0x7f5b400b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.427+0000 7f5b3f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400ba430 0x7f5b400ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.427+0000 7f5b3f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b401607c0 con 0x7f5b4015d060 2024-06-02T16:48:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.427+0000 7f5b3f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5b40163c50 con 0x7f5b400b6c80 2024-06-02T16:48:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.427+0000 7f5b3f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5b40163040 con 0x7f5b400ba430 2024-06-02T16:48:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b400b6c80 0x7f5b400b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b4015d060 0x7f5b400d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49496/0 (socket says 172.21.15.52:49496) 2024-06-02T16:48:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3de00640 1 -- 172.21.15.52:0/156405039 learned_addr learned my addr 172.21.15.52:0/156405039 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3e800640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400ba430 0x7f5b400ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3d400640 1 -- 172.21.15.52:0/156405039 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400ba430 msgr2=0x7f5b400ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:56.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3d400640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400ba430 0x7f5b400ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3d400640 1 -- 172.21.15.52:0/156405039 >> v1:172.21.15.52:6789/0 conn(0x7f5b4015d060 legacy=0x7f5b400d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3d400640 1 -- 172.21.15.52:0/156405039 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b40163320 con 0x7f5b400b6c80 2024-06-02T16:48:56.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.428+0000 7f5b3ca00640 1 -- 172.21.15.52:0/156405039 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398507296 0 0) 0x7f5b401607c0 con 0x7f5b4015d060 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3d400640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b400b6c80 0x7f5b400b7100 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d90 tx=0x7f5b2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cec57b84d613fb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3ca00640 1 -- 172.21.15.52:0/156405039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28007740 con 0x7f5b400b6c80 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3ca00640 1 -- 172.21.15.52:0/156405039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b280078e0 con 0x7f5b400b6c80 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3ca00640 1 -- 172.21.15.52:0/156405039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28007cb0 con 0x7f5b400b6c80 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3f200640 1 -- 172.21.15.52:0/156405039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b400b6c80 msgr2=0x7f5b400b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3f200640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b400b6c80 0x7f5b400b7100 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d90 tx=0x7f5b2802a660 comp rx=0 tx=0).stop 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.430+0000 7f5b3f200640 1 -- 172.21.15.52:0/156405039 shutdown_connections 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.431+0000 7f5b3f200640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400ba430 0x7f5b400ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.431+0000 7f5b3f200640 1 --2- 172.21.15.52:0/156405039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b400b6c80 0x7f5b400b7100 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.431+0000 7f5b3f200640 1 -- 172.21.15.52:0/156405039 >> 172.21.15.52:0/156405039 conn(0x7f5b400740e0 msgr2=0x7f5b400d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.431+0000 7f5b3f200640 1 -- 172.21.15.52:0/156405039 shutdown_connections 2024-06-02T16:48:56.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.431+0000 7f5b3f200640 1 -- 172.21.15.52:0/156405039 wait complete. 2024-06-02T16:48:56.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.432+0000 7f5b3f200640 1 Processor -- start 2024-06-02T16:48:56.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.432+0000 7f5b3f200640 1 -- start start 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400b6c80 0x7f5b401f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b400ba430 0x7f5b401f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b400d0880 con 0x7f5b4015d060 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5b401638e0 con 0x7f5b400ba430 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.433+0000 7f5b3f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5b400d0a00 con 0x7f5b400b6c80 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56104/0 (socket says 172.21.15.52:56104) 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 -- 172.21.15.52:0/709675738 learned_addr learned my addr 172.21.15.52:0/709675738 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3de00640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400b6c80 0x7f5b401f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3d400640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b400ba430 0x7f5b401f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 -- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400b6c80 msgr2=0x7f5b401f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400b6c80 0x7f5b401f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 -- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b400ba430 msgr2=0x7f5b401f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b400ba430 0x7f5b401f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.434+0000 7f5b3e800640 1 -- 172.21.15.52:0/709675738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b401f5aa0 con 0x7f5b4015d060 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b3e800640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800d800 tx=0x7f5b3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800b6c0 con 0x7f5b4015d060 2024-06-02T16:48:56.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38019070 con 0x7f5b4015d060 2024-06-02T16:48:56.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b401f5d80 con 0x7f5b4015d060 2024-06-02T16:48:56.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800bac0 con 0x7f5b4015d060 2024-06-02T16:48:56.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.435+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b400cc730 con 0x7f5b4015d060 2024-06-02T16:48:56.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.436+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b400507e0 con 0x7f5b4015d060 2024-06-02T16:48:56.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.438+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b3800bc60 con 0x7f5b4015d060 2024-06-02T16:48:56.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.439+0000 7f5b36000640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 0x7f5b1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:56.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.439+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f5b38097810 con 0x7f5b4015d060 2024-06-02T16:48:56.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.439+0000 7f5b3de00640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 0x7f5b1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:56.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.441+0000 7f5b3de00640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 0x7f5b1c078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000f60 tx=0x7f5b30007b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.443+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b380613d0 con 0x7f5b4015d060 2024-06-02T16:48:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:56.732+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f5b400d2ea0 con 0x7f5b4015d060 2024-06-02T16:48:57.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.733+0000 7f5b36000640 1 -- 172.21.15.52:0/709675738 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v169) ==== 148+0+0 (secure 0 0 0) 0x7f5b38060cd0 con 0x7f5b4015d060 2024-06-02T16:48:57.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 msgr2=0x7f5b1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 0x7f5b1c078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000f60 tx=0x7f5b30007b10 comp rx=0 tx=0).stop 2024-06-02T16:48:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 msgr2=0x7f5b40161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800d800 tx=0x7f5b3800dcc0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 shutdown_connections 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5b1c0762d0 0x7f5b1c078790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4015d060 0x7f5b40161ec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b400ba430 0x7f5b401f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 --2- 172.21.15.52:0/709675738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b400b6c80 0x7f5b401f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.737+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 >> 172.21.15.52:0/709675738 conn(0x7f5b400740e0 msgr2=0x7f5b4015fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.738+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 shutdown_connections 2024-06-02T16:48:57.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.738+0000 7f5b3f200640 1 -- 172.21.15.52:0/709675738 wait complete. 2024-06-02T16:48:57.761 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-06-02T16:48:57.761 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:48:57.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:48:57.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.972+0000 7f1a45a00640 1 Processor -- start 2024-06-02T16:48:57.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.973+0000 7f1a45a00640 1 -- start start 2024-06-02T16:48:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.974+0000 7f1a45a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a400b6c80 0x7f1a400b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.974+0000 7f1a45a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a400ba430 0x7f1a400ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.974+0000 7f1a45a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a401607c0 con 0x7f1a4015d060 2024-06-02T16:48:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.974+0000 7f1a45a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1a40163c50 con 0x7f1a400ba430 2024-06-02T16:48:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.974+0000 7f1a45a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1a40163040 con 0x7f1a400b6c80 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a400ba430 0x7f1a400ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a400ba430 0x7f1a400ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56108/0 (socket says 172.21.15.52:56108) 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 -- 172.21.15.52:0/1067007137 learned_addr learned my addr 172.21.15.52:0/1067007137 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a3f400640 1 --2- 172.21.15.52:0/1067007137 >> v2:172.21.15.114:3300/0 conn(0x7f1a400b6c80 0x7f1a400b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 -- 172.21.15.52:0/1067007137 >> v2:172.21.15.114:3300/0 conn(0x7f1a400b6c80 msgr2=0x7f1a400b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 --2- 172.21.15.52:0/1067007137 >> v2:172.21.15.114:3300/0 conn(0x7f1a400b6c80 0x7f1a400b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 -- 172.21.15.52:0/1067007137 >> v1:172.21.15.114:6789/0 conn(0x7f1a4015d060 legacy=0x7f1a400d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.975+0000 7f1a45000640 1 -- 172.21.15.52:0/1067007137 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a40163320 con 0x7f1a400ba430 2024-06-02T16:48:57.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.976+0000 7f1a45000640 1 --2- 172.21.15.52:0/1067007137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a400ba430 0x7f1a400ba8c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1a400d51b0 tx=0x7f1a3802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55331895c68235f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:57.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.977+0000 7f1a3ea00640 1 -- 172.21.15.52:0/1067007137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38036070 con 0x7f1a400ba430 2024-06-02T16:48:57.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.977+0000 7f1a3ea00640 1 -- 172.21.15.52:0/1067007137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38031600 con 0x7f1a400ba430 2024-06-02T16:48:57.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.977+0000 7f1a3ea00640 1 -- 172.21.15.52:0/1067007137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380319d0 con 0x7f1a400ba430 2024-06-02T16:48:57.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.977+0000 7f1a45a00640 1 -- 172.21.15.52:0/1067007137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a400ba430 msgr2=0x7f1a400ba8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:57.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.977+0000 7f1a45a00640 1 --2- 172.21.15.52:0/1067007137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a400ba430 0x7f1a400ba8c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1a400d51b0 tx=0x7f1a3802a6a0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 -- 172.21.15.52:0/1067007137 shutdown_connections 2024-06-02T16:48:57.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 --2- 172.21.15.52:0/1067007137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a400ba430 0x7f1a400ba8c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 --2- 172.21.15.52:0/1067007137 >> v2:172.21.15.114:3300/0 conn(0x7f1a400b6c80 0x7f1a400b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 -- 172.21.15.52:0/1067007137 >> 172.21.15.52:0/1067007137 conn(0x7f1a400740e0 msgr2=0x7f1a400d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:57.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 -- 172.21.15.52:0/1067007137 shutdown_connections 2024-06-02T16:48:57.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.978+0000 7f1a45a00640 1 -- 172.21.15.52:0/1067007137 wait complete. 2024-06-02T16:48:57.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.979+0000 7f1a45a00640 1 Processor -- start 2024-06-02T16:48:57.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.980+0000 7f1a45a00640 1 -- start start 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1a400b6c80 0x7f1a401f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a400ba430 0x7f1a40161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a400d0880 con 0x7f1a4015d060 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401638e0 con 0x7f1a400ba430 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1a400d0a00 con 0x7f1a400b6c80 2024-06-02T16:48:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56114/0 (socket says 172.21.15.52:56114) 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 -- 172.21.15.52:0/4206513421 learned_addr learned my addr 172.21.15.52:0/4206513421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 -- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1a400b6c80 msgr2=0x7f1a401f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1a400b6c80 0x7f1a401f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a3f400640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a400ba430 0x7f1a40161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 -- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a400ba430 msgr2=0x7f1a40161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a400ba430 0x7f1a40161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.981+0000 7f1a45000640 1 -- 172.21.15.52:0/4206513421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a401f98f0 con 0x7f1a4015d060 2024-06-02T16:48:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a45000640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009f40 tx=0x7f1a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3803f020 con 0x7f1a4015d060 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38037040 con 0x7f1a4015d060 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38036070 con 0x7f1a4015d060 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a400cc370 con 0x7f1a4015d060 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.982+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a400cc930 con 0x7f1a4015d060 2024-06-02T16:48:57.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.983+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a400507e0 con 0x7f1a4015d060 2024-06-02T16:48:57.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.984+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a38042020 con 0x7f1a4015d060 2024-06-02T16:48:57.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.985+0000 7f1a37e00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 0x7f1a20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:57.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.986+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f1a380b7790 con 0x7f1a4015d060 2024-06-02T16:48:57.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.986+0000 7f1a3fe00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 0x7f1a20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:57.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.987+0000 7f1a3fe00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 0x7f1a20078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a30003cc0 tx=0x7f1a300079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:57.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:57.990+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1a38049030 con 0x7f1a4015d060 2024-06-02T16:48:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.209+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a400ba210 con 0x7f1a4015d060 2024-06-02T16:48:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.210+0000 7f1a37e00640 1 -- 172.21.15.52:0/4206513421 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+13020 (secure 0 0 0) 0x7f1a380893d0 con 0x7f1a4015d060 2024-06-02T16:48:58.209 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:48:58.209 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:48:55.709055+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3573924540":"2024-06-03T16:48:52.481840+0000","172.21.15.52:6834/3573924540":"2024-06-03T16:48:52.481840+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:48:58.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 msgr2=0x7f1a20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 0x7f1a20078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a30003cc0 tx=0x7f1a300079b0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 msgr2=0x7f1a401616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009f40 tx=0x7f1a38004a40 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 shutdown_connections 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1a200762d0 0x7f1a20078790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a4015d060 0x7f1a401616c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a400ba430 0x7f1a40161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 --2- 172.21.15.52:0/4206513421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1a400b6c80 0x7f1a401f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 >> 172.21.15.52:0/4206513421 conn(0x7f1a400740e0 msgr2=0x7f1a400d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 shutdown_connections 2024-06-02T16:48:58.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.213+0000 7f1a45a00640 1 -- 172.21.15.52:0/4206513421 wait complete. 2024-06-02T16:48:58.229 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T16:45:00.031102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T16:48:58.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T16:48:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.441+0000 7f2a83200640 1 Processor -- start 2024-06-02T16:48:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.441+0000 7f2a83200640 1 -- start start 2024-06-02T16:48:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.442+0000 7f2a83200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a8415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.442+0000 7f2a83200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.442+0000 7f2a83200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a840aeef0 con 0x7f2a840aff90 2024-06-02T16:48:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.442+0000 7f2a83200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2a840af1d0 con 0x7f2a8406e410 2024-06-02T16:48:58.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.442+0000 7f2a83200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2a840af4b0 con 0x7f2a84159eb0 2024-06-02T16:48:58.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.443+0000 7f2a7be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.443+0000 7f2a81e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a8415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.443+0000 7f2a7be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.52:45584/0 (socket says 172.21.15.52:45584) 2024-06-02T16:48:58.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.443+0000 7f2a7be00640 1 -- 172.21.15.52:0/1349244681 learned_addr learned my addr 172.21.15.52:0/1349244681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.444+0000 7f2a81e00640 1 -- 172.21.15.52:0/1349244681 >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 msgr2=0x7f2a84073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.444+0000 7f2a81e00640 1 --2- 172.21.15.52:0/1349244681 >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.444+0000 7f2a81e00640 1 -- 172.21.15.52:0/1349244681 >> v1:172.21.15.114:6789/0 conn(0x7f2a840aff90 legacy=0x7f2a840723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.444+0000 7f2a81e00640 1 -- 172.21.15.52:0/1349244681 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a840af790 con 0x7f2a84159eb0 2024-06-02T16:48:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.444+0000 7f2a7be00640 1 --2- 172.21.15.52:0/1349244681 >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:48:58.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.445+0000 7f2a81e00640 1 --2- 172.21.15.52:0/1349244681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a8415c6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097a0 tx=0x7f2a7402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4119762eda7772 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.446+0000 7f2a81400640 1 -- 172.21.15.52:0/1349244681 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74037070 con 0x7f2a84159eb0 2024-06-02T16:48:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.446+0000 7f2a81400640 1 -- 172.21.15.52:0/1349244681 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a74032440 con 0x7f2a84159eb0 2024-06-02T16:48:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.446+0000 7f2a81400640 1 -- 172.21.15.52:0/1349244681 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74032810 con 0x7f2a84159eb0 2024-06-02T16:48:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 -- 172.21.15.52:0/1349244681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 msgr2=0x7f2a8415c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 --2- 172.21.15.52:0/1349244681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a8415c6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097a0 tx=0x7f2a7402a180 comp rx=0 tx=0).stop 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 -- 172.21.15.52:0/1349244681 shutdown_connections 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 --2- 172.21.15.52:0/1349244681 >> v2:172.21.15.114:3300/0 conn(0x7f2a8406e410 0x7f2a84073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 --2- 172.21.15.52:0/1349244681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a8415c6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 -- 172.21.15.52:0/1349244681 >> 172.21.15.52:0/1349244681 conn(0x7f2a840b2b60 msgr2=0x7f2a840b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 -- 172.21.15.52:0/1349244681 shutdown_connections 2024-06-02T16:48:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.447+0000 7f2a83200640 1 -- 172.21.15.52:0/1349244681 wait complete. 2024-06-02T16:48:58.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.449+0000 7f2a83200640 1 Processor -- start 2024-06-02T16:48:58.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.449+0000 7f2a83200640 1 -- start start 2024-06-02T16:48:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a840aff90 0x7f2a841ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a841ec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a840aeba0 con 0x7f2a8406e410 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a840b6100 con 0x7f2a840aff90 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a83200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2a84073990 con 0x7f2a84159eb0 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a81e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a81e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56124/0 (socket says 172.21.15.52:56124) 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.450+0000 7f2a81e00640 1 -- 172.21.15.52:0/2346834786 learned_addr learned my addr 172.21.15.52:0/2346834786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a7be00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a840aff90 0x7f2a841ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 -- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 msgr2=0x7f2a841ec3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a841ec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 -- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a840aff90 msgr2=0x7f2a841ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a840aff90 0x7f2a841ebea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 -- 172.21.15.52:0/2346834786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a84157680 con 0x7f2a8406e410 2024-06-02T16:48:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a81e00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a740098c0 tx=0x7f2a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74037050 con 0x7f2a8406e410 2024-06-02T16:48:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a74038040 con 0x7f2a8406e410 2024-06-02T16:48:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74030bd0 con 0x7f2a8406e410 2024-06-02T16:48:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.451+0000 7f2a83200640 1 -- 172.21.15.52:0/2346834786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a84157960 con 0x7f2a8406e410 2024-06-02T16:48:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.452+0000 7f2a83200640 1 -- 172.21.15.52:0/2346834786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a84157f20 con 0x7f2a8406e410 2024-06-02T16:48:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.453+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a840507e0 con 0x7f2a8406e410 2024-06-02T16:48:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.454+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2a7403c440 con 0x7f2a8406e410 2024-06-02T16:48:58.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.455+0000 7f2a7a000640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 0x7f2a60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.455+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f2a740b7e10 con 0x7f2a8406e410 2024-06-02T16:48:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.455+0000 7f2a7be00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 0x7f2a60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.457+0000 7f2a7be00640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 0x7f2a60078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00b8d0 tx=0x7f2a6c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.459+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2a740bb030 con 0x7f2a8406e410 2024-06-02T16:48:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.673+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a8415e270 con 0x7f2a8406e410 2024-06-02T16:48:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.674+0000 7f2a7a000640 1 -- 172.21.15.52:0/2346834786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f2a74081a60 con 0x7f2a8406e410 2024-06-02T16:48:58.672 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-06-02T16:48:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 msgr2=0x7f2a60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 0x7f2a60078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00b8d0 tx=0x7f2a6c008040 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 msgr2=0x7f2a841468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a740098c0 tx=0x7f2a740046c0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 shutdown_connections 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2a600762d0 0x7f2a60078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2a84159eb0 0x7f2a841ec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a840aff90 0x7f2a841ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 --2- 172.21.15.52:0/2346834786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8406e410 0x7f2a841468d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.676+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 >> 172.21.15.52:0/2346834786 conn(0x7f2a840b2b60 msgr2=0x7f2a8415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.677+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 shutdown_connections 2024-06-02T16:48:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.677+0000 7f2a73400640 1 -- 172.21.15.52:0/2346834786 wait complete. 2024-06-02T16:48:58.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-06-02T16:48:58.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.915+0000 7f005da00640 1 Processor -- start 2024-06-02T16:48:58.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.916+0000 7f005da00640 1 -- start start 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.917+0000 7f005da00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f005814cf30 0x7f0058167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.917+0000 7f005da00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f00580b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.917+0000 7f005da00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00581681e0 con 0x7f00580ce760 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.917+0000 7f005da00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0058073bf0 con 0x7f005814cf30 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.917+0000 7f005da00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f00580b4370 con 0x7f005806e840 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f0057400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f00580ce760 0x7f005806e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49504/0 (socket says 172.21.15.52:49504) 2024-06-02T16:48:58.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f0057400640 1 -- 172.21.15.52:0/1876344372 learned_addr learned my addr 172.21.15.52:0/1876344372 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f0057e00640 1 --2- 172.21.15.52:0/1876344372 >> v2:172.21.15.114:3300/0 conn(0x7f005814cf30 0x7f0058167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f005d000640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f00580b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403087847 0 0) 0x7f0044001110 con 0x7f00580ce760 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.918+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f003c003520 con 0x7f00580ce760 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 806063608 0 0) 0x7f003c003520 con 0x7f00580ce760 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 msgr2=0x7f00580b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f00580b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 >> v2:172.21.15.114:3300/0 conn(0x7f005814cf30 msgr2=0x7f0058167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 --2- 172.21.15.52:0/1876344372 >> v2:172.21.15.114:3300/0 conn(0x7f005814cf30 0x7f0058167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580b4650 con 0x7f00580ce760 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f00440018c0 con 0x7f00580ce760 2024-06-02T16:48:58.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 >> v1:172.21.15.52:6789/0 conn(0x7f00580ce760 legacy=0x7f005806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f003c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c003fd0 0x7f003c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f003c004d40 0x7f003c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0058073bf0 con 0x7f003c004d40 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00580b4370 con 0x7f003c003fd0 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f003c00ba10 con 0x7f005806e840 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f005d000640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f003c004d40 0x7f003c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0057400640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c003fd0 0x7f003c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.919+0000 7f0057e00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f003c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f005d000640 1 -- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 msgr2=0x7f003c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f005d000640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f003c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f005d000640 1 -- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c003fd0 msgr2=0x7f003c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:58.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f005d000640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c003fd0 0x7f003c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f005d000640 1 -- 172.21.15.52:0/1876344372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c003520 con 0x7f003c004d40 2024-06-02T16:48:58.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.920+0000 7f0057e00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f005806e840 0x7f003c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.921+0000 7f005d000640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f003c004d40 0x7f003c0051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f005000e170 tx=0x7f003c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87869ff090c4a394 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.921+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050034020 con 0x7f003c004d40 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.921+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500305f0 con 0x7f003c004d40 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.921+0000 7f0056a00640 1 -- 172.21.15.52:0/1876344372 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050009c10 con 0x7f003c004d40 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 -- 172.21.15.52:0/1876344372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f003c004d40 msgr2=0x7f003c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 --2- 172.21.15.52:0/1876344372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f003c004d40 0x7f003c0051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f005000e170 tx=0x7f003c005830 comp rx=0 tx=0).stop 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005d000640 1 -- 172.21.15.52:0/1876344372 reap_dead start 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 -- 172.21.15.52:0/1876344372 shutdown_connections 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 -- 172.21.15.52:0/1876344372 >> 172.21.15.52:0/1876344372 conn(0x7f005806c380 msgr2=0x7f005806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 -- 172.21.15.52:0/1876344372 shutdown_connections 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.922+0000 7f005da00640 1 -- 172.21.15.52:0/1876344372 wait complete. 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.924+0000 7f005da00640 1 Processor -- start 2024-06-02T16:48:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.924+0000 7f005da00640 1 -- start start 2024-06-02T16:48:58.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 0x7f0058162a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00581edd40 0x7f00581ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00580b4ef0 con 0x7f0058142860 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00580b4c10 con 0x7f003c004d40 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005da00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f005814d310 con 0x7f00581edd40 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56138/0 (socket says 172.21.15.52:56138) 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.925+0000 7f005d000640 1 -- 172.21.15.52:0/2047516972 learned_addr learned my addr 172.21.15.52:0/2047516972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f0057e00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 0x7f0058162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f0057400640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00581edd40 0x7f00581ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 -- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00581edd40 msgr2=0x7f00581ee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00581edd40 0x7f00581ee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 -- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 msgr2=0x7f0058162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 0x7f0058162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:58.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 -- 172.21.15.52:0/2047516972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00581ee700 con 0x7f0058142860 2024-06-02T16:48:58.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f0057e00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 0x7f0058162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:58.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f005d000640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f005000e170 tx=0x7f0050009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.926+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050040070 con 0x7f0058142860 2024-06-02T16:48:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.927+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00581ee9c0 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.927+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0050003990 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.927+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050034040 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.927+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0058141d80 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.928+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00580507e0 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.929+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0050037020 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.930+0000 7f004fe00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 0x7f00380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.930+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f00500b7570 con 0x7f0058142860 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.931+0000 7f0057e00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 0x7f00380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:58.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.932+0000 7f0057e00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 0x7f00380787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f00581fc940 tx=0x7f0048008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:58.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:58.935+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0050081170 con 0x7f0058142860 2024-06-02T16:48:59.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.230+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f005814b7e0 con 0x7f0058142860 2024-06-02T16:48:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.746+0000 7f004fe00640 1 -- 172.21.15.52:0/2047516972 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v171) ==== 146+0+0 (secure 0 0 0) 0x7f0050080a70 con 0x7f0058142860 2024-06-02T16:48:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.749+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 msgr2=0x7f00380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.749+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 0x7f00380787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f00581fc940 tx=0x7f0048008040 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.749+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 msgr2=0x7f0058142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.749+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f005000e170 tx=0x7f0050009750 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 shutdown_connections 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f0038076300 0x7f00380787c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058142860 0x7f0058142cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00581edd40 0x7f00581ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 --2- 172.21.15.52:0/2047516972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f003c004d40 0x7f0058162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 >> 172.21.15.52:0/2047516972 conn(0x7f005806c380 msgr2=0x7f0058164840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 shutdown_connections 2024-06-02T16:48:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.750+0000 7f005da00640 1 -- 172.21.15.52:0/2047516972 wait complete. 2024-06-02T16:48:59.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T16:48:59.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.990+0000 7fc348e00640 1 Processor -- start 2024-06-02T16:48:59.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.991+0000 7fc348e00640 1 -- start start 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.992+0000 7fc348e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc34406eeb0 0x7fc34409c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.992+0000 7fc348e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 0x7fc34409b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.992+0000 7fc348e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440d1880 con 0x7fc34406f290 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.992+0000 7fc348e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc34409cc40 con 0x7fc34406eeb0 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.992+0000 7fc348e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440d1b60 con 0x7fc344070b20 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc34406eeb0 0x7fc34409c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc34406eeb0 0x7fc34409c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56140/0 (socket says 172.21.15.52:56140) 2024-06-02T16:48:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 -- 172.21.15.52:0/3267505546 learned_addr learned my addr 172.21.15.52:0/3267505546 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341400640 1 --2- 172.21.15.52:0/3267505546 >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 0x7fc34409b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 -- 172.21.15.52:0/3267505546 >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 msgr2=0x7fc34409b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 --2- 172.21.15.52:0/3267505546 >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 0x7fc34409b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 -- 172.21.15.52:0/3267505546 >> v1:172.21.15.114:6789/0 conn(0x7fc34406f290 legacy=0x7fc34415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:48:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341e00640 1 -- 172.21.15.52:0/3267505546 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440d1e40 con 0x7fc34406eeb0 2024-06-02T16:48:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.993+0000 7fc341400640 1 --2- 172.21.15.52:0/3267505546 >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 0x7fc34409b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:48:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.994+0000 7fc341e00640 1 --2- 172.21.15.52:0/3267505546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc34409c700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3440d3170 tx=0x7fc33402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f774f7ae6291b3e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:48:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.995+0000 7fc340a00640 1 -- 172.21.15.52:0/3267505546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334037070 con 0x7fc34406eeb0 2024-06-02T16:48:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.995+0000 7fc340a00640 1 -- 172.21.15.52:0/3267505546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334032440 con 0x7fc34406eeb0 2024-06-02T16:48:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.995+0000 7fc340a00640 1 -- 172.21.15.52:0/3267505546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334032810 con 0x7fc34406eeb0 2024-06-02T16:48:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.995+0000 7fc348e00640 1 -- 172.21.15.52:0/3267505546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 msgr2=0x7fc34409c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.995+0000 7fc348e00640 1 --2- 172.21.15.52:0/3267505546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc34409c700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3440d3170 tx=0x7fc33402a270 comp rx=0 tx=0).stop 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 -- 172.21.15.52:0/3267505546 shutdown_connections 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 --2- 172.21.15.52:0/3267505546 >> v2:172.21.15.114:3300/0 conn(0x7fc344070b20 0x7fc34409b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 --2- 172.21.15.52:0/3267505546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc34409c700 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 -- 172.21.15.52:0/3267505546 >> 172.21.15.52:0/3267505546 conn(0x7fc3440b4cc0 msgr2=0x7fc3440b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 -- 172.21.15.52:0/3267505546 shutdown_connections 2024-06-02T16:48:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.996+0000 7fc348e00640 1 -- 172.21.15.52:0/3267505546 wait complete. 2024-06-02T16:48:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.998+0000 7fc348e00640 1 Processor -- start 2024-06-02T16:48:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.998+0000 7fc348e00640 1 -- start start 2024-06-02T16:48:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc34406f290 0x7fc3440ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344070b20 0x7fc3441de500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:48:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440d1580 con 0x7fc34406eeb0 2024-06-02T16:48:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440d2400 con 0x7fc344070b20 2024-06-02T16:48:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc348e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440d2920 con 0x7fc34406f290 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc341e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc341e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56154/0 (socket says 172.21.15.52:56154) 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc341e00640 1 -- 172.21.15.52:0/2895188748 learned_addr learned my addr 172.21.15.52:0/2895188748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:48:59.999+0000 7fc342800640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344070b20 0x7fc3441de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341400640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc34406f290 0x7fc3440ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 -- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc34406f290 msgr2=0x7fc3440ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc34406f290 0x7fc3440ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 -- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344070b20 msgr2=0x7fc3441de500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344070b20 0x7fc3441de500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 -- 172.21.15.52:0/2895188748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440ccc20 con 0x7fc34406eeb0 2024-06-02T16:48:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.000+0000 7fc341e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc334009960 tx=0x7fc3340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.001+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334041070 con 0x7fc34406eeb0 2024-06-02T16:49:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.001+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33403c950 con 0x7fc34406eeb0 2024-06-02T16:49:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.001+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334037040 con 0x7fc34406eeb0 2024-06-02T16:49:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.001+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3440ca660 con 0x7fc34406eeb0 2024-06-02T16:49:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.001+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3440cac20 con 0x7fc34406eeb0 2024-06-02T16:49:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.002+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344069520 con 0x7fc34406eeb0 2024-06-02T16:49:00.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.003+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc334044070 con 0x7fc34406eeb0 2024-06-02T16:49:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.004+0000 7fc33a000640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 0x7fc324078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.004+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fc3340b7cb0 con 0x7fc34406eeb0 2024-06-02T16:49:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.005+0000 7fc341400640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 0x7fc324078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.006+0000 7fc341400640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 0x7fc324078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b1480 tx=0x7fc330008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.009+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc334081350 con 0x7fc34406eeb0 2024-06-02T16:49:00.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.220+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc3440719a0 con 0x7fc34406eeb0 2024-06-02T16:49:00.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.227+0000 7fc33a000640 1 -- 172.21.15.52:0/2895188748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fc334085650 con 0x7fc34406eeb0 2024-06-02T16:49:00.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.229+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 msgr2=0x7fc324078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:00.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.229+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 0x7fc324078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b1480 tx=0x7fc330008040 comp rx=0 tx=0).stop 2024-06-02T16:49:00.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.229+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 msgr2=0x7fc3440cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:00.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.229+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc334009960 tx=0x7fc3340046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.229+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 shutdown_connections 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3240762d0 0x7fc324078790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344070b20 0x7fc3441de500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc34406f290 0x7fc3440ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 --2- 172.21.15.52:0/2895188748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34406eeb0 0x7fc3440cc6e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 >> 172.21.15.52:0/2895188748 conn(0x7fc3440b4cc0 msgr2=0x7fc3440b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 shutdown_connections 2024-06-02T16:49:00.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.230+0000 7fc348e00640 1 -- 172.21.15.52:0/2895188748 wait complete. 2024-06-02T16:49:00.248 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T16:49:00.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:49:00.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:49:00.471 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T16:49:00.471 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:00.471 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:00.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:49:00.533 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:00.533 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:00.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:00.591 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:00.591 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:00.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:49:00.651 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:00.651 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:00.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:00.709 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T16:49:00.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:00.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.931+0000 7ff3af000640 1 Processor -- start 2024-06-02T16:49:00.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.932+0000 7ff3af000640 1 -- start start 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.933+0000 7ff3af000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3a813ed60 0x7ff3a806e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.933+0000 7ff3af000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff3a8160350 0x7ff3a806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.933+0000 7ff3af000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a81416c0 con 0x7ff3a813f140 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.933+0000 7ff3af000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a80d0890 con 0x7ff3a813ed60 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.933+0000 7ff3af000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a8160970 con 0x7ff3a8160350 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3a813ed60 0x7ff3a806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:00.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3a813ed60 0x7ff3a806e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56156/0 (socket says 172.21.15.52:56156) 2024-06-02T16:49:00.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 -- 172.21.15.52:0/241786433 learned_addr learned my addr 172.21.15.52:0/241786433 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:00.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3ae600640 1 --2- 172.21.15.52:0/241786433 >> v2:172.21.15.114:3300/0 conn(0x7ff3a8160350 0x7ff3a806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:00.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 -- 172.21.15.52:0/241786433 >> v2:172.21.15.114:3300/0 conn(0x7ff3a8160350 msgr2=0x7ff3a806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:00.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 --2- 172.21.15.52:0/241786433 >> v2:172.21.15.114:3300/0 conn(0x7ff3a8160350 0x7ff3a806e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 -- 172.21.15.52:0/241786433 >> v1:172.21.15.114:6789/0 conn(0x7ff3a813f140 legacy=0x7ff3a815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:00.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.934+0000 7ff3adc00640 1 -- 172.21.15.52:0/241786433 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8141960 con 0x7ff3a813ed60 2024-06-02T16:49:00.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.935+0000 7ff3adc00640 1 --2- 172.21.15.52:0/241786433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a813ed60 0x7ff3a806e130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3a815c5e0 tx=0x7ff39c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ac0e757125b70d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:00.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.936+0000 7ff3a7e00640 1 -- 172.21.15.52:0/241786433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c037070 con 0x7ff3a813ed60 2024-06-02T16:49:00.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.936+0000 7ff3a7e00640 1 -- 172.21.15.52:0/241786433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c032440 con 0x7ff3a813ed60 2024-06-02T16:49:00.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.936+0000 7ff3a7e00640 1 -- 172.21.15.52:0/241786433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c032810 con 0x7ff3a813ed60 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.936+0000 7ff3af000640 1 -- 172.21.15.52:0/241786433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a813ed60 msgr2=0x7ff3a806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.936+0000 7ff3af000640 1 --2- 172.21.15.52:0/241786433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a813ed60 0x7ff3a806e130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3a815c5e0 tx=0x7ff39c02a140 comp rx=0 tx=0).stop 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 -- 172.21.15.52:0/241786433 shutdown_connections 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 --2- 172.21.15.52:0/241786433 >> v2:172.21.15.114:3300/0 conn(0x7ff3a8160350 0x7ff3a806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 --2- 172.21.15.52:0/241786433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a813ed60 0x7ff3a806e130 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 -- 172.21.15.52:0/241786433 >> 172.21.15.52:0/241786433 conn(0x7ff3a806c380 msgr2=0x7ff3a806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:00.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 -- 172.21.15.52:0/241786433 shutdown_connections 2024-06-02T16:49:00.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.937+0000 7ff3af000640 1 -- 172.21.15.52:0/241786433 wait complete. 2024-06-02T16:49:00.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.939+0000 7ff3af000640 1 Processor -- start 2024-06-02T16:49:00.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.939+0000 7ff3af000640 1 -- start start 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff3a813ed60 0x7ff3a81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a8139300 0x7ff3a80b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8142440 con 0x7ff3a8160350 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8141f20 con 0x7ff3a8139300 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.940+0000 7ff3af000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a81425c0 con 0x7ff3a813ed60 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56168/0 (socket says 172.21.15.52:56168) 2024-06-02T16:49:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 -- 172.21.15.52:0/66310658 learned_addr learned my addr 172.21.15.52:0/66310658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 -- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff3a813ed60 msgr2=0x7ff3a81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff3a813ed60 0x7ff3a81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 -- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a8139300 msgr2=0x7ff3a80b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a8139300 0x7ff3a80b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 -- 172.21.15.52:0/66310658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a81437f0 con 0x7ff3a8160350 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.941+0000 7ff3ad200640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c410 tx=0x7ff39400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.942+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394017070 con 0x7ff3a8160350 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.942+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3940035f0 con 0x7ff3a8160350 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.942+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394003a20 con 0x7ff3a8160350 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.942+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a8155c20 con 0x7ff3a8160350 2024-06-02T16:49:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.942+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a8143d70 con 0x7ff3a8160350 2024-06-02T16:49:00.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.943+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a80639c0 con 0x7ff3a8160350 2024-06-02T16:49:00.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.945+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff394003bc0 con 0x7ff3a8160350 2024-06-02T16:49:00.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.946+0000 7ff3a5600640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 0x7ff388078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:00.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.946+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7ff394096760 con 0x7ff3a8160350 2024-06-02T16:49:00.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.946+0000 7ff3adc00640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 0x7ff388078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:00.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.948+0000 7ff3adc00640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 0x7ff388078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff39c034000 tx=0x7ff39c02c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:00.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:00.950+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff3a80639c0 con 0x7ff3a8160350 2024-06-02T16:49:01.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.205+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3a8166d40 con 0x7ff3a8160350 2024-06-02T16:49:01.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.206+0000 7ff3a5600640 1 -- 172.21.15.52:0/66310658 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3872 (secure 0 0 0) 0x7ff394060320 con 0x7ff3a8160350 2024-06-02T16:49:01.205 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:01.205 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2939008840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2939008840},{"type":"v1","addr":"172.21.15.114:6836","nonce":2939008840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2650059506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2650059506},{"type":"v1","addr":"172.21.15.114:6837","nonce":2650059506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2911962196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2911962196},{"type":"v1","addr":"172.21.15.52:6833","nonce":2911962196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/598825309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":598825309},{"type":"v1","addr":"172.21.15.52:6835","nonce":598825309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-06-02T16:49:01.205 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 20 2024-06-02T16:49:01.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 msgr2=0x7ff388078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 0x7ff388078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff39c034000 tx=0x7ff39c02c000 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 msgr2=0x7ff3a813b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c410 tx=0x7ff39400c8d0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 shutdown_connections 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3880762d0 0x7ff388078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a8139300 0x7ff3a80b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3a8160350 0x7ff3a813b680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 --2- 172.21.15.52:0/66310658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff3a813ed60 0x7ff3a81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 >> 172.21.15.52:0/66310658 conn(0x7ff3a806c380 msgr2=0x7ff3a815c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:01.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 shutdown_connections 2024-06-02T16:49:01.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.209+0000 7ff3af000640 1 -- 172.21.15.52:0/66310658 wait complete. 2024-06-02T16:49:01.229 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T16:49:01.229 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T16:49:01.229 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T16:49:01.229 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:49:01.229 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T16:49:01.230 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T16:49:01.230 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T16:49:01.230 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:49:01.230 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T16:49:01.230 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T16:49:01.230 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T16:49:01.230 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:49:01.231 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T16:49:01.231 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T16:49:01.231 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T16:49:01.231 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:49:01.248 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T16:49:01.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T16:49:01.249 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T16:49:01.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T16:49:01.252 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T16:49:01.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T16:49:01.255 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T16:49:01.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T16:49:01.294 INFO:tasks.ceph.mds.c:Started 2024-06-02T16:49:01.294 DEBUG:teuthology.parallel:result is None 2024-06-02T16:49:01.298 INFO:tasks.ceph.mds.a:Started 2024-06-02T16:49:01.299 DEBUG:teuthology.parallel:result is None 2024-06-02T16:49:01.302 INFO:tasks.ceph.mds.d:Started 2024-06-02T16:49:01.303 DEBUG:teuthology.parallel:result is None 2024-06-02T16:49:01.308 INFO:tasks.ceph.mds.b:Started 2024-06-02T16:49:01.309 DEBUG:teuthology.parallel:result is None 2024-06-02T16:49:01.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T16:49:01.448 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-06-02T16:49:01.451 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-06-02T16:49:01.457 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2024-06-02T16:49:01.457 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2024-06-02T16:49:01.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.496+0000 7f6c0de00640 1 Processor -- start 2024-06-02T16:49:01.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.496+0000 7f6c0de00640 1 -- start start 2024-06-02T16:49:01.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6c0815f590 0x7f6c080b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c080b77a0 0x7f6c080d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c080d3e90 0x7f6c080d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6c080b9e90 con 0x7f6c0815f590 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6c080ba170 con 0x7f6c080b77a0 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.497+0000 7f6c0de00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6c080ba450 con 0x7f6c080d3e90 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6c0815f590 0x7f6c080b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6c0815f590 0x7f6c080b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56214/0 (socket says 172.21.15.52:56214) 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 -- 172.21.15.52:0/2234739022 learned_addr learned my addr 172.21.15.52:0/2234739022 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c07e00640 1 --2- 172.21.15.52:0/2234739022 >> v2:172.21.15.114:3300/0 conn(0x7f6c080b77a0 0x7f6c080d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0d400640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c080d3e90 0x7f6c080d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 -- 172.21.15.52:0/2234739022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c080d3e90 msgr2=0x7f6c080d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c080d3e90 0x7f6c080d42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 -- 172.21.15.52:0/2234739022 >> v2:172.21.15.114:3300/0 conn(0x7f6c080b77a0 msgr2=0x7f6c080d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/2234739022 >> v2:172.21.15.114:3300/0 conn(0x7f6c080b77a0 0x7f6c080d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.498+0000 7f6c0ca00640 1 -- 172.21.15.52:0/2234739022 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c080d3430 con 0x7f6c0815f590 2024-06-02T16:49:01.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.499+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0815f590 0x7f6c080b7260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cfc60 tx=0x7f6bfc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f39e91bc908706e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:01.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c07400640 1 -- 172.21.15.52:0/2234739022 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc037070 con 0x7f6c0815f590 2024-06-02T16:49:01.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c07400640 1 -- 172.21.15.52:0/2234739022 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc032440 con 0x7f6c0815f590 2024-06-02T16:49:01.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c07400640 1 -- 172.21.15.52:0/2234739022 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc032810 con 0x7f6c0815f590 2024-06-02T16:49:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 -- 172.21.15.52:0/2234739022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0815f590 msgr2=0x7f6c080b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0815f590 0x7f6c080b7260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cfc60 tx=0x7f6bfc02a140 comp rx=0 tx=0).stop 2024-06-02T16:49:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 -- 172.21.15.52:0/2234739022 shutdown_connections 2024-06-02T16:49:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c080d3e90 0x7f6c080d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 --2- 172.21.15.52:0/2234739022 >> v2:172.21.15.114:3300/0 conn(0x7f6c080b77a0 0x7f6c080d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 --2- 172.21.15.52:0/2234739022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0815f590 0x7f6c080b7260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 -- 172.21.15.52:0/2234739022 >> 172.21.15.52:0/2234739022 conn(0x7f6c08073ea0 msgr2=0x7f6c080742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 -- 172.21.15.52:0/2234739022 shutdown_connections 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.500+0000 7f6c0de00640 1 -- 172.21.15.52:0/2234739022 wait complete. 2024-06-02T16:49:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.502+0000 7f6c0de00640 1 Processor -- start 2024-06-02T16:49:01.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.502+0000 7f6c0de00640 1 -- start start 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 0x7f6c08161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c0815f590 0x7f6c080cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6c080d49a0 con 0x7f6c080b77a0 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c080d4820 con 0x7f6c080d3e90 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0de00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6c080d4b20 con 0x7f6c0815f590 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56230/0 (socket says 172.21.15.52:56230) 2024-06-02T16:49:01.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.503+0000 7f6c0ca00640 1 -- 172.21.15.52:0/3499048722 learned_addr learned my addr 172.21.15.52:0/3499048722 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c07e00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 0x7f6c08161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 -- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c0815f590 msgr2=0x7f6c080cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c0815f590 0x7f6c080cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 -- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 msgr2=0x7f6c08161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 0x7f6c08161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 -- 172.21.15.52:0/3499048722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c081584f0 con 0x7f6c080b77a0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c07e00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 0x7f6c08161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.504+0000 7f6c0ca00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc02a180 tx=0x7f6bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.505+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc037040 con 0x7f6c080b77a0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.505+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc042070 con 0x7f6c080b77a0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.505+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c080cc360 con 0x7f6c080b77a0 2024-06-02T16:49:01.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.505+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc03d880 con 0x7f6c080b77a0 2024-06-02T16:49:01.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.505+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c080ccba0 con 0x7f6c080b77a0 2024-06-02T16:49:01.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.506+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c080507e0 con 0x7f6c080b77a0 2024-06-02T16:49:01.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.508+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6bfc03da20 con 0x7f6c080b77a0 2024-06-02T16:49:01.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.509+0000 7f6c04c00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 0x7f6be8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:01.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.509+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6bfc0b8640 con 0x7f6c080b77a0 2024-06-02T16:49:01.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.510+0000 7f6c07e00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 0x7f6be8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:01.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.511+0000 7f6c07e00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 0x7f6be8078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c080b9360 tx=0x7f6bf4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:01.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.513+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c080cc360 con 0x7f6c080b77a0 2024-06-02T16:49:01.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.741+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6c0806c380 con 0x7f6c080b77a0 2024-06-02T16:49:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.777+0000 7f6c04c00640 1 -- 172.21.15.52:0/3499048722 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7f6bfc082280 con 0x7f6c080b77a0 2024-06-02T16:49:01.775 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-06-02T16:49:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 msgr2=0x7f6be8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 0x7f6be8078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c080b9360 tx=0x7f6bf4008040 comp rx=0 tx=0).stop 2024-06-02T16:49:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 msgr2=0x7f6c08157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc02a180 tx=0x7f6bfc0046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 shutdown_connections 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6be80762d0 0x7f6be8078790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c0815f590 0x7f6c080cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c080d3e90 0x7f6c08161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 --2- 172.21.15.52:0/3499048722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c080b77a0 0x7f6c08157fb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.780+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 >> 172.21.15.52:0/3499048722 conn(0x7f6c08073ea0 msgr2=0x7f6c080d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.781+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 shutdown_connections 2024-06-02T16:49:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:01.781+0000 7f6c0de00640 1 -- 172.21.15.52:0/3499048722 wait complete. 2024-06-02T16:49:01.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T16:49:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.004+0000 7fdc2be00640 1 Processor -- start 2024-06-02T16:49:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.005+0000 7fdc2be00640 1 -- start start 2024-06-02T16:49:02.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.006+0000 7fdc2be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc2c15d060 0x7fdc2c0d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.006+0000 7fdc2be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc2c0d06b0 0x7fdc2c0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.006+0000 7fdc2be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c1607c0 con 0x7fdc2c0b71c0 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.006+0000 7fdc2be00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c163c50 con 0x7fdc2c15d060 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.006+0000 7fdc2be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c163040 con 0x7fdc2c0d06b0 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc2c15d060 0x7fdc2c0d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc2c15d060 0x7fdc2c0d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56240/0 (socket says 172.21.15.52:56240) 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 -- 172.21.15.52:0/1041604744 learned_addr learned my addr 172.21.15.52:0/1041604744 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2b400640 1 --1- 172.21.15.52:0/1041604744 >> v1:172.21.15.52:6789/0 conn(0x7fdc2c0b71c0 0x7fdc2c0ba430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49524/0 (socket says 172.21.15.52:49524) 2024-06-02T16:49:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc23e00640 1 --2- 172.21.15.52:0/1041604744 >> v2:172.21.15.114:3300/0 conn(0x7fdc2c0d06b0 0x7fdc2c0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 -- 172.21.15.52:0/1041604744 >> v2:172.21.15.114:3300/0 conn(0x7fdc2c0d06b0 msgr2=0x7fdc2c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 --2- 172.21.15.52:0/1041604744 >> v2:172.21.15.114:3300/0 conn(0x7fdc2c0d06b0 0x7fdc2c0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 -- 172.21.15.52:0/1041604744 >> v1:172.21.15.52:6789/0 conn(0x7fdc2c0b71c0 legacy=0x7fdc2c0ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.007+0000 7fdc2aa00640 1 -- 172.21.15.52:0/1041604744 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c163320 con 0x7fdc2c15d060 2024-06-02T16:49:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.008+0000 7fdc2aa00640 1 --2- 172.21.15.52:0/1041604744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c0d0170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0d51b0 tx=0x7fdc1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124e0c293ac914ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2a000640 1 -- 172.21.15.52:0/1041604744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c037070 con 0x7fdc2c15d060 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2a000640 1 -- 172.21.15.52:0/1041604744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c032440 con 0x7fdc2c15d060 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2a000640 1 -- 172.21.15.52:0/1041604744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c032810 con 0x7fdc2c15d060 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 -- 172.21.15.52:0/1041604744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 msgr2=0x7fdc2c0d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 --2- 172.21.15.52:0/1041604744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c0d0170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0d51b0 tx=0x7fdc1c02a270 comp rx=0 tx=0).stop 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 -- 172.21.15.52:0/1041604744 shutdown_connections 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 --2- 172.21.15.52:0/1041604744 >> v2:172.21.15.114:3300/0 conn(0x7fdc2c0d06b0 0x7fdc2c0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 --2- 172.21.15.52:0/1041604744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c0d0170 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.009+0000 7fdc2be00640 1 -- 172.21.15.52:0/1041604744 >> 172.21.15.52:0/1041604744 conn(0x7fdc2c0740e0 msgr2=0x7fdc2c0d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.010+0000 7fdc2be00640 1 -- 172.21.15.52:0/1041604744 shutdown_connections 2024-06-02T16:49:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.010+0000 7fdc2be00640 1 -- 172.21.15.52:0/1041604744 wait complete. 2024-06-02T16:49:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.011+0000 7fdc2be00640 1 Processor -- start 2024-06-02T16:49:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.011+0000 7fdc2be00640 1 -- start start 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc2c0b71c0 0x7fdc2c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc2c0d06b0 0x7fdc2c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0bab40 con 0x7fdc2c15d060 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1638e0 con 0x7fdc2c0b71c0 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.012+0000 7fdc2be00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2c0bacc0 con 0x7fdc2c0d06b0 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56244/0 (socket says 172.21.15.52:56244) 2024-06-02T16:49:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 -- 172.21.15.52:0/3985547708 learned_addr learned my addr 172.21.15.52:0/3985547708 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2aa00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc2c0b71c0 0x7fdc2c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc23e00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc2c0d06b0 0x7fdc2c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 -- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc2c0d06b0 msgr2=0x7fdc2c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc2c0d06b0 0x7fdc2c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 -- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc2c0b71c0 msgr2=0x7fdc2c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc2c0b71c0 0x7fdc2c151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.013+0000 7fdc2b400640 1 -- 172.21.15.52:0/3985547708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c0cdad0 con 0x7fdc2c15d060 2024-06-02T16:49:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc2b400640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c730 tx=0x7fdc2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24017070 con 0x7fdc2c15d060 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2400ce40 con 0x7fdc2c15d060 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400a840 con 0x7fdc2c15d060 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c0b4cc0 con 0x7fdc2c15d060 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.014+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c0b5280 con 0x7fdc2c15d060 2024-06-02T16:49:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.015+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c0507e0 con 0x7fdc2c15d060 2024-06-02T16:49:02.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.017+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc2401a070 con 0x7fdc2c15d060 2024-06-02T16:49:02.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.018+0000 7fdc22a00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 0x7fdc08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.018+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fdc24096860 con 0x7fdc2c15d060 2024-06-02T16:49:02.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.019+0000 7fdc2aa00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 0x7fdc08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.020+0000 7fdc2aa00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 0x7fdc08078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c034000 tx=0x7fdc1c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.023+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc2405feb0 con 0x7fdc2c15d060 2024-06-02T16:49:02.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.309+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdc2c0d2ea0 con 0x7fdc2c15d060 2024-06-02T16:49:02.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.310+0000 7fdc22a00640 1 -- 172.21.15.52:0/3985547708 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7fdc240641b0 con 0x7fdc2c15d060 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmkrauNRAAtSub8IGAOmQ8jfF/xTX67A==", 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.309 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmIbxBGRAAG68t8uJC+GuNbFc+SC8/NA==", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:49:02.310 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmjEFeCRAA+YqDS+DB83q8NUpSJ8FO6A==", 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:49:02.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmjpKiJhAAWpU4lunYnPmsz9zy/PDTdg==", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBcoVxmbTuuExAAAzEdHpKz4dpD5YaxsFcPmQ==", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBfoVxmUW6eLhAA0LnI1X4gkZleDKWEsNX3tg==", 2024-06-02T16:49:02.313 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBioVxmAv0SOxAAlLO2sN1rvUm/UC4BoqAtZQ==", 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.314 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBmoVxmw9NuGhAAqFXZzV11Daf/s4vHmrz0Jw==", 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBsoVxmqFpWJRAAOA2Nsp5qjzyy+QUEl17VqA==", 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-06-02T16:49:02.316 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBvoVxmh40YLxAAE/CjbilEWfYvm9s981NWFg==", 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQByoVxmfLmLOxAAKVMtkROjbvvGefI4R322Dw==", 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.317 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB2oVxm4PEpCRAAnsHEBG7RsSY+jEhAyuN9ww==", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.318 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ==", 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxmRyQ6DBAA81tsOoBRr09hbKxgg/1YuQ==", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-06-02T16:49:02.320 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxmHDpvAhAAzdzaT56O4WUkRLNYHP3fnw==", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBaoVxm29IKFhAA3bLnZJX2M0CykpQt+g2JHA==", 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.321 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBXoVxmii5JLxAAkh2TeU4jkTcYDNjHxHNHjA==", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:49:02.322 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmeV9VKhAAWRGPPyEnG/7idTtgebGCKA==", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYoVxmkKoxIBAAqO4kNYlr+tMKK3s4ubHuVA==", 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-06-02T16:49:02.324 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.312+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 msgr2=0x7fdc08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.312+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 0x7fdc08078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c034000 tx=0x7fdc1c02e000 comp rx=0 tx=0).stop 2024-06-02T16:49:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.312+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 msgr2=0x7fdc2c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.312+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c730 tx=0x7fdc2400cbf0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 shutdown_connections 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdc080762d0 0x7fdc08078790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc2c15d060 0x7fdc2c15a660 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc2c0d06b0 0x7fdc2c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 --2- 172.21.15.52:0/3985547708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc2c0b71c0 0x7fdc2c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 >> 172.21.15.52:0/3985547708 conn(0x7fdc2c0740e0 msgr2=0x7fdc2c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 shutdown_connections 2024-06-02T16:49:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.313+0000 7fdc2be00640 1 -- 172.21.15.52:0/3985547708 wait complete. 2024-06-02T16:49:02.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T16:49:02.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.528+0000 7fb1ef200640 1 Processor -- start 2024-06-02T16:49:02.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.528+0000 7fb1ef200640 1 -- start start 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ef200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f013ed60 0x7fb1f006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ef200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1f013f140 0x7fb1f006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ef200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f01416c0 con 0x7fb1f015fc40 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ef200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00d0890 con 0x7fb1f013ed60 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ef200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f0160970 con 0x7fb1f013f140 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ede00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f013ed60 0x7fb1f006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ede00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f013ed60 0x7fb1f006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56252/0 (socket says 172.21.15.52:56252) 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ede00640 1 -- 172.21.15.52:0/3380592083 learned_addr learned my addr 172.21.15.52:0/3380592083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.530+0000 7fb1ee800640 1 --1- 172.21.15.52:0/3380592083 >> v1:172.21.15.52:6789/0 conn(0x7fb1f015fc40 0x7fb1f01600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49526/0 (socket says 172.21.15.52:49526) 2024-06-02T16:49:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1ed400640 1 --2- 172.21.15.52:0/3380592083 >> v2:172.21.15.114:3300/0 conn(0x7fb1f013f140 0x7fb1f006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1ede00640 1 -- 172.21.15.52:0/3380592083 >> v2:172.21.15.114:3300/0 conn(0x7fb1f013f140 msgr2=0x7fb1f006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1ede00640 1 --2- 172.21.15.52:0/3380592083 >> v2:172.21.15.114:3300/0 conn(0x7fb1f013f140 0x7fb1f006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1ede00640 1 -- 172.21.15.52:0/3380592083 >> v1:172.21.15.52:6789/0 conn(0x7fb1f015fc40 legacy=0x7fb1f01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1ede00640 1 -- 172.21.15.52:0/3380592083 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f0141960 con 0x7fb1f013ed60 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.531+0000 7fb1eca00640 1 -- 172.21.15.52:0/3380592083 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460147678 0 0) 0x7fb1f01416c0 con 0x7fb1f015fc40 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.532+0000 7fb1ede00640 1 --2- 172.21.15.52:0/3380592083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f013ed60 0x7fb1f006e130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0156ba0 tx=0x7fb1e002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2526090b339fe795 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.532+0000 7fb1eca00640 1 -- 172.21.15.52:0/3380592083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0036070 con 0x7fb1f013ed60 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.532+0000 7fb1eca00640 1 -- 172.21.15.52:0/3380592083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0031600 con 0x7fb1f013ed60 2024-06-02T16:49:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.532+0000 7fb1eca00640 1 -- 172.21.15.52:0/3380592083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00319d0 con 0x7fb1f013ed60 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 -- 172.21.15.52:0/3380592083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f013ed60 msgr2=0x7fb1f006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 --2- 172.21.15.52:0/3380592083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f013ed60 0x7fb1f006e130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0156ba0 tx=0x7fb1e002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 -- 172.21.15.52:0/3380592083 shutdown_connections 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 --2- 172.21.15.52:0/3380592083 >> v2:172.21.15.114:3300/0 conn(0x7fb1f013f140 0x7fb1f006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 --2- 172.21.15.52:0/3380592083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f013ed60 0x7fb1f006e130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 -- 172.21.15.52:0/3380592083 >> 172.21.15.52:0/3380592083 conn(0x7fb1f006c380 msgr2=0x7fb1f006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 -- 172.21.15.52:0/3380592083 shutdown_connections 2024-06-02T16:49:02.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.533+0000 7fb1ef200640 1 -- 172.21.15.52:0/3380592083 wait complete. 2024-06-02T16:49:02.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.535+0000 7fb1ef200640 1 Processor -- start 2024-06-02T16:49:02.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.535+0000 7fb1ef200640 1 -- start start 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f013ed60 0x7fb1f00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 0x7fb1f00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0142440 con 0x7fb1f00b2720 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0141f20 con 0x7fb1f015fc40 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ef200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f01425c0 con 0x7fb1f013ed60 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56260/0 (socket says 172.21.15.52:56260) 2024-06-02T16:49:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.536+0000 7fb1ee800640 1 -- 172.21.15.52:0/1602649290 learned_addr learned my addr 172.21.15.52:0/1602649290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ede00640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f013ed60 0x7fb1f00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ed400640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 0x7fb1f00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 -- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f013ed60 msgr2=0x7fb1f00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f013ed60 0x7fb1f00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 -- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 msgr2=0x7fb1f00b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 0x7fb1f00b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 -- 172.21.15.52:0/1602649290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00b43e0 con 0x7fb1f00b2720 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ed400640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 0x7fb1f00b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ee800640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c390 tx=0x7fb1e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80074e0 con 0x7fb1f00b2720 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00b46c0 con 0x7fb1f00b2720 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80047e0 con 0x7fb1f00b2720 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.537+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8004b90 con 0x7fb1f00b2720 2024-06-02T16:49:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.538+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00b4c80 con 0x7fb1f00b2720 2024-06-02T16:49:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.539+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f00507e0 con 0x7fb1f00b2720 2024-06-02T16:49:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.540+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb1e8011070 con 0x7fb1f00b2720 2024-06-02T16:49:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.541+0000 7fb1e6000640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 0x7fb1d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.541+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fb1e8096f80 con 0x7fb1f00b2720 2024-06-02T16:49:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.542+0000 7fb1ede00640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 0x7fb1d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.543+0000 7fb1ede00640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 0x7fb1d0078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0033000 tx=0x7fb1e0009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.545+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb1e8060b10 con 0x7fb1f00b2720 2024-06-02T16:49:02.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.757+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb1f0159900 con 0x7fb1f00b2720 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.757+0000 7fb1e6000640 1 -- 172.21.15.52:0/1602649290 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) ==== 84+0+65 (secure 0 0 0) 0x7fb1e8060410 con 0x7fb1f00b2720 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-06-02T16:49:02.756 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-06-02T16:49:02.757 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-06-02T16:49:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.760+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 msgr2=0x7fb1d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.760+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 0x7fb1d0078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0033000 tx=0x7fb1e0009000 comp rx=0 tx=0).stop 2024-06-02T16:49:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.760+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 msgr2=0x7fb1f00b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.760+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c390 tx=0x7fb1e800c850 comp rx=0 tx=0).stop 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 shutdown_connections 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1d00762d0 0x7fb1d0078790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f00b2720 0x7fb1f00b5800 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f015fc40 0x7fb1f00b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 --2- 172.21.15.52:0/1602649290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f013ed60 0x7fb1f00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 >> 172.21.15.52:0/1602649290 conn(0x7fb1f006c380 msgr2=0x7fb1f0072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 shutdown_connections 2024-06-02T16:49:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.761+0000 7fb1ef200640 1 -- 172.21.15.52:0/1602649290 wait complete. 2024-06-02T16:49:02.778 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T16:49:02.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T16:49:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.972+0000 7fb9ffe00640 1 Processor -- start 2024-06-02T16:49:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.972+0000 7fb9ffe00640 1 -- start start 2024-06-02T16:49:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ffe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba0015f570 0x7fba000b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ffe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba000bafd0 0x7fba000d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ffe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba000b8e20 con 0x7fba000b8960 2024-06-02T16:49:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ffe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fba000b9a30 con 0x7fba000bafd0 2024-06-02T16:49:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ffe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fba000b9100 con 0x7fba0015f570 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ff400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba000bafd0 0x7fba000d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ff400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba000bafd0 0x7fba000d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36594/0 (socket says 172.21.15.52:36594) 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.973+0000 7fb9ff400640 1 -- 172.21.15.52:0/2115968726 learned_addr learned my addr 172.21.15.52:0/2115968726 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.974+0000 7fb9fea00640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba0015f570 0x7fba000b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.974+0000 7fb9ff400640 1 -- 172.21.15.52:0/2115968726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba0015f570 msgr2=0x7fba000b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.974+0000 7fb9ff400640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba0015f570 0x7fba000b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.974+0000 7fb9ff400640 1 -- 172.21.15.52:0/2115968726 >> v1:172.21.15.114:6789/0 conn(0x7fba000b8960 legacy=0x7fba000d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.974+0000 7fb9ff400640 1 -- 172.21.15.52:0/2115968726 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba000b93e0 con 0x7fba000bafd0 2024-06-02T16:49:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.975+0000 7fb9ff400640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba000bafd0 0x7fba000d22c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb35ac2d34cd41e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.976+0000 7fb9fd600640 1 -- 172.21.15.52:0/2115968726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037070 con 0x7fba000bafd0 2024-06-02T16:49:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.976+0000 7fb9fd600640 1 -- 172.21.15.52:0/2115968726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8032440 con 0x7fba000bafd0 2024-06-02T16:49:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.976+0000 7fb9fd600640 1 -- 172.21.15.52:0/2115968726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8032810 con 0x7fba000bafd0 2024-06-02T16:49:02.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.976+0000 7fb9ffe00640 1 -- 172.21.15.52:0/2115968726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba000bafd0 msgr2=0x7fba000d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.976+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba000bafd0 0x7fba000d22c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f802a1c0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 -- 172.21.15.52:0/2115968726 shutdown_connections 2024-06-02T16:49:02.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba000bafd0 0x7fba000d22c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/2115968726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba0015f570 0x7fba000b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 -- 172.21.15.52:0/2115968726 >> 172.21.15.52:0/2115968726 conn(0x7fba00073f00 msgr2=0x7fba00074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:02.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 -- 172.21.15.52:0/2115968726 shutdown_connections 2024-06-02T16:49:02.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.977+0000 7fb9ffe00640 1 -- 172.21.15.52:0/2115968726 wait complete. 2024-06-02T16:49:02.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.978+0000 7fb9ffe00640 1 Processor -- start 2024-06-02T16:49:02.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.979+0000 7fb9ffe00640 1 -- start start 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.979+0000 7fb9ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba000b8960 0x7fba001f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.979+0000 7fb9ffe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba000bafd0 0x7fba00161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ffe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba000d2800 con 0x7fba0015f570 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ffe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fba000d3a40 con 0x7fba000b8960 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ffe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fba000d2980 con 0x7fba000bafd0 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36598/0 (socket says 172.21.15.52:36598) 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 -- 172.21.15.52:0/3023207645 learned_addr learned my addr 172.21.15.52:0/3023207645 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9fea00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba000b8960 0x7fba001f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 -- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba000bafd0 msgr2=0x7fba00161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba000bafd0 0x7fba00161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 -- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba000b8960 msgr2=0x7fba001f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:02.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba000b8960 0x7fba001f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:02.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.980+0000 7fb9ff400640 1 -- 172.21.15.52:0/3023207645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0015fba0 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9ff400640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8041020 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8030700 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037040 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0015fe80 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.981+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba00160440 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.982+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba000ba7c0 con 0x7fba0015f570 2024-06-02T16:49:02.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.983+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9f8044020 con 0x7fba0015f570 2024-06-02T16:49:02.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.984+0000 7fb9f6a00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 0x7fb9dc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:02.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.984+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7fb9f80b7a30 con 0x7fba0015f570 2024-06-02T16:49:02.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.985+0000 7fb9fea00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 0x7fb9dc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:02.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.986+0000 7fb9fea00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 0x7fb9dc0787c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0006fd0 tx=0x7fb9f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:02.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:02.989+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fba000ba7c0 con 0x7fba0015f570 2024-06-02T16:49:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.189+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fba000507e0 con 0x7fba0015f570 2024-06-02T16:49:03.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.801+0000 7fb9f6a00640 1 -- 172.21.15.52:0/3023207645 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) ==== 138+0+0 (secure 0 0 0) 0x7fb9f804b030 con 0x7fba0015f570 2024-06-02T16:49:03.801 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-06-02T16:49:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.805+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 msgr2=0x7fb9dc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.805+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 0x7fb9dc0787c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0006fd0 tx=0x7fb9f0008040 comp rx=0 tx=0).stop 2024-06-02T16:49:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.805+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 msgr2=0x7fba00159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.805+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f80046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 shutdown_connections 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb9dc076300 0x7fb9dc0787c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba0015f570 0x7fba00159790 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba000bafd0 0x7fba00161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 --2- 172.21.15.52:0/3023207645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba000b8960 0x7fba001f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 >> 172.21.15.52:0/3023207645 conn(0x7fba00073f00 msgr2=0x7fba000b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:03.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 shutdown_connections 2024-06-02T16:49:03.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:03.806+0000 7fb9ffe00640 1 -- 172.21.15.52:0/3023207645 wait complete. 2024-06-02T16:49:03.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T16:49:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.044+0000 7fca17e00640 1 Processor -- start 2024-06-02T16:49:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.044+0000 7fca17e00640 1 -- start start 2024-06-02T16:49:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca1815d330 0x7fca18073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180734f0 0x7fca18074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca180ade40 0x7fca180ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fca180ae810 con 0x7fca180ade40 2024-06-02T16:49:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fca18070650 con 0x7fca1815d330 2024-06-02T16:49:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.046+0000 7fca17e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fca18072450 con 0x7fca180734f0 2024-06-02T16:49:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca180ade40 0x7fca180ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca180ade40 0x7fca180ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36614/0 (socket says 172.21.15.52:36614) 2024-06-02T16:49:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 -- 172.21.15.52:0/775793900 learned_addr learned my addr 172.21.15.52:0/775793900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca16a00640 1 --2- 172.21.15.52:0/775793900 >> v2:172.21.15.114:3300/0 conn(0x7fca1815d330 0x7fca18073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca16000640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180734f0 0x7fca18074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 -- 172.21.15.52:0/775793900 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180734f0 msgr2=0x7fca18074060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180734f0 0x7fca18074060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 -- 172.21.15.52:0/775793900 >> v2:172.21.15.114:3300/0 conn(0x7fca1815d330 msgr2=0x7fca18073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 --2- 172.21.15.52:0/775793900 >> v2:172.21.15.114:3300/0 conn(0x7fca1815d330 0x7fca18073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.047+0000 7fca17400640 1 -- 172.21.15.52:0/775793900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca18072730 con 0x7fca180ade40 2024-06-02T16:49:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.048+0000 7fca17400640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180ade40 0x7fca180ae2d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca180d1f00 tx=0x7fca1002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44ac3f1ffe4d3ca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.049+0000 7fca15600640 1 -- 172.21.15.52:0/775793900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10036070 con 0x7fca180ade40 2024-06-02T16:49:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.049+0000 7fca15600640 1 -- 172.21.15.52:0/775793900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10031600 con 0x7fca180ade40 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.049+0000 7fca15600640 1 -- 172.21.15.52:0/775793900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100319d0 con 0x7fca180ade40 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 -- 172.21.15.52:0/775793900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180ade40 msgr2=0x7fca180ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180ade40 0x7fca180ae2d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca180d1f00 tx=0x7fca1002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 -- 172.21.15.52:0/775793900 shutdown_connections 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180734f0 0x7fca18074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 --2- 172.21.15.52:0/775793900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180ade40 0x7fca180ae2d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 --2- 172.21.15.52:0/775793900 >> v2:172.21.15.114:3300/0 conn(0x7fca1815d330 0x7fca18073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 -- 172.21.15.52:0/775793900 >> 172.21.15.52:0/775793900 conn(0x7fca180b2b60 msgr2=0x7fca180b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 -- 172.21.15.52:0/775793900 shutdown_connections 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.050+0000 7fca17e00640 1 -- 172.21.15.52:0/775793900 wait complete. 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.052+0000 7fca17e00640 1 Processor -- start 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.053+0000 7fca17e00640 1 -- start start 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180ade40 0x7fca18154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca1815d330 0x7fca1809c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca18072fd0 con 0x7fca180734f0 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fca18072cf0 con 0x7fca1815d330 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fca18160d40 con 0x7fca180ade40 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca16a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca16a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36620/0 (socket says 172.21.15.52:36620) 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca16a00640 1 -- 172.21.15.52:0/403655805 learned_addr learned my addr 172.21.15.52:0/403655805 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca17400640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca1815d330 0x7fca1809c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.054+0000 7fca16000640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180ade40 0x7fca18154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 -- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180ade40 msgr2=0x7fca18154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180ade40 0x7fca18154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 -- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca1815d330 msgr2=0x7fca1809c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca1815d330 0x7fca1809c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 -- 172.21.15.52:0/403655805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca180b4b10 con 0x7fca180734f0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca16a00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d5f0 tx=0x7fca0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080125f0 con 0x7fca180734f0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08019070 con 0x7fca180734f0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080129d0 con 0x7fca180734f0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.055+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca180b4df0 con 0x7fca180734f0 2024-06-02T16:49:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.056+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca180b53b0 con 0x7fca180734f0 2024-06-02T16:49:04.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.057+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca180507e0 con 0x7fca180734f0 2024-06-02T16:49:04.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.058+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca08012b70 con 0x7fca180734f0 2024-06-02T16:49:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.060+0000 7fca0f400640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 0x7fc9f80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.061+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5227+0+0 (secure 0 0 0) 0x7fca080977f0 con 0x7fca180734f0 2024-06-02T16:49:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.061+0000 7fca16000640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 0x7fc9f80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.062+0000 7fca16000640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 0x7fc9f80787c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca1815db60 tx=0x7fca04008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.066+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca08061320 con 0x7fca180734f0 2024-06-02T16:49:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.277+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fca1806d390 con 0x7fca180734f0 2024-06-02T16:49:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.816+0000 7fca0f400640 1 -- 172.21.15.52:0/403655805 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) ==== 170+0+0 (secure 0 0 0) 0x7fca08060c20 con 0x7fca180734f0 2024-06-02T16:49:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-06-02T16:49:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 msgr2=0x7fc9f80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 0x7fc9f80787c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca1815db60 tx=0x7fca04008040 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 msgr2=0x7fca180cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d5f0 tx=0x7fca0800dab0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 shutdown_connections 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc9f8076300 0x7fc9f80787c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca1815d330 0x7fca1809c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca180ade40 0x7fca18154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 --2- 172.21.15.52:0/403655805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca180734f0 0x7fca180cf760 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d5f0 tx=0x7fca0800dab0 comp rx=0 tx=0).stop 2024-06-02T16:49:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.820+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 >> 172.21.15.52:0/403655805 conn(0x7fca180b2b60 msgr2=0x7fca1806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.823+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 shutdown_connections 2024-06-02T16:49:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:04.823+0000 7fca17e00640 1 -- 172.21.15.52:0/403655805 wait complete. 2024-06-02T16:49:04.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T16:49:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.046+0000 7fc3f1600640 1 Processor -- start 2024-06-02T16:49:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.046+0000 7fc3f1600640 1 -- start start 2024-06-02T16:49:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3f1600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3ec15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3f1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3ec15ec80 0x7fc3ec15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3f1600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec09eec0 con 0x7fc3ec0b0610 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3f1600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ec06ebd0 con 0x7fc3ec15ec80 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3f1600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ec15e490 con 0x7fc3ec0ae5c0 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3eaa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc3ec0b0610 0x7fc3ec0adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43892/0 (socket says 172.21.15.52:43892) 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3eaa00640 1 -- 172.21.15.52:0/1901780153 learned_addr learned my addr 172.21.15.52:0/1901780153 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.048+0000 7fc3ea000640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3ec15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3eb400640 1 --2- 172.21.15.52:0/1901780153 >> v2:172.21.15.114:3300/0 conn(0x7fc3ec15ec80 0x7fc3ec15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271756505 0 0) 0x7fc3ec09eec0 con 0x7fc3ec0b0610 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3ec0b0610 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3224357000 0 0) 0x7fc3d0003520 con 0x7fc3ec0b0610 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 msgr2=0x7fc3ec15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3ec15d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 >> v2:172.21.15.114:3300/0 conn(0x7fc3ec15ec80 msgr2=0x7fc3ec15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 --2- 172.21.15.52:0/1901780153 >> v2:172.21.15.114:3300/0 conn(0x7fc3ec15ec80 0x7fc3ec15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec15e770 con 0x7fc3ec0b0610 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fc3dc0016f0 con 0x7fc3ec0b0610 2024-06-02T16:49:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 >> v1:172.21.15.52:6789/0 conn(0x7fc3ec0b0610 legacy=0x7fc3ec0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3d0003a00 0x7fc3d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0004d40 0x7fc3d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec06ebd0 con 0x7fc3d0003a00 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec15e490 con 0x7fc3d0004d40 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.049+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d000ba40 con 0x7fc3ec0ae5c0 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3d0003a00 0x7fc3d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3ea000640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 -- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 msgr2=0x7fc3d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec0ae5c0 0x7fc3d0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 -- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0004d40 msgr2=0x7fc3d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0004d40 0x7fc3d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.050+0000 7fc3eaa00640 1 -- 172.21.15.52:0/1901780153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d0003520 con 0x7fc3d0003a00 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.051+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3d0003a00 0x7fc3d0003e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c210 tx=0x7fc3d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4920ba36e2c14a82 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.051+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007d50 con 0x7fc3d0003a00 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.051+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3dc005ad0 con 0x7fc3d0003a00 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.051+0000 7fc3e9600640 1 -- 172.21.15.52:0/1901780153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007070 con 0x7fc3d0003a00 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 -- 172.21.15.52:0/1901780153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3d0003a00 msgr2=0x7fc3d0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 --2- 172.21.15.52:0/1901780153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3d0003a00 0x7fc3d0003e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c210 tx=0x7fc3d0005830 comp rx=0 tx=0).stop 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3eb400640 1 -- 172.21.15.52:0/1901780153 reap_dead start 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 -- 172.21.15.52:0/1901780153 shutdown_connections 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 -- 172.21.15.52:0/1901780153 >> 172.21.15.52:0/1901780153 conn(0x7fc3ec0b3200 msgr2=0x7fc3ec0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 -- 172.21.15.52:0/1901780153 shutdown_connections 2024-06-02T16:49:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.052+0000 7fc3f1600640 1 -- 172.21.15.52:0/1901780153 wait complete. 2024-06-02T16:49:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.054+0000 7fc3f1600640 1 Processor -- start 2024-06-02T16:49:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.054+0000 7fc3f1600640 1 -- start start 2024-06-02T16:49:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0003a00 0x7fc3ec072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec14c960 0x7fc3ec0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec15d8b0 con 0x7fc3ec0b5780 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec06e860 con 0x7fc3d0003a00 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.055+0000 7fc3f1600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ec15da30 con 0x7fc3ec14c960 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36630/0 (socket says 172.21.15.52:36630) 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 -- 172.21.15.52:0/3737639335 learned_addr learned my addr 172.21.15.52:0/3737639335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3ea000640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec14c960 0x7fc3ec0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0003a00 0x7fc3ec072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 -- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec14c960 msgr2=0x7fc3ec0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec14c960 0x7fc3ec0b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 -- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0003a00 msgr2=0x7fc3ec072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0003a00 0x7fc3ec072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.056+0000 7fc3eb400640 1 -- 172.21.15.52:0/3737639335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec09bd10 con 0x7fc3ec0b5780 2024-06-02T16:49:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3eb400640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec070860 tx=0x7fc3e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400bd10 con 0x7fc3ec0b5780 2024-06-02T16:49:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e401a070 con 0x7fc3ec0b5780 2024-06-02T16:49:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4014640 con 0x7fc3ec0b5780 2024-06-02T16:49:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec09bff0 con 0x7fc3ec0b5780 2024-06-02T16:49:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.057+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec09c5b0 con 0x7fc3ec0b5780 2024-06-02T16:49:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.058+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec069520 con 0x7fc3ec0b5780 2024-06-02T16:49:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.060+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3e4005d10 con 0x7fc3ec0b5780 2024-06-02T16:49:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.061+0000 7fc3e2a00640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 0x7fc3cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.061+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5609+0+0 (secure 0 0 0) 0x7fc3e4097810 con 0x7fc3ec0b5780 2024-06-02T16:49:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.062+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 0x7fc3cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.063+0000 7fc3eaa00640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 0x7fc3cc0787c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc032000 tx=0x7fc3dc02d000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.066+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3e4024020 con 0x7fc3ec0b5780 2024-06-02T16:49:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.319+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc3ec0b3fd0 con 0x7fc3ec0b5780 2024-06-02T16:49:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.820+0000 7fc3e2a00640 1 -- 172.21.15.52:0/3737639335 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7fc3e4061130 con 0x7fc3ec0b5780 2024-06-02T16:49:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 6 and data pool 7 2024-06-02T16:49:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 msgr2=0x7fc3cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 0x7fc3cc0787c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc032000 tx=0x7fc3dc02d000 comp rx=0 tx=0).stop 2024-06-02T16:49:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 msgr2=0x7fc3ec073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec070860 tx=0x7fc3e400b480 comp rx=0 tx=0).stop 2024-06-02T16:49:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 shutdown_connections 2024-06-02T16:49:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc3cc076300 0x7fc3cc0787c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3ec0b5780 0x7fc3ec073650 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3ec14c960 0x7fc3ec0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 --2- 172.21.15.52:0/3737639335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3d0003a00 0x7fc3ec072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.824+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 >> 172.21.15.52:0/3737639335 conn(0x7fc3ec0b3200 msgr2=0x7fc3ec15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.825+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 shutdown_connections 2024-06-02T16:49:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:05.825+0000 7fc3f1600640 1 -- 172.21.15.52:0/3737639335 wait complete. 2024-06-02T16:49:05.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:05.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:49:05.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:49:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.044+0000 7f130ce00640 1 Processor -- start 2024-06-02T16:49:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.044+0000 7f130ce00640 1 -- start start 2024-06-02T16:49:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.045+0000 7f130ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f130815d090 0x7f1308160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.045+0000 7f130ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1308070f30 0x7f13080afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.045+0000 7f130ce00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13080b6e80 con 0x7f130806ee90 2024-06-02T16:49:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.045+0000 7f130ce00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f130806f370 con 0x7f130815d090 2024-06-02T16:49:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.045+0000 7f130ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f130806f650 con 0x7f1308070f30 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f130815d090 0x7f1308160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f130806ee90 0x7f1308070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43904/0 (socket says 172.21.15.52:43904) 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305400640 1 -- 172.21.15.52:0/2346679188 learned_addr learned my addr 172.21.15.52:0/2346679188 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f130815d090 0x7f1308160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36634/0 (socket says 172.21.15.52:36634) 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1306800640 1 --2- 172.21.15.52:0/2346679188 >> v2:172.21.15.114:3300/0 conn(0x7f1308070f30 0x7f13080afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 -- 172.21.15.52:0/2346679188 >> v2:172.21.15.114:3300/0 conn(0x7f1308070f30 msgr2=0x7f13080afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 --2- 172.21.15.52:0/2346679188 >> v2:172.21.15.114:3300/0 conn(0x7f1308070f30 0x7f13080afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 -- 172.21.15.52:0/2346679188 >> v1:172.21.15.52:6789/0 conn(0x7f130806ee90 legacy=0x7f1308070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.046+0000 7f1305e00640 1 -- 172.21.15.52:0/2346679188 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130806f930 con 0x7f130815d090 2024-06-02T16:49:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.048+0000 7f1305e00640 1 --2- 172.21.15.52:0/2346679188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130815d090 0x7f1308160470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f13080633a0 tx=0x7f12f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71139e8dba01363 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.048+0000 7f1304a00640 1 -- 172.21.15.52:0/2346679188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8037070 con 0x7f130815d090 2024-06-02T16:49:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.048+0000 7f1304a00640 1 -- 172.21.15.52:0/2346679188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f8032440 con 0x7f130815d090 2024-06-02T16:49:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.048+0000 7f1304a00640 1 -- 172.21.15.52:0/2346679188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8032810 con 0x7f130815d090 2024-06-02T16:49:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 -- 172.21.15.52:0/2346679188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130815d090 msgr2=0x7f1308160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 --2- 172.21.15.52:0/2346679188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130815d090 0x7f1308160470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f13080633a0 tx=0x7f12f802a1a0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 -- 172.21.15.52:0/2346679188 shutdown_connections 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 --2- 172.21.15.52:0/2346679188 >> v2:172.21.15.114:3300/0 conn(0x7f1308070f30 0x7f13080afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 --2- 172.21.15.52:0/2346679188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130815d090 0x7f1308160470 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 -- 172.21.15.52:0/2346679188 >> 172.21.15.52:0/2346679188 conn(0x7f1308073b70 msgr2=0x7f130806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 -- 172.21.15.52:0/2346679188 shutdown_connections 2024-06-02T16:49:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.049+0000 7f130ce00640 1 -- 172.21.15.52:0/2346679188 wait complete. 2024-06-02T16:49:06.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.051+0000 7f130ce00640 1 Processor -- start 2024-06-02T16:49:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.051+0000 7f130ce00640 1 -- start start 2024-06-02T16:49:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1308070f30 0x7f13080d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f130815d090 0x7f1308141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13080aff90 con 0x7f130806ee90 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f130806fef0 con 0x7f1308070f30 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.052+0000 7f130ce00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f13080b0110 con 0x7f130815d090 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36650/0 (socket says 172.21.15.52:36650) 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 -- 172.21.15.52:0/1439464703 learned_addr learned my addr 172.21.15.52:0/1439464703 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305400640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1308070f30 0x7f13080d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 -- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f130815d090 msgr2=0x7f1308141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f130815d090 0x7f1308141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 -- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1308070f30 msgr2=0x7f13080d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1308070f30 0x7f13080d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 -- 172.21.15.52:0/1439464703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13080d1620 con 0x7f130806ee90 2024-06-02T16:49:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.053+0000 7f1305e00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009890 tx=0x7f12f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.054+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8037040 con 0x7f130806ee90 2024-06-02T16:49:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.054+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f8042070 con 0x7f130806ee90 2024-06-02T16:49:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.054+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13080d0040 con 0x7f130806ee90 2024-06-02T16:49:06.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.054+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f803b950 con 0x7f130806ee90 2024-06-02T16:49:06.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.054+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13080d0600 con 0x7f130806ee90 2024-06-02T16:49:06.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.055+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1308069520 con 0x7f130806ee90 2024-06-02T16:49:06.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.056+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f12f803baf0 con 0x7f130806ee90 2024-06-02T16:49:06.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.057+0000 7f12fe000640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 0x7f12e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.057+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f12f80b7ed0 con 0x7f130806ee90 2024-06-02T16:49:06.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.058+0000 7f1305400640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 0x7f12e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.059+0000 7f1305400640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 0x7f12e80787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1308155950 tx=0x7f12f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.062+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f12f8081790 con 0x7f130806ee90 2024-06-02T16:49:06.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.274+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1308071470 con 0x7f130806ee90 2024-06-02T16:49:06.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.278+0000 7f12fe000640 1 -- 172.21.15.52:0/1439464703 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16626 (secure 0 0 0) 0x7f12f8081090 con 0x7f130806ee90 2024-06-02T16:49:06.277 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:06.277 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":47,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:05.320480+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:49:03.203481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-06-02T16:49:04.293800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 msgr2=0x7f12e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 0x7f12e80787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1308155950 tx=0x7f12f4009040 comp rx=0 tx=0).stop 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 msgr2=0x7f13080cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009890 tx=0x7f12f80046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 shutdown_connections 2024-06-02T16:49:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12e8076300 0x7f12e80787c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f130815d090 0x7f1308141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1308070f30 0x7f13080d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 --2- 172.21.15.52:0/1439464703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f130806ee90 0x7f13080cfa40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 >> 172.21.15.52:0/1439464703 conn(0x7f1308073b70 msgr2=0x7f130815e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.280+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 shutdown_connections 2024-06-02T16:49:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.281+0000 7f130ce00640 1 -- 172.21.15.52:0/1439464703 wait complete. 2024-06-02T16:49:06.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:06.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.505+0000 7f12b9600640 1 Processor -- start 2024-06-02T16:49:06.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.505+0000 7f12b9600640 1 -- start start 2024-06-02T16:49:06.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.507+0000 7f12b9600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f12b40cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.507+0000 7f12b9600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b40cf2f0 con 0x7f12b4160f30 2024-06-02T16:49:06.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b9600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b415d790 con 0x7f12b40b1120 2024-06-02T16:49:06.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b9600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f12b415eaf0 con 0x7f12b415d3b0 2024-06-02T16:49:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f12b4160f30 0x7f12b40cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43912/0 (socket says 172.21.15.52:43912) 2024-06-02T16:49:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b3400640 1 -- 172.21.15.52:0/3191956420 learned_addr learned my addr 172.21.15.52:0/3191956420 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b2a00640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f12b40cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037379722 0 0) 0x7f12b40cf2f0 con 0x7f12b4160f30 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.508+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1298003520 con 0x7f12b4160f30 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1886737187 0 0) 0x7f1298003520 con 0x7f12b4160f30 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 msgr2=0x7f12b40cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f12b40cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 >> v1:172.21.15.114:6789/0 conn(0x7f12b40b1120 legacy=0x7f12b40ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b415da50 con 0x7f12b4160f30 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f12ac001a70 con 0x7f12b4160f30 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 >> v1:172.21.15.52:6789/0 conn(0x7f12b4160f30 legacy=0x7f12b40cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298003a30 0x7f1298003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1298004800 0x7f1298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f1298005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b415eaf0 con 0x7f1298004800 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f129800bb80 con 0x7f1298003a30 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f129800bd80 con 0x7f12b415d3b0 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.509+0000 7f12aa000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1298004800 0x7f1298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12b2a00640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298003a30 0x7f1298003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12b3400640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f1298005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12aa000640 1 -- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 msgr2=0x7f1298005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12aa000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f1298005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12aa000640 1 -- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298003a30 msgr2=0x7f1298003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12aa000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298003a30 0x7f1298003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12aa000640 1 -- 172.21.15.52:0/3191956420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1298003520 con 0x7f1298004800 2024-06-02T16:49:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.510+0000 7f12b3400640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b415d3b0 0x7f1298005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12aa000640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1298004800 0x7f1298004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f129c001760 tx=0x7f1298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1b8053f0a17936 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0013b0 con 0x7f1298004800 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0052d0 con 0x7f1298004800 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12b2000640 1 -- 172.21.15.52:0/3191956420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c02aaa0 con 0x7f1298004800 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12b9600640 1 -- 172.21.15.52:0/3191956420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1298004800 msgr2=0x7f1298004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.511+0000 7f12b9600640 1 --2- 172.21.15.52:0/3191956420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1298004800 0x7f1298004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f129c001760 tx=0x7f1298005830 comp rx=0 tx=0).stop 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.512+0000 7f12b3400640 1 -- 172.21.15.52:0/3191956420 reap_dead start 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.512+0000 7f12b9600640 1 -- 172.21.15.52:0/3191956420 shutdown_connections 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.512+0000 7f12b9600640 1 -- 172.21.15.52:0/3191956420 >> 172.21.15.52:0/3191956420 conn(0x7f12b4073b70 msgr2=0x7f12b406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.512+0000 7f12b9600640 1 -- 172.21.15.52:0/3191956420 shutdown_connections 2024-06-02T16:49:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.512+0000 7f12b9600640 1 -- 172.21.15.52:0/3191956420 wait complete. 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.513+0000 7f12b9600640 1 Processor -- start 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.514+0000 7f12b9600640 1 -- start start 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298004800 0x7f12b4149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 0x7f12b4070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b415e2f0 con 0x7f12b4145bd0 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f12b415e010 con 0x7f1298004800 2024-06-02T16:49:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b9600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f12b415e5d0 con 0x7f12b40704f0 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36668/0 (socket says 172.21.15.52:36668) 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 -- 172.21.15.52:0/2408966034 learned_addr learned my addr 172.21.15.52:0/2408966034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b2a00640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298004800 0x7f12b4149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b3400640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 0x7f12b4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 -- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 msgr2=0x7f12b4070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 0x7f12b4070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 -- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298004800 msgr2=0x7f12b4149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298004800 0x7f12b4149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12aa000640 1 -- 172.21.15.52:0/2408966034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40af100 con 0x7f12b4145bd0 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.515+0000 7f12b3400640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 0x7f12b4070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12aa000640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f129c001880 tx=0x7f129c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c040020 con 0x7f12b4145bd0 2024-06-02T16:49:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c005480 con 0x7f12b4145bd0 2024-06-02T16:49:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0069e0 con 0x7f12b4145bd0 2024-06-02T16:49:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b40af3e0 con 0x7f12b4145bd0 2024-06-02T16:49:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.516+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b40af9a0 con 0x7f12b4145bd0 2024-06-02T16:49:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.517+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b4069520 con 0x7f12b4145bd0 2024-06-02T16:49:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.519+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f129c043020 con 0x7f12b4145bd0 2024-06-02T16:49:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.520+0000 7f12ab400640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 0x7f1290078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.520+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f129c0b7570 con 0x7f12b4145bd0 2024-06-02T16:49:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.520+0000 7f12b2a00640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 0x7f1290078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.521+0000 7f12b2a00640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 0x7f1290078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009a10 tx=0x7f12a4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.524+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f129c04a030 con 0x7f12b4145bd0 2024-06-02T16:49:06.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.735+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12b415f0e0 con 0x7f12b4145bd0 2024-06-02T16:49:06.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.736+0000 7f12ab400640 1 -- 172.21.15.52:0/2408966034 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16626 (secure 0 0 0) 0x7f129c0b5e20 con 0x7f12b4145bd0 2024-06-02T16:49:06.735 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:06.735 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":47,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:05.320480+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:49:03.203481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-06-02T16:49:04.293800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 msgr2=0x7f1290078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 0x7f1290078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009a10 tx=0x7f12a4008040 comp rx=0 tx=0).stop 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 msgr2=0x7f12b40ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f129c001880 tx=0x7f129c001120 comp rx=0 tx=0).stop 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 shutdown_connections 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f12900762d0 0x7f1290078790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f12b40704f0 0x7f12b4070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b4145bd0 0x7f12b40ae7f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 --2- 172.21.15.52:0/2408966034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1298004800 0x7f12b4149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 >> 172.21.15.52:0/2408966034 conn(0x7f12b4073b70 msgr2=0x7f12b40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 shutdown_connections 2024-06-02T16:49:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.739+0000 7f12b9600640 1 -- 172.21.15.52:0/2408966034 wait complete. 2024-06-02T16:49:06.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T16:49:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.965+0000 7f1d2b400640 1 Processor -- start 2024-06-02T16:49:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.965+0000 7f1d2b400640 1 -- start start 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1d240b0610 0x7f1d240adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415ec80 0x7f1d240ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d2415d8b0 0x7f1d2415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2406ebd0 con 0x7f1d2415d8b0 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2415e240 con 0x7f1d240b0610 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d2b400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2409eec0 con 0x7f1d2415ec80 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d29400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d2415d8b0 0x7f1d2415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d29400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d2415d8b0 0x7f1d2415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36678/0 (socket says 172.21.15.52:36678) 2024-06-02T16:49:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.967+0000 7f1d29400640 1 -- 172.21.15.52:0/2259745949 learned_addr learned my addr 172.21.15.52:0/2259745949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d23e00640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415ec80 0x7f1d240ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d28a00640 1 --2- 172.21.15.52:0/2259745949 >> v2:172.21.15.114:3300/0 conn(0x7f1d240b0610 0x7f1d240adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d29400640 1 -- 172.21.15.52:0/2259745949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415ec80 msgr2=0x7f1d240ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d29400640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415ec80 0x7f1d240ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d29400640 1 -- 172.21.15.52:0/2259745949 >> v2:172.21.15.114:3300/0 conn(0x7f1d240b0610 msgr2=0x7f1d240adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d29400640 1 --2- 172.21.15.52:0/2259745949 >> v2:172.21.15.114:3300/0 conn(0x7f1d240b0610 0x7f1d240adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.968+0000 7f1d29400640 1 -- 172.21.15.52:0/2259745949 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2415e490 con 0x7f1d2415d8b0 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.969+0000 7f1d29400640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2415d8b0 0x7f1d2415dd00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b3c20 tx=0x7f1d1c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b97fae47f58dee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.970+0000 7f1d23400640 1 -- 172.21.15.52:0/2259745949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c036070 con 0x7f1d2415d8b0 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.970+0000 7f1d23400640 1 -- 172.21.15.52:0/2259745949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d1c031600 con 0x7f1d2415d8b0 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.970+0000 7f1d23400640 1 -- 172.21.15.52:0/2259745949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0319d0 con 0x7f1d2415d8b0 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.970+0000 7f1d2b400640 1 -- 172.21.15.52:0/2259745949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2415d8b0 msgr2=0x7f1d2415dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.970+0000 7f1d2b400640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2415d8b0 0x7f1d2415dd00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b3c20 tx=0x7f1d1c02a610 comp rx=0 tx=0).stop 2024-06-02T16:49:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 -- 172.21.15.52:0/2259745949 shutdown_connections 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415ec80 0x7f1d240ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 --2- 172.21.15.52:0/2259745949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2415d8b0 0x7f1d2415dd00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 --2- 172.21.15.52:0/2259745949 >> v2:172.21.15.114:3300/0 conn(0x7f1d240b0610 0x7f1d240adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 -- 172.21.15.52:0/2259745949 >> 172.21.15.52:0/2259745949 conn(0x7f1d240b3200 msgr2=0x7f1d240d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 -- 172.21.15.52:0/2259745949 shutdown_connections 2024-06-02T16:49:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.971+0000 7f1d2b400640 1 -- 172.21.15.52:0/2259745949 wait complete. 2024-06-02T16:49:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.972+0000 7f1d2b400640 1 Processor -- start 2024-06-02T16:49:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.972+0000 7f1d2b400640 1 -- start start 2024-06-02T16:49:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415d8b0 0x7f1d241571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d2415ec80 0x7f1d24072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2406e860 con 0x7f1d240b0610 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2406e580 con 0x7f1d2415ec80 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.973+0000 7f1d2b400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f1d241600e0 con 0x7f1d2415d8b0 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36686/0 (socket says 172.21.15.52:36686) 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 -- 172.21.15.52:0/3353097253 learned_addr learned my addr 172.21.15.52:0/3353097253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 -- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415d8b0 msgr2=0x7f1d241571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415d8b0 0x7f1d241571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 -- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d2415ec80 msgr2=0x7f1d24072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d2415ec80 0x7f1d24072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 -- 172.21.15.52:0/3353097253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d24157c60 con 0x7f1d240b0610 2024-06-02T16:49:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.974+0000 7f1d28a00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800d830 tx=0x7f1d1800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.975+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18018020 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.975+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d180096a0 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.975+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d24157f40 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.975+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18009a70 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.975+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d24158500 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.976+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d24069520 con 0x7f1d240b0610 2024-06-02T16:49:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.977+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d1801b020 con 0x7f1d240b0610 2024-06-02T16:49:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.978+0000 7f1d20c00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 0x7f1d04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.978+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f1d18097e30 con 0x7f1d240b0610 2024-06-02T16:49:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.979+0000 7f1d23e00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 0x7f1d04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.980+0000 7f1d23e00640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 0x7f1d04078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d10006fd0 tx=0x7f1d10008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:06.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:06.983+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1d18022020 con 0x7f1d240b0610 2024-06-02T16:49:07.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.224+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1d240b3fd0 con 0x7f1d240b0610 2024-06-02T16:49:07.785 INFO:tasks.ceph.mds.d.smithi114.stderr:2024-06-02T16:49:07.786+0000 7fc623600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T16:49:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.850+0000 7f1d20c00640 1 -- 172.21.15.52:0/3353097253 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f1d18009e20 con 0x7f1d240b0610 2024-06-02T16:49:07.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 msgr2=0x7f1d04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 0x7f1d04078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1d10006fd0 tx=0x7f1d10008040 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 msgr2=0x7f1d2414f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800d830 tx=0x7f1d1800dcf0 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 shutdown_connections 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f1d040762d0 0x7f1d04078790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d2415ec80 0x7f1d24072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d2415d8b0 0x7f1d241571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 --2- 172.21.15.52:0/3353097253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d240b0610 0x7f1d2414f670 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 >> 172.21.15.52:0/3353097253 conn(0x7f1d240b3200 msgr2=0x7f1d2406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 shutdown_connections 2024-06-02T16:49:07.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:07.854+0000 7f1d2b400640 1 -- 172.21.15.52:0/3353097253 wait complete. 2024-06-02T16:49:07.878 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T16:49:07.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T16:49:08.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.093+0000 7fb81d000640 1 Processor -- start 2024-06-02T16:49:08.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.093+0000 7fb81d000640 1 -- start start 2024-06-02T16:49:08.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb81d000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb818157960 0x7fb81815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb81d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8180d1190 0x7fb818142e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb81d000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8181437c0 con 0x7fb818142990 2024-06-02T16:49:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb81d000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb818140650 con 0x7fb8180d1190 2024-06-02T16:49:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb81d000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb81815e780 con 0x7fb818157960 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.095+0000 7fb817e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8180d1190 0x7fb818142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8180d1190 0x7fb818142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36698/0 (socket says 172.21.15.52:36698) 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 -- 172.21.15.52:0/3075634553 learned_addr learned my addr 172.21.15.52:0/3075634553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817400640 1 --2- 172.21.15.52:0/3075634553 >> v2:172.21.15.114:3300/0 conn(0x7fb818157960 0x7fb81815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 -- 172.21.15.52:0/3075634553 >> v2:172.21.15.114:3300/0 conn(0x7fb818157960 msgr2=0x7fb81815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 --2- 172.21.15.52:0/3075634553 >> v2:172.21.15.114:3300/0 conn(0x7fb818157960 0x7fb81815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 -- 172.21.15.52:0/3075634553 >> v1:172.21.15.114:6789/0 conn(0x7fb818142990 legacy=0x7fb818160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.096+0000 7fb817e00640 1 -- 172.21.15.52:0/3075634553 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb818072c70 con 0x7fb8180d1190 2024-06-02T16:49:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.097+0000 7fb817e00640 1 --2- 172.21.15.52:0/3075634553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8180d1190 0x7fb818142e40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb818075e40 tx=0x7fb81002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439ed86554a78827 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb816a00640 1 -- 172.21.15.52:0/3075634553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810036070 con 0x7fb8180d1190 2024-06-02T16:49:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb816a00640 1 -- 172.21.15.52:0/3075634553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb810031600 con 0x7fb8180d1190 2024-06-02T16:49:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb816a00640 1 -- 172.21.15.52:0/3075634553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8100319d0 con 0x7fb8180d1190 2024-06-02T16:49:08.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 -- 172.21.15.52:0/3075634553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8180d1190 msgr2=0x7fb818142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 --2- 172.21.15.52:0/3075634553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8180d1190 0x7fb818142e40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb818075e40 tx=0x7fb81002a610 comp rx=0 tx=0).stop 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 -- 172.21.15.52:0/3075634553 shutdown_connections 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 --2- 172.21.15.52:0/3075634553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8180d1190 0x7fb818142e40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 --2- 172.21.15.52:0/3075634553 >> v2:172.21.15.114:3300/0 conn(0x7fb818157960 0x7fb81815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.098+0000 7fb81d000640 1 -- 172.21.15.52:0/3075634553 >> 172.21.15.52:0/3075634553 conn(0x7fb8180b6cc0 msgr2=0x7fb81806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.099+0000 7fb81d000640 1 -- 172.21.15.52:0/3075634553 shutdown_connections 2024-06-02T16:49:08.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.099+0000 7fb81d000640 1 -- 172.21.15.52:0/3075634553 wait complete. 2024-06-02T16:49:08.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.100+0000 7fb81d000640 1 Processor -- start 2024-06-02T16:49:08.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.100+0000 7fb81d000640 1 -- start start 2024-06-02T16:49:08.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.101+0000 7fb81d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 0x7fb8180b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb81d000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 0x7fb8181f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb81d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb81d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb818073510 con 0x7fb818157960 2024-06-02T16:49:08.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb81d000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb818073230 con 0x7fb8180d1190 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb81d000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb818072820 con 0x7fb818142990 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36702/0 (socket says 172.21.15.52:36702) 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 -- 172.21.15.52:0/1498976037 learned_addr learned my addr 172.21.15.52:0/1498976037 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817400640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 0x7fb8180b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb80fe00640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 0x7fb8181f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 -- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 msgr2=0x7fb8181f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 0x7fb8181f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 -- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 msgr2=0x7fb8180b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.102+0000 7fb817e00640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 0x7fb8180b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb817e00640 1 -- 172.21.15.52:0/1498976037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb818156490 con 0x7fb818157960 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb80fe00640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 0x7fb8181f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:08.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb817400640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 0x7fb8180b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:08.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb817e00640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb81002ac00 tx=0x7fb810004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:08.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81003f020 con 0x7fb818157960 2024-06-02T16:49:08.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb810037040 con 0x7fb818157960 2024-06-02T16:49:08.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810036070 con 0x7fb818157960 2024-06-02T16:49:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8180b3ef0 con 0x7fb818157960 2024-06-02T16:49:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.103+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8180b44b0 con 0x7fb818157960 2024-06-02T16:49:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.104+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8180507e0 con 0x7fb818157960 2024-06-02T16:49:08.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.106+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb810042020 con 0x7fb818157960 2024-06-02T16:49:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.107+0000 7fb80f400640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 0x7fb7f40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:08.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.108+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fb8100b8380 con 0x7fb818157960 2024-06-02T16:49:08.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.108+0000 7fb817400640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 0x7fb7f40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:08.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.109+0000 7fb817400640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 0x7fb7f40787c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:08.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.110+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb810049020 con 0x7fb818157960 2024-06-02T16:49:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.365+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb81815de30 con 0x7fb818157960 2024-06-02T16:49:08.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.874+0000 7fb80f400640 1 -- 172.21.15.52:0/1498976037 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fb810081cc0 con 0x7fb818157960 2024-06-02T16:49:08.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.877+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 msgr2=0x7fb7f40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:08.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.877+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 0x7fb7f40787c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808008040 comp rx=0 tx=0).stop 2024-06-02T16:49:08.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.877+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 msgr2=0x7fb8180b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:08.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.877+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb81002ac00 tx=0x7fb810004a40 comp rx=0 tx=0).stop 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 shutdown_connections 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb7f4076300 0x7fb7f40787c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb818157960 0x7fb8180b1ef0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb818142990 0x7fb8181f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 --2- 172.21.15.52:0/1498976037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8180d1190 0x7fb8180b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 >> 172.21.15.52:0/1498976037 conn(0x7fb8180b6cc0 msgr2=0x7fb8180ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 shutdown_connections 2024-06-02T16:49:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:08.878+0000 7fb81d000640 1 -- 172.21.15.52:0/1498976037 wait complete. 2024-06-02T16:49:08.899 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T16:49:08.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:09.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.105+0000 7f4688a00640 1 Processor -- start 2024-06-02T16:49:09.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.105+0000 7f4688a00640 1 -- start start 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.106+0000 7f4688a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 0x7f46840d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.106+0000 7f4688a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46841607c0 con 0x7f46840d06b0 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.106+0000 7f4688a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4684163040 con 0x7f46840b7390 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.106+0000 7f4688a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4684163c50 con 0x7f468415d060 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.107+0000 7f4682a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f46840d06b0 0x7f46840b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43926/0 (socket says 172.21.15.52:43926) 2024-06-02T16:49:09.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.107+0000 7f4682a00640 1 -- 172.21.15.52:0/2623462702 learned_addr learned my addr 172.21.15.52:0/2623462702 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:09.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.107+0000 7f4683400640 1 --2- 172.21.15.52:0/2623462702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 0x7f46840d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.107+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960789079 0 0) 0x7f46841607c0 con 0x7f46840d06b0 2024-06-02T16:49:09.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.108+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4664003520 con 0x7f46840d06b0 2024-06-02T16:49:09.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.108+0000 7f4683400640 1 -- 172.21.15.52:0/2623462702 >> v1:172.21.15.114:6789/0 conn(0x7f46840b7390 legacy=0x7f46840ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.108+0000 7f4683400640 1 -- 172.21.15.52:0/2623462702 >> v1:172.21.15.52:6789/0 conn(0x7f46840d06b0 legacy=0x7f46840b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.108+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1538835096 0 0) 0x7f4664003520 con 0x7f46840d06b0 2024-06-02T16:49:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.108+0000 7f4683400640 1 -- 172.21.15.52:0/2623462702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4684163320 con 0x7f468415d060 2024-06-02T16:49:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.109+0000 7f4683400640 1 --2- 172.21.15.52:0/2623462702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 0x7f46840d0170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46740097d0 tx=0x7f467402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341832a0f0e7be46 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674037070 con 0x7f468415d060 2024-06-02T16:49:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674032440 con 0x7f468415d060 2024-06-02T16:49:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4682000640 1 -- 172.21.15.52:0/2623462702 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740327f0 con 0x7f468415d060 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 -- 172.21.15.52:0/2623462702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 msgr2=0x7f46840d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 --2- 172.21.15.52:0/2623462702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 0x7f46840d0170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46740097d0 tx=0x7f467402a210 comp rx=0 tx=0).stop 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 -- 172.21.15.52:0/2623462702 shutdown_connections 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 --2- 172.21.15.52:0/2623462702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f468415d060 0x7f46840d0170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 -- 172.21.15.52:0/2623462702 >> 172.21.15.52:0/2623462702 conn(0x7f46840740e0 msgr2=0x7f46840d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.110+0000 7f4688a00640 1 -- 172.21.15.52:0/2623462702 shutdown_connections 2024-06-02T16:49:09.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.111+0000 7f4688a00640 1 -- 172.21.15.52:0/2623462702 wait complete. 2024-06-02T16:49:09.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.112+0000 7f4688a00640 1 Processor -- start 2024-06-02T16:49:09.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.112+0000 7f4688a00640 1 -- start start 2024-06-02T16:49:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46840b7390 0x7f4684159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46840d06b0 0x7f4684156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46840d4280 con 0x7f468415d060 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46841638e0 con 0x7f46840d06b0 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.113+0000 7f4688a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f46840d4400 con 0x7f46840b7390 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36704/0 (socket says 172.21.15.52:36704) 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 -- 172.21.15.52:0/1883950057 learned_addr learned my addr 172.21.15.52:0/1883950057 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683400640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46840b7390 0x7f4684159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4682a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46840d06b0 0x7f4684156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 -- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46840b7390 msgr2=0x7f4684159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46840b7390 0x7f4684159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 -- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46840d06b0 msgr2=0x7f4684156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46840d06b0 0x7f4684156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.114+0000 7f4683e00640 1 -- 172.21.15.52:0/1883950057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46841e9210 con 0x7f468415d060 2024-06-02T16:49:09.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f4683e00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c3c0 tx=0x7f467c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c017070 con 0x7f468415d060 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467c0052d0 con 0x7f468415d060 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c003810 con 0x7f468415d060 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46841e94f0 con 0x7f468415d060 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.115+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46841e9ab0 con 0x7f468415d060 2024-06-02T16:49:09.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.116+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46840507e0 con 0x7f468415d060 2024-06-02T16:49:09.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.118+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f467c01a070 con 0x7f468415d060 2024-06-02T16:49:09.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.119+0000 7f467b400640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 0x7f46600787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.119+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f467c096950 con 0x7f468415d060 2024-06-02T16:49:09.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.119+0000 7f4683400640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 0x7f46600787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.120+0000 7f4683400640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 0x7f46600787c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4674034000 tx=0x7f467402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.123+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f467c060210 con 0x7f468415d060 2024-06-02T16:49:09.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.371+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46840d2ea0 con 0x7f468415d060 2024-06-02T16:49:09.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.372+0000 7f467b400640 1 -- 172.21.15.52:0/1883950057 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f467c068020 con 0x7f468415d060 2024-06-02T16:49:09.371 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:09.371 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:09.371 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:09.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 msgr2=0x7f46600787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 0x7f46600787c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4674034000 tx=0x7f467402e000 comp rx=0 tx=0).stop 2024-06-02T16:49:09.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 msgr2=0x7f4684157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c3c0 tx=0x7f467c00c880 comp rx=0 tx=0).stop 2024-06-02T16:49:09.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 shutdown_connections 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4660076300 0x7f46600787c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f468415d060 0x7f4684157480 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46840d06b0 0x7f4684156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 --2- 172.21.15.52:0/1883950057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46840b7390 0x7f4684159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.375+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 >> 172.21.15.52:0/1883950057 conn(0x7f46840740e0 msgr2=0x7f4684160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.376+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 shutdown_connections 2024-06-02T16:49:09.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.376+0000 7f4688a00640 1 -- 172.21.15.52:0/1883950057 wait complete. 2024-06-02T16:49:09.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:09.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.607+0000 7f2973200640 1 Processor -- start 2024-06-02T16:49:09.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.608+0000 7f2973200640 1 -- start start 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.609+0000 7f2973200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29740b6c80 0x7f29740b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.609+0000 7f2973200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29740ba430 0x7f29740ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.609+0000 7f2973200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29741607c0 con 0x7f297415d060 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.609+0000 7f2973200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2974163c50 con 0x7f29740b6c80 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.609+0000 7f2973200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2974163040 con 0x7f29740ba430 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29740b6c80 0x7f29740b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29740b6c80 0x7f29740b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36718/0 (socket says 172.21.15.52:36718) 2024-06-02T16:49:09.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 -- 172.21.15.52:0/3349372772 learned_addr learned my addr 172.21.15.52:0/3349372772 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2972800640 1 --2- 172.21.15.52:0/3349372772 >> v2:172.21.15.114:3300/0 conn(0x7f29740ba430 0x7f29740ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 -- 172.21.15.52:0/3349372772 >> v2:172.21.15.114:3300/0 conn(0x7f29740ba430 msgr2=0x7f29740ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 --2- 172.21.15.52:0/3349372772 >> v2:172.21.15.114:3300/0 conn(0x7f29740ba430 0x7f29740ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 -- 172.21.15.52:0/3349372772 >> v1:172.21.15.114:6789/0 conn(0x7f297415d060 legacy=0x7f29740d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.610+0000 7f2971400640 1 -- 172.21.15.52:0/3349372772 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2974163320 con 0x7f29740b6c80 2024-06-02T16:49:09.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.611+0000 7f2971400640 1 --2- 172.21.15.52:0/3349372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740b6c80 0x7f29740b7100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f29740b4bf0 tx=0x7f296002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba5b09f674969dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.612+0000 7f2970a00640 1 -- 172.21.15.52:0/3349372772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960037070 con 0x7f29740b6c80 2024-06-02T16:49:09.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.612+0000 7f2970a00640 1 -- 172.21.15.52:0/3349372772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2960032440 con 0x7f29740b6c80 2024-06-02T16:49:09.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.612+0000 7f2970a00640 1 -- 172.21.15.52:0/3349372772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960032810 con 0x7f29740b6c80 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.612+0000 7f2973200640 1 -- 172.21.15.52:0/3349372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740b6c80 msgr2=0x7f29740b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.612+0000 7f2973200640 1 --2- 172.21.15.52:0/3349372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740b6c80 0x7f29740b7100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f29740b4bf0 tx=0x7f296002a1e0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 -- 172.21.15.52:0/3349372772 shutdown_connections 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 --2- 172.21.15.52:0/3349372772 >> v2:172.21.15.114:3300/0 conn(0x7f29740ba430 0x7f29740ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 --2- 172.21.15.52:0/3349372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740b6c80 0x7f29740b7100 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 -- 172.21.15.52:0/3349372772 >> 172.21.15.52:0/3349372772 conn(0x7f29740740e0 msgr2=0x7f29740d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 -- 172.21.15.52:0/3349372772 shutdown_connections 2024-06-02T16:49:09.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.613+0000 7f2973200640 1 -- 172.21.15.52:0/3349372772 wait complete. 2024-06-02T16:49:09.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.614+0000 7f2973200640 1 Processor -- start 2024-06-02T16:49:09.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 -- start start 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 0x7f29740cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 0x7f29741f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29740d0880 con 0x7f29740ba430 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29741638e0 con 0x7f29740b6c80 2024-06-02T16:49:09.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.615+0000 7f2973200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f29740d0a00 con 0x7f297415d060 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36732/0 (socket says 172.21.15.52:36732) 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 -- 172.21.15.52:0/2586110915 learned_addr learned my addr 172.21.15.52:0/2586110915 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2972800640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 0x7f29741f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971e00640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 0x7f29740cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 -- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 msgr2=0x7f29741f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 0x7f29741f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 -- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 msgr2=0x7f29740cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 0x7f29740cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971400640 1 -- 172.21.15.52:0/2586110915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29740b9560 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2972800640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 0x7f29741f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.616+0000 7f2971e00640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 0x7f29740cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.617+0000 7f2971400640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f296002a220 tx=0x7f29600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.617+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960041020 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.617+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29600306c0 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.617+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960037040 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.617+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29740b9840 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.618+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29740b9e00 con 0x7f29740ba430 2024-06-02T16:49:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.619+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29740507e0 con 0x7f29740ba430 2024-06-02T16:49:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.620+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2960044020 con 0x7f29740ba430 2024-06-02T16:49:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.621+0000 7f296a000640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 0x7f2954078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.621+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f29600b7d00 con 0x7f29740ba430 2024-06-02T16:49:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.621+0000 7f2971e00640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 0x7f2954078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.622+0000 7f2971e00640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 0x7f2954078810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2964004520 tx=0x7f2964009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.625+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f29600bb030 con 0x7f29740ba430 2024-06-02T16:49:09.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.833+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29740cba60 con 0x7f29740ba430 2024-06-02T16:49:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.837+0000 7f296a000640 1 -- 172.21.15.52:0/2586110915 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16613 (secure 0 0 0) 0x7f296004b030 con 0x7f29740ba430 2024-06-02T16:49:09.835 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:09.836 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:06.834085+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:49:03.203481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-06-02T16:49:04.293800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 msgr2=0x7f2954078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 0x7f2954078810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2964004520 tx=0x7f2964009040 comp rx=0 tx=0).stop 2024-06-02T16:49:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 msgr2=0x7f29741f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f296002a220 tx=0x7f29600046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 shutdown_connections 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2954076350 0x7f2954078810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f297415d060 0x7f29741f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29740ba430 0x7f29741f8350 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 --2- 172.21.15.52:0/2586110915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29740b6c80 0x7f29740cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 >> 172.21.15.52:0/2586110915 conn(0x7f29740740e0 msgr2=0x7f29740b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.839+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 shutdown_connections 2024-06-02T16:49:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:09.840+0000 7f2973200640 1 -- 172.21.15.52:0/2586110915 wait complete. 2024-06-02T16:49:09.859 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T16:49:09.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.054+0000 7fb16ae00640 1 Processor -- start 2024-06-02T16:49:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.054+0000 7fb16ae00640 1 -- start start 2024-06-02T16:49:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16ae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb16406e130 0x7fb16406e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16ae00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb164072340 0x7fb1640727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16ae00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb164160c80 con 0x7fb1641577f0 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16ae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb164160f60 con 0x7fb16406e130 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16ae00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb164161240 con 0x7fb164072340 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb169000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb16406e130 0x7fb16406e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb169a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb1641577f0 0x7fb164073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43938/0 (socket says 172.21.15.52:43938) 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb169a00640 1 -- 172.21.15.52:0/3077854049 learned_addr learned my addr 172.21.15.52:0/3077854049 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.056+0000 7fb16a400640 1 --2- 172.21.15.52:0/3077854049 >> v2:172.21.15.114:3300/0 conn(0x7fb164072340 0x7fb1640727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.057+0000 7fb169000640 1 -- 172.21.15.52:0/3077854049 >> v2:172.21.15.114:3300/0 conn(0x7fb164072340 msgr2=0x7fb1640727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.057+0000 7fb169000640 1 --2- 172.21.15.52:0/3077854049 >> v2:172.21.15.114:3300/0 conn(0x7fb164072340 0x7fb1640727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.057+0000 7fb169000640 1 -- 172.21.15.52:0/3077854049 >> v1:172.21.15.52:6789/0 conn(0x7fb1641577f0 legacy=0x7fb164073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.057+0000 7fb169000640 1 -- 172.21.15.52:0/3077854049 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb164161520 con 0x7fb16406e130 2024-06-02T16:49:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.057+0000 7fb163e00640 1 -- 172.21.15.52:0/3077854049 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950523370 0 0) 0x7fb164160c80 con 0x7fb1641577f0 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.058+0000 7fb169000640 1 --2- 172.21.15.52:0/3077854049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb16406e130 0x7fb16406e5b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb16415e7b0 tx=0x7fb15002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339fd6a3b70aafa9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.058+0000 7fb163e00640 1 -- 172.21.15.52:0/3077854049 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150037070 con 0x7fb16406e130 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.058+0000 7fb163e00640 1 -- 172.21.15.52:0/3077854049 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb150032440 con 0x7fb16406e130 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.058+0000 7fb163e00640 1 -- 172.21.15.52:0/3077854049 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150032810 con 0x7fb16406e130 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 -- 172.21.15.52:0/3077854049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb16406e130 msgr2=0x7fb16406e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 --2- 172.21.15.52:0/3077854049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb16406e130 0x7fb16406e5b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb16415e7b0 tx=0x7fb15002a1a0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 -- 172.21.15.52:0/3077854049 shutdown_connections 2024-06-02T16:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 --2- 172.21.15.52:0/3077854049 >> v2:172.21.15.114:3300/0 conn(0x7fb164072340 0x7fb1640727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 --2- 172.21.15.52:0/3077854049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb16406e130 0x7fb16406e5b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 -- 172.21.15.52:0/3077854049 >> 172.21.15.52:0/3077854049 conn(0x7fb16406c380 msgr2=0x7fb16406c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 -- 172.21.15.52:0/3077854049 shutdown_connections 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.059+0000 7fb16ae00640 1 -- 172.21.15.52:0/3077854049 wait complete. 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.061+0000 7fb16ae00640 1 Processor -- start 2024-06-02T16:49:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.061+0000 7fb16ae00640 1 -- start start 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb16406e130 0x7fb16415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb164072340 0x7fb164152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb164074580 con 0x7fb1641577f0 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb164161a40 con 0x7fb164072340 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16ae00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb164074180 con 0x7fb16406e130 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36754/0 (socket says 172.21.15.52:36754) 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb16a400640 1 -- 172.21.15.52:0/2880873588 learned_addr learned my addr 172.21.15.52:0/2880873588 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.062+0000 7fb169a00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb16406e130 0x7fb16415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 -- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb16406e130 msgr2=0x7fb16415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb16406e130 0x7fb16415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb169000640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb164072340 0x7fb164152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 -- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb164072340 msgr2=0x7fb164152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb164072340 0x7fb164152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 -- 172.21.15.52:0/2880873588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16415bf70 con 0x7fb1641577f0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16a400640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb15c007e40 tx=0x7fb15c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c014620 con 0x7fb1641577f0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c019070 con 0x7fb1641577f0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c014a20 con 0x7fb1641577f0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16415c250 con 0x7fb1641577f0 2024-06-02T16:49:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.063+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16415c810 con 0x7fb1641577f0 2024-06-02T16:49:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.064+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1640507e0 con 0x7fb1641577f0 2024-06-02T16:49:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.066+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb15c014bc0 con 0x7fb1641577f0 2024-06-02T16:49:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.066+0000 7fb161600640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 0x7fb144078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.067+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fb15c097f30 con 0x7fb1641577f0 2024-06-02T16:49:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.067+0000 7fb169a00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 0x7fb144078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.068+0000 7fb169a00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 0x7fb144078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f60 tx=0x7fb158009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.074+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb15c061880 con 0x7fb1641577f0 2024-06-02T16:49:10.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.282+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb16406eb60 con 0x7fb1440762d0 2024-06-02T16:49:10.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.302+0000 7fb161600640 1 -- 172.21.15.52:0/2880873588 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7fb16406eb60 con 0x7fb1440762d0 2024-06-02T16:49:10.305 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:10.306 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 msgr2=0x7fb144078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 0x7fb144078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f60 tx=0x7fb158009040 comp rx=0 tx=0).stop 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 msgr2=0x7fb164153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb15c007e40 tx=0x7fb15c00e4b0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 shutdown_connections 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb1440762d0 0x7fb144078790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1641577f0 0x7fb164153090 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb164072340 0x7fb164152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 --2- 172.21.15.52:0/2880873588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb16406e130 0x7fb16415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 >> 172.21.15.52:0/2880873588 conn(0x7fb16406c380 msgr2=0x7fb164155480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:10.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 shutdown_connections 2024-06-02T16:49:10.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.308+0000 7fb16ae00640 1 -- 172.21.15.52:0/2880873588 wait complete. 2024-06-02T16:49:10.326 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-06-02T16:49:10.082756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300784,"kb_used_data":5544,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754673936,"statfs":{"total":773094113280,"available":772786110464,"internally_reserved":0,"allocated":5677056,"data_stored":2987636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":302173758},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002032"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858461+0000","last_change":"2024-06-02T16:49:05.860988+0000","last_active":"2024-06-02T16:49:06.858461+0000","last_peered":"2024-06-02T16:49:06.858461+0000","last_clean":"2024-06-02T16:49:06.858461+0000","last_became_active":"2024-06-02T16:49:05.857904+0000","last_became_peered":"2024-06-02T16:49:05.857904+0000","last_unstale":"2024-06-02T16:49:06.858461+0000","last_undegraded":"2024-06-02T16:49:06.858461+0000","last_fullsized":"2024-06-02T16:49:06.858461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:51.645958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903926+0000","last_change":"2024-06-02T16:49:05.845661+0000","last_active":"2024-06-02T16:49:06.903926+0000","last_peered":"2024-06-02T16:49:06.903926+0000","last_clean":"2024-06-02T16:49:06.903926+0000","last_became_active":"2024-06-02T16:49:05.843622+0000","last_became_peered":"2024-06-02T16:49:05.843622+0000","last_unstale":"2024-06-02T16:49:06.903926+0000","last_undegraded":"2024-06-02T16:49:06.903926+0000","last_fullsized":"2024-06-02T16:49:06.903926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:02:18.819138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903809+0000","last_change":"2024-06-02T16:49:05.852824+0000","last_active":"2024-06-02T16:49:06.903809+0000","last_peered":"2024-06-02T16:49:06.903809+0000","last_clean":"2024-06-02T16:49:06.903809+0000","last_became_active":"2024-06-02T16:49:05.852043+0000","last_became_peered":"2024-06-02T16:49:05.852043+0000","last_unstale":"2024-06-02T16:49:06.903809+0000","last_undegraded":"2024-06-02T16:49:06.903809+0000","last_fullsized":"2024-06-02T16:49:06.903809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:10.844175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904301+0000","last_change":"2024-06-02T16:49:05.853205+0000","last_active":"2024-06-02T16:49:06.904301+0000","last_peered":"2024-06-02T16:49:06.904301+0000","last_clean":"2024-06-02T16:49:06.904301+0000","last_became_active":"2024-06-02T16:49:05.852926+0000","last_became_peered":"2024-06-02T16:49:05.852926+0000","last_unstale":"2024-06-02T16:49:06.904301+0000","last_undegraded":"2024-06-02T16:49:06.904301+0000","last_fullsized":"2024-06-02T16:49:06.904301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:38.932871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902209+0000","last_change":"2024-06-02T16:49:05.855786+0000","last_active":"2024-06-02T16:49:06.902209+0000","last_peered":"2024-06-02T16:49:06.902209+0000","last_clean":"2024-06-02T16:49:06.902209+0000","last_became_active":"2024-06-02T16:49:05.855388+0000","last_became_peered":"2024-06-02T16:49:05.855388+0000","last_unstale":"2024-06-02T16:49:06.902209+0000","last_undegraded":"2024-06-02T16:49:06.902209+0000","last_fullsized":"2024-06-02T16:49:06.902209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:42.477312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851559+0000","last_change":"2024-06-02T16:49:05.860387+0000","last_active":"2024-06-02T16:49:06.851559+0000","last_peered":"2024-06-02T16:49:06.851559+0000","last_clean":"2024-06-02T16:49:06.851559+0000","last_became_active":"2024-06-02T16:49:05.860098+0000","last_became_peered":"2024-06-02T16:49:05.860098+0000","last_unstale":"2024-06-02T16:49:06.851559+0000","last_undegraded":"2024-06-02T16:49:06.851559+0000","last_fullsized":"2024-06-02T16:49:06.851559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:50:20.452827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857899+0000","last_change":"2024-06-02T16:49:05.863973+0000","last_active":"2024-06-02T16:49:06.857899+0000","last_peered":"2024-06-02T16:49:06.857899+0000","last_clean":"2024-06-02T16:49:06.857899+0000","last_became_active":"2024-06-02T16:49:05.863011+0000","last_became_peered":"2024-06-02T16:49:05.863011+0000","last_unstale":"2024-06-02T16:49:06.857899+0000","last_undegraded":"2024-06-02T16:49:06.857899+0000","last_fullsized":"2024-06-02T16:49:06.857899+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:45.314258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902868+0000","last_change":"2024-06-02T16:49:05.848839+0000","last_active":"2024-06-02T16:49:06.902868+0000","last_peered":"2024-06-02T16:49:06.902868+0000","last_clean":"2024-06-02T16:49:06.902868+0000","last_became_active":"2024-06-02T16:49:05.848539+0000","last_became_peered":"2024-06-02T16:49:05.848539+0000","last_unstale":"2024-06-02T16:49:06.902868+0000","last_undegraded":"2024-06-02T16:49:06.902868+0000","last_fullsized":"2024-06-02T16:49:06.902868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:36.414280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906372+0000","last_change":"2024-06-02T16:49:05.863261+0000","last_active":"2024-06-02T16:49:06.906372+0000","last_peered":"2024-06-02T16:49:06.906372+0000","last_clean":"2024-06-02T16:49:06.906372+0000","last_became_active":"2024-06-02T16:49:05.862974+0000","last_became_peered":"2024-06-02T16:49:05.862974+0000","last_unstale":"2024-06-02T16:49:06.906372+0000","last_undegraded":"2024-06-02T16:49:06.906372+0000","last_fullsized":"2024-06-02T16:49:06.906372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:53:25.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905906+0000","last_change":"2024-06-02T16:49:05.851543+0000","last_active":"2024-06-02T16:49:06.905906+0000","last_peered":"2024-06-02T16:49:06.905906+0000","last_clean":"2024-06-02T16:49:06.905906+0000","last_became_active":"2024-06-02T16:49:05.851216+0000","last_became_peered":"2024-06-02T16:49:05.851216+0000","last_unstale":"2024-06-02T16:49:06.905906+0000","last_undegraded":"2024-06-02T16:49:06.905906+0000","last_fullsized":"2024-06-02T16:49:06.905906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:35.044617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906029+0000","last_change":"2024-06-02T16:49:05.848679+0000","last_active":"2024-06-02T16:49:06.906029+0000","last_peered":"2024-06-02T16:49:06.906029+0000","last_clean":"2024-06-02T16:49:06.906029+0000","last_became_active":"2024-06-02T16:49:05.848313+0000","last_became_peered":"2024-06-02T16:49:05.848313+0000","last_unstale":"2024-06-02T16:49:06.906029+0000","last_undegraded":"2024-06-02T16:49:06.906029+0000","last_fullsized":"2024-06-02T16:49:06.906029+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:42.477312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902569+0000","last_change":"2024-06-02T16:49:05.865011+0000","last_active":"2024-06-02T16:49:06.902569+0000","last_peered":"2024-06-02T16:49:06.902569+0000","last_clean":"2024-06-02T16:49:06.902569+0000","last_became_active":"2024-06-02T16:49:05.864631+0000","last_became_peered":"2024-06-02T16:49:05.864631+0000","last_unstale":"2024-06-02T16:49:06.902569+0000","last_undegraded":"2024-06-02T16:49:06.902569+0000","last_fullsized":"2024-06-02T16:49:06.902569+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:59.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901535+0000","last_change":"2024-06-02T16:49:05.869225+0000","last_active":"2024-06-02T16:49:06.901535+0000","last_peered":"2024-06-02T16:49:06.901535+0000","last_clean":"2024-06-02T16:49:06.901535+0000","last_became_active":"2024-06-02T16:49:05.868619+0000","last_became_peered":"2024-06-02T16:49:05.868619+0000","last_unstale":"2024-06-02T16:49:06.901535+0000","last_undegraded":"2024-06-02T16:49:06.901535+0000","last_fullsized":"2024-06-02T16:49:06.901535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:09:55.690061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902059+0000","last_change":"2024-06-02T16:49:05.861557+0000","last_active":"2024-06-02T16:49:06.902059+0000","last_peered":"2024-06-02T16:49:06.902059+0000","last_clean":"2024-06-02T16:49:06.902059+0000","last_became_active":"2024-06-02T16:49:05.860795+0000","last_became_peered":"2024-06-02T16:49:05.860795+0000","last_unstale":"2024-06-02T16:49:06.902059+0000","last_undegraded":"2024-06-02T16:49:06.902059+0000","last_fullsized":"2024-06-02T16:49:06.902059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:20:00.942208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851500+0000","last_change":"2024-06-02T16:49:05.852691+0000","last_active":"2024-06-02T16:49:06.851500+0000","last_peered":"2024-06-02T16:49:06.851500+0000","last_clean":"2024-06-02T16:49:06.851500+0000","last_became_active":"2024-06-02T16:49:05.852399+0000","last_became_peered":"2024-06-02T16:49:05.852399+0000","last_unstale":"2024-06-02T16:49:06.851500+0000","last_undegraded":"2024-06-02T16:49:06.851500+0000","last_fullsized":"2024-06-02T16:49:06.851500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:54:43.552795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902932+0000","last_change":"2024-06-02T16:49:05.862677+0000","last_active":"2024-06-02T16:49:06.902932+0000","last_peered":"2024-06-02T16:49:06.902932+0000","last_clean":"2024-06-02T16:49:06.902932+0000","last_became_active":"2024-06-02T16:49:05.861774+0000","last_became_peered":"2024-06-02T16:49:05.861774+0000","last_unstale":"2024-06-02T16:49:06.902932+0000","last_undegraded":"2024-06-02T16:49:06.902932+0000","last_fullsized":"2024-06-02T16:49:06.902932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:43.500968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903896+0000","last_change":"2024-06-02T16:49:05.848500+0000","last_active":"2024-06-02T16:49:06.903896+0000","last_peered":"2024-06-02T16:49:06.903896+0000","last_clean":"2024-06-02T16:49:06.903896+0000","last_became_active":"2024-06-02T16:49:05.846572+0000","last_became_peered":"2024-06-02T16:49:05.846572+0000","last_unstale":"2024-06-02T16:49:06.903896+0000","last_undegraded":"2024-06-02T16:49:06.903896+0000","last_fullsized":"2024-06-02T16:49:06.903896+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:01.881856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903351+0000","last_change":"2024-06-02T16:49:05.865503+0000","last_active":"2024-06-02T16:49:06.903351+0000","last_peered":"2024-06-02T16:49:06.903351+0000","last_clean":"2024-06-02T16:49:06.903351+0000","last_became_active":"2024-06-02T16:49:05.865010+0000","last_became_peered":"2024-06-02T16:49:05.865010+0000","last_unstale":"2024-06-02T16:49:06.903351+0000","last_undegraded":"2024-06-02T16:49:06.903351+0000","last_fullsized":"2024-06-02T16:49:06.903351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:59.495776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905572+0000","last_change":"2024-06-02T16:49:05.862445+0000","last_active":"2024-06-02T16:49:06.905572+0000","last_peered":"2024-06-02T16:49:06.905572+0000","last_clean":"2024-06-02T16:49:06.905572+0000","last_became_active":"2024-06-02T16:49:05.861972+0000","last_became_peered":"2024-06-02T16:49:05.861972+0000","last_unstale":"2024-06-02T16:49:06.905572+0000","last_undegraded":"2024-06-02T16:49:06.905572+0000","last_fullsized":"2024-06-02T16:49:06.905572+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:34.884218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902025+0000","last_change":"2024-06-02T16:49:05.855619+0000","last_active":"2024-06-02T16:49:06.902025+0000","last_peered":"2024-06-02T16:49:06.902025+0000","last_clean":"2024-06-02T16:49:06.902025+0000","last_became_active":"2024-06-02T16:49:05.855308+0000","last_became_peered":"2024-06-02T16:49:05.855308+0000","last_unstale":"2024-06-02T16:49:06.902025+0000","last_undegraded":"2024-06-02T16:49:06.902025+0000","last_fullsized":"2024-06-02T16:49:06.902025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:25:50.785058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851781+0000","last_change":"2024-06-02T16:49:05.855704+0000","last_active":"2024-06-02T16:49:06.851781+0000","last_peered":"2024-06-02T16:49:06.851781+0000","last_clean":"2024-06-02T16:49:06.851781+0000","last_became_active":"2024-06-02T16:49:05.855412+0000","last_became_peered":"2024-06-02T16:49:05.855412+0000","last_unstale":"2024-06-02T16:49:06.851781+0000","last_undegraded":"2024-06-02T16:49:06.851781+0000","last_fullsized":"2024-06-02T16:49:06.851781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:21.764600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902314+0000","last_change":"2024-06-02T16:49:05.861313+0000","last_active":"2024-06-02T16:49:06.902314+0000","last_peered":"2024-06-02T16:49:06.902314+0000","last_clean":"2024-06-02T16:49:06.902314+0000","last_became_active":"2024-06-02T16:49:05.860467+0000","last_became_peered":"2024-06-02T16:49:05.860467+0000","last_unstale":"2024-06-02T16:49:06.902314+0000","last_undegraded":"2024-06-02T16:49:06.902314+0000","last_fullsized":"2024-06-02T16:49:06.902314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:09.153906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905436+0000","last_change":"2024-06-02T16:49:05.857889+0000","last_active":"2024-06-02T16:49:06.905436+0000","last_peered":"2024-06-02T16:49:06.905436+0000","last_clean":"2024-06-02T16:49:06.905436+0000","last_became_active":"2024-06-02T16:49:05.857607+0000","last_became_peered":"2024-06-02T16:49:05.857607+0000","last_unstale":"2024-06-02T16:49:06.905436+0000","last_undegraded":"2024-06-02T16:49:06.905436+0000","last_fullsized":"2024-06-02T16:49:06.905436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:09:47.337679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903334+0000","last_change":"2024-06-02T16:49:05.858206+0000","last_active":"2024-06-02T16:49:06.903334+0000","last_peered":"2024-06-02T16:49:06.903334+0000","last_clean":"2024-06-02T16:49:06.903334+0000","last_became_active":"2024-06-02T16:49:05.857928+0000","last_became_peered":"2024-06-02T16:49:05.857928+0000","last_unstale":"2024-06-02T16:49:06.903334+0000","last_undegraded":"2024-06-02T16:49:06.903334+0000","last_fullsized":"2024-06-02T16:49:06.903334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:08.771424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905987+0000","last_change":"2024-06-02T16:49:05.854844+0000","last_active":"2024-06-02T16:49:06.905987+0000","last_peered":"2024-06-02T16:49:06.905987+0000","last_clean":"2024-06-02T16:49:06.905987+0000","last_became_active":"2024-06-02T16:49:05.854530+0000","last_became_peered":"2024-06-02T16:49:05.854530+0000","last_unstale":"2024-06-02T16:49:06.905987+0000","last_undegraded":"2024-06-02T16:49:06.905987+0000","last_fullsized":"2024-06-02T16:49:06.905987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:15:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904528+0000","last_change":"2024-06-02T16:49:05.866018+0000","last_active":"2024-06-02T16:49:06.904528+0000","last_peered":"2024-06-02T16:49:06.904528+0000","last_clean":"2024-06-02T16:49:06.904528+0000","last_became_active":"2024-06-02T16:49:05.865694+0000","last_became_peered":"2024-06-02T16:49:05.865694+0000","last_unstale":"2024-06-02T16:49:06.904528+0000","last_undegraded":"2024-06-02T16:49:06.904528+0000","last_fullsized":"2024-06-02T16:49:06.904528+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:57:57.690250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903257+0000","last_change":"2024-06-02T16:49:05.845433+0000","last_active":"2024-06-02T16:49:06.903257+0000","last_peered":"2024-06-02T16:49:06.903257+0000","last_clean":"2024-06-02T16:49:06.903257+0000","last_became_active":"2024-06-02T16:49:05.845228+0000","last_became_peered":"2024-06-02T16:49:05.845228+0000","last_unstale":"2024-06-02T16:49:06.903257+0000","last_undegraded":"2024-06-02T16:49:06.903257+0000","last_fullsized":"2024-06-02T16:49:06.903257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:36.414280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903002+0000","last_change":"2024-06-02T16:49:05.864888+0000","last_active":"2024-06-02T16:49:06.903002+0000","last_peered":"2024-06-02T16:49:06.903002+0000","last_clean":"2024-06-02T16:49:06.903002+0000","last_became_active":"2024-06-02T16:49:05.864587+0000","last_became_peered":"2024-06-02T16:49:05.864587+0000","last_unstale":"2024-06-02T16:49:06.903002+0000","last_undegraded":"2024-06-02T16:49:06.903002+0000","last_fullsized":"2024-06-02T16:49:06.903002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:25:14.803213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904601+0000","last_change":"2024-06-02T16:49:05.846337+0000","last_active":"2024-06-02T16:49:06.904601+0000","last_peered":"2024-06-02T16:49:06.904601+0000","last_clean":"2024-06-02T16:49:06.904601+0000","last_became_active":"2024-06-02T16:49:05.846060+0000","last_became_peered":"2024-06-02T16:49:05.846060+0000","last_unstale":"2024-06-02T16:49:06.904601+0000","last_undegraded":"2024-06-02T16:49:06.904601+0000","last_fullsized":"2024-06-02T16:49:06.904601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:42.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902391+0000","last_change":"2024-06-02T16:49:05.858382+0000","last_active":"2024-06-02T16:49:06.902391+0000","last_peered":"2024-06-02T16:49:06.902391+0000","last_clean":"2024-06-02T16:49:06.902391+0000","last_became_active":"2024-06-02T16:49:05.858064+0000","last_became_peered":"2024-06-02T16:49:05.858064+0000","last_unstale":"2024-06-02T16:49:06.902391+0000","last_undegraded":"2024-06-02T16:49:06.902391+0000","last_fullsized":"2024-06-02T16:49:06.902391+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:09.153906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851577+0000","last_change":"2024-06-02T16:49:05.859869+0000","last_active":"2024-06-02T16:49:06.851577+0000","last_peered":"2024-06-02T16:49:06.851577+0000","last_clean":"2024-06-02T16:49:06.851577+0000","last_became_active":"2024-06-02T16:49:05.859476+0000","last_became_peered":"2024-06-02T16:49:05.859476+0000","last_unstale":"2024-06-02T16:49:06.851577+0000","last_undegraded":"2024-06-02T16:49:06.851577+0000","last_fullsized":"2024-06-02T16:49:06.851577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:26.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901592+0000","last_change":"2024-06-02T16:49:05.849340+0000","last_active":"2024-06-02T16:49:06.901592+0000","last_peered":"2024-06-02T16:49:06.901592+0000","last_clean":"2024-06-02T16:49:06.901592+0000","last_became_active":"2024-06-02T16:49:05.849061+0000","last_became_peered":"2024-06-02T16:49:05.849061+0000","last_unstale":"2024-06-02T16:49:06.901592+0000","last_undegraded":"2024-06-02T16:49:06.901592+0000","last_fullsized":"2024-06-02T16:49:06.901592+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:48:37.128816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903508+0000","last_change":"2024-06-02T16:49:05.857206+0000","last_active":"2024-06-02T16:49:06.903508+0000","last_peered":"2024-06-02T16:49:06.903508+0000","last_clean":"2024-06-02T16:49:06.903508+0000","last_became_active":"2024-06-02T16:49:05.856917+0000","last_became_peered":"2024-06-02T16:49:05.856917+0000","last_unstale":"2024-06-02T16:49:06.903508+0000","last_undegraded":"2024-06-02T16:49:06.903508+0000","last_fullsized":"2024-06-02T16:49:06.903508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:50:52.463515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852091+0000","last_change":"2024-06-02T16:49:04.858872+0000","last_active":"2024-06-02T16:49:06.852091+0000","last_peered":"2024-06-02T16:49:06.852091+0000","last_clean":"2024-06-02T16:49:06.852091+0000","last_became_active":"2024-06-02T16:49:04.858524+0000","last_became_peered":"2024-06-02T16:49:04.858524+0000","last_unstale":"2024-06-02T16:49:06.852091+0000","last_undegraded":"2024-06-02T16:49:06.852091+0000","last_fullsized":"2024-06-02T16:49:06.852091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:58.326038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906022+0000","last_change":"2024-06-02T16:49:05.844541+0000","last_active":"2024-06-02T16:49:06.906022+0000","last_peered":"2024-06-02T16:49:06.906022+0000","last_clean":"2024-06-02T16:49:06.906022+0000","last_became_active":"2024-06-02T16:49:05.844257+0000","last_became_peered":"2024-06-02T16:49:05.844257+0000","last_unstale":"2024-06-02T16:49:06.906022+0000","last_undegraded":"2024-06-02T16:49:06.906022+0000","last_fullsized":"2024-06-02T16:49:06.906022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:37:54.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903978+0000","last_change":"2024-06-02T16:49:04.857316+0000","last_active":"2024-06-02T16:49:06.903978+0000","last_peered":"2024-06-02T16:49:06.903978+0000","last_clean":"2024-06-02T16:49:06.903978+0000","last_became_active":"2024-06-02T16:49:04.856598+0000","last_became_peered":"2024-06-02T16:49:04.856598+0000","last_unstale":"2024-06-02T16:49:06.903978+0000","last_undegraded":"2024-06-02T16:49:06.903978+0000","last_fullsized":"2024-06-02T16:49:06.903978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:51.735167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903373+0000","last_change":"2024-06-02T16:49:05.859845+0000","last_active":"2024-06-02T16:49:06.903373+0000","last_peered":"2024-06-02T16:49:06.903373+0000","last_clean":"2024-06-02T16:49:06.903373+0000","last_became_active":"2024-06-02T16:49:05.859547+0000","last_became_peered":"2024-06-02T16:49:05.859547+0000","last_unstale":"2024-06-02T16:49:06.903373+0000","last_undegraded":"2024-06-02T16:49:06.903373+0000","last_fullsized":"2024-06-02T16:49:06.903373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:45.314258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902833+0000","last_change":"2024-06-02T16:49:04.844723+0000","last_active":"2024-06-02T16:49:06.902833+0000","last_peered":"2024-06-02T16:49:06.902833+0000","last_clean":"2024-06-02T16:49:06.902833+0000","last_became_active":"2024-06-02T16:49:04.844402+0000","last_became_peered":"2024-06-02T16:49:04.844402+0000","last_unstale":"2024-06-02T16:49:06.902833+0000","last_undegraded":"2024-06-02T16:49:06.902833+0000","last_fullsized":"2024-06-02T16:49:06.902833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:39:20.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902713+0000","last_change":"2024-06-02T16:49:05.845283+0000","last_active":"2024-06-02T16:49:06.902713+0000","last_peered":"2024-06-02T16:49:06.902713+0000","last_clean":"2024-06-02T16:49:06.902713+0000","last_became_active":"2024-06-02T16:49:05.843664+0000","last_became_peered":"2024-06-02T16:49:05.843664+0000","last_unstale":"2024-06-02T16:49:06.902713+0000","last_undegraded":"2024-06-02T16:49:06.902713+0000","last_fullsized":"2024-06-02T16:49:06.902713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:55:41.500382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858177+0000","last_change":"2024-06-02T16:49:04.854952+0000","last_active":"2024-06-02T16:49:06.858177+0000","last_peered":"2024-06-02T16:49:06.858177+0000","last_clean":"2024-06-02T16:49:06.858177+0000","last_became_active":"2024-06-02T16:49:04.854152+0000","last_became_peered":"2024-06-02T16:49:04.854152+0000","last_unstale":"2024-06-02T16:49:06.858177+0000","last_undegraded":"2024-06-02T16:49:06.858177+0000","last_fullsized":"2024-06-02T16:49:06.858177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:58.489699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902768+0000","last_change":"2024-06-02T16:49:05.847980+0000","last_active":"2024-06-02T16:49:06.902768+0000","last_peered":"2024-06-02T16:49:06.902768+0000","last_clean":"2024-06-02T16:49:06.902768+0000","last_became_active":"2024-06-02T16:49:05.847687+0000","last_became_peered":"2024-06-02T16:49:05.847687+0000","last_unstale":"2024-06-02T16:49:06.902768+0000","last_undegraded":"2024-06-02T16:49:06.902768+0000","last_fullsized":"2024-06-02T16:49:06.902768+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:10.082580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851825+0000","last_change":"2024-06-02T16:49:04.848777+0000","last_active":"2024-06-02T16:49:06.851825+0000","last_peered":"2024-06-02T16:49:06.851825+0000","last_clean":"2024-06-02T16:49:06.851825+0000","last_became_active":"2024-06-02T16:49:04.848425+0000","last_became_peered":"2024-06-02T16:49:04.848425+0000","last_unstale":"2024-06-02T16:49:06.851825+0000","last_undegraded":"2024-06-02T16:49:06.851825+0000","last_fullsized":"2024-06-02T16:49:06.851825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:58.489699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902678+0000","last_change":"2024-06-02T16:49:05.859132+0000","last_active":"2024-06-02T16:49:06.902678+0000","last_peered":"2024-06-02T16:49:06.902678+0000","last_clean":"2024-06-02T16:49:06.902678+0000","last_became_active":"2024-06-02T16:49:05.854935+0000","last_became_peered":"2024-06-02T16:49:05.854935+0000","last_unstale":"2024-06-02T16:49:06.902678+0000","last_undegraded":"2024-06-02T16:49:06.902678+0000","last_fullsized":"2024-06-02T16:49:06.902678+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:13.844902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903039+0000","last_change":"2024-06-02T16:49:04.849972+0000","last_active":"2024-06-02T16:49:06.903039+0000","last_peered":"2024-06-02T16:49:06.903039+0000","last_clean":"2024-06-02T16:49:06.903039+0000","last_became_active":"2024-06-02T16:49:04.849677+0000","last_became_peered":"2024-06-02T16:49:04.849677+0000","last_unstale":"2024-06-02T16:49:06.903039+0000","last_undegraded":"2024-06-02T16:49:06.903039+0000","last_fullsized":"2024-06-02T16:49:06.903039+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:07.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903162+0000","last_change":"2024-06-02T16:49:05.861669+0000","last_active":"2024-06-02T16:49:06.903162+0000","last_peered":"2024-06-02T16:49:06.903162+0000","last_clean":"2024-06-02T16:49:06.903162+0000","last_became_active":"2024-06-02T16:49:05.861294+0000","last_became_peered":"2024-06-02T16:49:05.861294+0000","last_unstale":"2024-06-02T16:49:06.903162+0000","last_undegraded":"2024-06-02T16:49:06.903162+0000","last_fullsized":"2024-06-02T16:49:06.903162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:59.495776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901907+0000","last_change":"2024-06-02T16:49:04.844955+0000","last_active":"2024-06-02T16:49:06.901907+0000","last_peered":"2024-06-02T16:49:06.901907+0000","last_clean":"2024-06-02T16:49:06.901907+0000","last_became_active":"2024-06-02T16:49:04.844075+0000","last_became_peered":"2024-06-02T16:49:04.844075+0000","last_unstale":"2024-06-02T16:49:06.901907+0000","last_undegraded":"2024-06-02T16:49:06.901907+0000","last_fullsized":"2024-06-02T16:49:06.901907+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:19:59.936131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905351+0000","last_change":"2024-06-02T16:49:05.857352+0000","last_active":"2024-06-02T16:49:06.905351+0000","last_peered":"2024-06-02T16:49:06.905351+0000","last_clean":"2024-06-02T16:49:06.905351+0000","last_became_active":"2024-06-02T16:49:05.857090+0000","last_became_peered":"2024-06-02T16:49:05.857090+0000","last_unstale":"2024-06-02T16:49:06.905351+0000","last_undegraded":"2024-06-02T16:49:06.905351+0000","last_fullsized":"2024-06-02T16:49:06.905351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:38:21.530558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903267+0000","last_change":"2024-06-02T16:49:04.842013+0000","last_active":"2024-06-02T16:49:06.903267+0000","last_peered":"2024-06-02T16:49:06.903267+0000","last_clean":"2024-06-02T16:49:06.903267+0000","last_became_active":"2024-06-02T16:49:04.841716+0000","last_became_peered":"2024-06-02T16:49:04.841716+0000","last_unstale":"2024-06-02T16:49:06.903267+0000","last_undegraded":"2024-06-02T16:49:06.903267+0000","last_fullsized":"2024-06-02T16:49:06.903267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:25:49.778982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903751+0000","last_change":"2024-06-02T16:49:05.866001+0000","last_active":"2024-06-02T16:49:06.903751+0000","last_peered":"2024-06-02T16:49:06.903751+0000","last_clean":"2024-06-02T16:49:06.903751+0000","last_became_active":"2024-06-02T16:49:05.864622+0000","last_became_peered":"2024-06-02T16:49:05.864622+0000","last_unstale":"2024-06-02T16:49:06.903751+0000","last_undegraded":"2024-06-02T16:49:06.903751+0000","last_fullsized":"2024-06-02T16:49:06.903751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:38.932871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904148+0000","last_change":"2024-06-02T16:49:04.853618+0000","last_active":"2024-06-02T16:49:06.904148+0000","last_peered":"2024-06-02T16:49:06.904148+0000","last_clean":"2024-06-02T16:49:06.904148+0000","last_became_active":"2024-06-02T16:49:04.853343+0000","last_became_peered":"2024-06-02T16:49:04.853343+0000","last_unstale":"2024-06-02T16:49:06.904148+0000","last_undegraded":"2024-06-02T16:49:06.904148+0000","last_fullsized":"2024-06-02T16:49:06.904148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:59:16.376362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858712+0000","last_change":"2024-06-02T16:49:05.860395+0000","last_active":"2024-06-02T16:49:06.858712+0000","last_peered":"2024-06-02T16:49:06.858712+0000","last_clean":"2024-06-02T16:49:06.858712+0000","last_became_active":"2024-06-02T16:49:05.860135+0000","last_became_peered":"2024-06-02T16:49:05.860135+0000","last_unstale":"2024-06-02T16:49:06.858712+0000","last_undegraded":"2024-06-02T16:49:06.858712+0000","last_fullsized":"2024-06-02T16:49:06.858712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:47:00.696107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906001+0000","last_change":"2024-06-02T16:49:04.842122+0000","last_active":"2024-06-02T16:49:06.906001+0000","last_peered":"2024-06-02T16:49:06.906001+0000","last_clean":"2024-06-02T16:49:06.906001+0000","last_became_active":"2024-06-02T16:49:04.841575+0000","last_became_peered":"2024-06-02T16:49:04.841575+0000","last_unstale":"2024-06-02T16:49:06.906001+0000","last_undegraded":"2024-06-02T16:49:06.906001+0000","last_fullsized":"2024-06-02T16:49:06.906001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:48:36.122740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852121+0000","last_change":"2024-06-02T16:49:05.865460+0000","last_active":"2024-06-02T16:49:06.852121+0000","last_peered":"2024-06-02T16:49:06.852121+0000","last_clean":"2024-06-02T16:49:06.852121+0000","last_became_active":"2024-06-02T16:49:05.865174+0000","last_became_peered":"2024-06-02T16:49:05.865174+0000","last_unstale":"2024-06-02T16:49:06.852121+0000","last_undegraded":"2024-06-02T16:49:06.852121+0000","last_fullsized":"2024-06-02T16:49:06.852121+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:31:56.772769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.859023+0000","last_change":"2024-06-02T16:49:04.862317+0000","last_active":"2024-06-02T16:49:06.859023+0000","last_peered":"2024-06-02T16:49:06.859023+0000","last_clean":"2024-06-02T16:49:06.859023+0000","last_became_active":"2024-06-02T16:49:04.862012+0000","last_became_peered":"2024-06-02T16:49:04.862012+0000","last_unstale":"2024-06-02T16:49:06.859023+0000","last_undegraded":"2024-06-02T16:49:06.859023+0000","last_fullsized":"2024-06-02T16:49:06.859023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:37.926794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858882+0000","last_change":"2024-06-02T16:49:05.865054+0000","last_active":"2024-06-02T16:49:06.858882+0000","last_peered":"2024-06-02T16:49:06.858882+0000","last_clean":"2024-06-02T16:49:06.858882+0000","last_became_active":"2024-06-02T16:49:05.864602+0000","last_became_peered":"2024-06-02T16:49:05.864602+0000","last_unstale":"2024-06-02T16:49:06.858882+0000","last_undegraded":"2024-06-02T16:49:06.858882+0000","last_fullsized":"2024-06-02T16:49:06.858882+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:15:55.614467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902139+0000","last_change":"2024-06-02T16:49:04.845668+0000","last_active":"2024-06-02T16:49:06.902139+0000","last_peered":"2024-06-02T16:49:06.902139+0000","last_clean":"2024-06-02T16:49:06.902139+0000","last_became_active":"2024-06-02T16:49:04.845353+0000","last_became_peered":"2024-06-02T16:49:04.845353+0000","last_unstale":"2024-06-02T16:49:06.902139+0000","last_undegraded":"2024-06-02T16:49:06.902139+0000","last_fullsized":"2024-06-02T16:49:06.902139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:54:31.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905897+0000","last_change":"2024-06-02T16:49:05.852440+0000","last_active":"2024-06-02T16:49:06.905897+0000","last_peered":"2024-06-02T16:49:06.905897+0000","last_clean":"2024-06-02T16:49:06.905897+0000","last_became_active":"2024-06-02T16:49:05.852128+0000","last_became_peered":"2024-06-02T16:49:05.852128+0000","last_unstale":"2024-06-02T16:49:06.905897+0000","last_undegraded":"2024-06-02T16:49:06.905897+0000","last_fullsized":"2024-06-02T16:49:06.905897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:17:36.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851938+0000","last_change":"2024-06-02T16:49:04.846144+0000","last_active":"2024-06-02T16:49:06.851938+0000","last_peered":"2024-06-02T16:49:06.851938+0000","last_clean":"2024-06-02T16:49:06.851938+0000","last_became_active":"2024-06-02T16:49:04.845895+0000","last_became_peered":"2024-06-02T16:49:04.845895+0000","last_unstale":"2024-06-02T16:49:06.851938+0000","last_undegraded":"2024-06-02T16:49:06.851938+0000","last_fullsized":"2024-06-02T16:49:06.851938+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:37.926794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905417+0000","last_change":"2024-06-02T16:49:05.871797+0000","last_active":"2024-06-02T16:49:06.905417+0000","last_peered":"2024-06-02T16:49:06.905417+0000","last_clean":"2024-06-02T16:49:06.905417+0000","last_became_active":"2024-06-02T16:49:05.870953+0000","last_became_peered":"2024-06-02T16:49:05.870953+0000","last_unstale":"2024-06-02T16:49:06.905417+0000","last_undegraded":"2024-06-02T16:49:06.905417+0000","last_fullsized":"2024-06-02T16:49:06.905417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:01.881856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858036+0000","last_change":"2024-06-02T16:49:04.851245+0000","last_active":"2024-06-02T16:49:06.858036+0000","last_peered":"2024-06-02T16:49:06.858036+0000","last_clean":"2024-06-02T16:49:06.858036+0000","last_became_active":"2024-06-02T16:49:04.850886+0000","last_became_peered":"2024-06-02T16:49:04.850886+0000","last_unstale":"2024-06-02T16:49:06.858036+0000","last_undegraded":"2024-06-02T16:49:06.858036+0000","last_fullsized":"2024-06-02T16:49:06.858036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:09.076503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851328+0000","last_change":"2024-06-02T16:49:05.857394+0000","last_active":"2024-06-02T16:49:06.851328+0000","last_peered":"2024-06-02T16:49:06.851328+0000","last_clean":"2024-06-02T16:49:06.851328+0000","last_became_active":"2024-06-02T16:49:05.856400+0000","last_became_peered":"2024-06-02T16:49:05.856400+0000","last_unstale":"2024-06-02T16:49:06.851328+0000","last_undegraded":"2024-06-02T16:49:06.851328+0000","last_fullsized":"2024-06-02T16:49:06.851328+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.096734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851588+0000","last_change":"2024-06-02T16:49:04.847272+0000","last_active":"2024-06-02T16:49:06.851588+0000","last_peered":"2024-06-02T16:49:06.851588+0000","last_clean":"2024-06-02T16:49:06.851588+0000","last_became_active":"2024-06-02T16:49:04.846925+0000","last_became_peered":"2024-06-02T16:49:04.846925+0000","last_unstale":"2024-06-02T16:49:06.851588+0000","last_undegraded":"2024-06-02T16:49:06.851588+0000","last_fullsized":"2024-06-02T16:49:06.851588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:00.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858089+0000","last_change":"2024-06-02T16:49:05.857321+0000","last_active":"2024-06-02T16:49:06.858089+0000","last_peered":"2024-06-02T16:49:06.858089+0000","last_clean":"2024-06-02T16:49:06.858089+0000","last_became_active":"2024-06-02T16:49:05.856977+0000","last_became_peered":"2024-06-02T16:49:05.856977+0000","last_unstale":"2024-06-02T16:49:06.858089+0000","last_undegraded":"2024-06-02T16:49:06.858089+0000","last_fullsized":"2024-06-02T16:49:06.858089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:02:18.819138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903472+0000","last_change":"2024-06-02T16:49:04.836399+0000","last_active":"2024-06-02T16:49:06.903472+0000","last_peered":"2024-06-02T16:49:06.903472+0000","last_clean":"2024-06-02T16:49:06.903472+0000","last_became_active":"2024-06-02T16:49:04.836106+0000","last_became_peered":"2024-06-02T16:49:04.836106+0000","last_unstale":"2024-06-02T16:49:06.903472+0000","last_undegraded":"2024-06-02T16:49:06.903472+0000","last_fullsized":"2024-06-02T16:49:06.903472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:57:56.684173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904944+0000","last_change":"2024-06-02T16:49:05.862992+0000","last_active":"2024-06-02T16:49:06.904944+0000","last_peered":"2024-06-02T16:49:06.904944+0000","last_clean":"2024-06-02T16:49:06.904944+0000","last_became_active":"2024-06-02T16:49:05.862697+0000","last_became_peered":"2024-06-02T16:49:05.862697+0000","last_unstale":"2024-06-02T16:49:06.904944+0000","last_undegraded":"2024-06-02T16:49:06.904944+0000","last_fullsized":"2024-06-02T16:49:06.904944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:41.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901547+0000","last_change":"2024-06-02T16:49:04.841220+0000","last_active":"2024-06-02T16:49:06.901547+0000","last_peered":"2024-06-02T16:49:06.901547+0000","last_clean":"2024-06-02T16:49:06.901547+0000","last_became_active":"2024-06-02T16:49:04.840836+0000","last_became_peered":"2024-06-02T16:49:04.840836+0000","last_unstale":"2024-06-02T16:49:06.901547+0000","last_undegraded":"2024-06-02T16:49:06.901547+0000","last_fullsized":"2024-06-02T16:49:06.901547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:55:12.937190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906427+0000","last_change":"2024-06-02T16:49:05.868543+0000","last_active":"2024-06-02T16:49:06.906427+0000","last_peered":"2024-06-02T16:49:06.906427+0000","last_clean":"2024-06-02T16:49:06.906427+0000","last_became_active":"2024-06-02T16:49:05.868227+0000","last_became_peered":"2024-06-02T16:49:05.868227+0000","last_unstale":"2024-06-02T16:49:06.906427+0000","last_undegraded":"2024-06-02T16:49:06.906427+0000","last_fullsized":"2024-06-02T16:49:06.906427+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:25:14.803213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904140+0000","last_change":"2024-06-02T16:49:04.852954+0000","last_active":"2024-06-02T16:49:06.904140+0000","last_peered":"2024-06-02T16:49:06.904140+0000","last_clean":"2024-06-02T16:49:06.904140+0000","last_became_active":"2024-06-02T16:49:04.852534+0000","last_became_peered":"2024-06-02T16:49:04.852534+0000","last_unstale":"2024-06-02T16:49:06.904140+0000","last_undegraded":"2024-06-02T16:49:06.904140+0000","last_fullsized":"2024-06-02T16:49:06.904140+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:09:46.331602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905022+0000","last_change":"2024-06-02T16:49:05.855196+0000","last_active":"2024-06-02T16:49:06.905022+0000","last_peered":"2024-06-02T16:49:06.905022+0000","last_clean":"2024-06-02T16:49:06.905022+0000","last_became_active":"2024-06-02T16:49:05.854522+0000","last_became_peered":"2024-06-02T16:49:05.854522+0000","last_unstale":"2024-06-02T16:49:06.905022+0000","last_undegraded":"2024-06-02T16:49:06.905022+0000","last_fullsized":"2024-06-02T16:49:06.905022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:59:17.382438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903397+0000","last_change":"2024-06-02T16:49:04.848288+0000","last_active":"2024-06-02T16:49:06.903397+0000","last_peered":"2024-06-02T16:49:06.903397+0000","last_clean":"2024-06-02T16:49:06.903397+0000","last_became_active":"2024-06-02T16:49:04.847874+0000","last_became_peered":"2024-06-02T16:49:04.847874+0000","last_unstale":"2024-06-02T16:49:06.903397+0000","last_undegraded":"2024-06-02T16:49:06.903397+0000","last_fullsized":"2024-06-02T16:49:06.903397+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:09.076503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905092+0000","last_change":"2024-06-02T16:49:05.849739+0000","last_active":"2024-06-02T16:49:06.905092+0000","last_peered":"2024-06-02T16:49:06.905092+0000","last_clean":"2024-06-02T16:49:06.905092+0000","last_became_active":"2024-06-02T16:49:05.849473+0000","last_became_peered":"2024-06-02T16:49:05.849473+0000","last_unstale":"2024-06-02T16:49:06.905092+0000","last_undegraded":"2024-06-02T16:49:06.905092+0000","last_fullsized":"2024-06-02T16:49:06.905092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:52.741243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851997+0000","last_change":"2024-06-02T16:49:04.860959+0000","last_active":"2024-06-02T16:49:06.851997+0000","last_peered":"2024-06-02T16:49:06.851997+0000","last_clean":"2024-06-02T16:49:06.851997+0000","last_became_active":"2024-06-02T16:49:04.860732+0000","last_became_peered":"2024-06-02T16:49:04.860732+0000","last_unstale":"2024-06-02T16:49:06.851997+0000","last_undegraded":"2024-06-02T16:49:06.851997+0000","last_fullsized":"2024-06-02T16:49:06.851997+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:34.038541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851621+0000","last_change":"2024-06-02T16:49:05.860759+0000","last_active":"2024-06-02T16:49:06.851621+0000","last_peered":"2024-06-02T16:49:06.851621+0000","last_clean":"2024-06-02T16:49:06.851621+0000","last_became_active":"2024-06-02T16:49:05.856482+0000","last_became_peered":"2024-06-02T16:49:05.856482+0000","last_unstale":"2024-06-02T16:49:06.851621+0000","last_undegraded":"2024-06-02T16:49:06.851621+0000","last_fullsized":"2024-06-02T16:49:06.851621+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:13.634138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852105+0000","last_change":"2024-06-02T16:49:04.848319+0000","last_active":"2024-06-02T16:49:06.852105+0000","last_peered":"2024-06-02T16:49:06.852105+0000","last_clean":"2024-06-02T16:49:06.852105+0000","last_became_active":"2024-06-02T16:49:04.847685+0000","last_became_peered":"2024-06-02T16:49:04.847685+0000","last_unstale":"2024-06-02T16:49:06.852105+0000","last_undegraded":"2024-06-02T16:49:06.852105+0000","last_fullsized":"2024-06-02T16:49:06.852105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:09.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903084+0000","last_change":"2024-06-02T16:49:05.845014+0000","last_active":"2024-06-02T16:49:06.903084+0000","last_peered":"2024-06-02T16:49:06.903084+0000","last_clean":"2024-06-02T16:49:06.903084+0000","last_became_active":"2024-06-02T16:49:05.844738+0000","last_became_peered":"2024-06-02T16:49:05.844738+0000","last_unstale":"2024-06-02T16:49:06.903084+0000","last_undegraded":"2024-06-02T16:49:06.903084+0000","last_fullsized":"2024-06-02T16:49:06.903084+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:25:22.230560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902107+0000","last_change":"2024-06-02T16:49:04.855724+0000","last_active":"2024-06-02T16:49:06.902107+0000","last_peered":"2024-06-02T16:49:06.902107+0000","last_clean":"2024-06-02T16:49:06.902107+0000","last_became_active":"2024-06-02T16:49:04.855449+0000","last_became_peered":"2024-06-02T16:49:04.855449+0000","last_unstale":"2024-06-02T16:49:06.902107+0000","last_undegraded":"2024-06-02T16:49:06.902107+0000","last_fullsized":"2024-06-02T16:49:06.902107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:08.147829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904955+0000","last_change":"2024-06-02T16:49:05.857785+0000","last_active":"2024-06-02T16:49:06.904955+0000","last_peered":"2024-06-02T16:49:06.904955+0000","last_clean":"2024-06-02T16:49:06.904955+0000","last_became_active":"2024-06-02T16:49:05.857488+0000","last_became_peered":"2024-06-02T16:49:05.857488+0000","last_unstale":"2024-06-02T16:49:06.904955+0000","last_undegraded":"2024-06-02T16:49:06.904955+0000","last_fullsized":"2024-06-02T16:49:06.904955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:22:20.184744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902881+0000","last_change":"2024-06-02T16:49:04.848650+0000","last_active":"2024-06-02T16:49:06.902881+0000","last_peered":"2024-06-02T16:49:06.902881+0000","last_clean":"2024-06-02T16:49:06.902881+0000","last_became_active":"2024-06-02T16:49:04.848243+0000","last_became_peered":"2024-06-02T16:49:04.848243+0000","last_unstale":"2024-06-02T16:49:06.902881+0000","last_undegraded":"2024-06-02T16:49:06.902881+0000","last_fullsized":"2024-06-02T16:49:06.902881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:09:54.683984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902776+0000","last_change":"2024-06-02T16:49:05.852801+0000","last_active":"2024-06-02T16:49:06.902776+0000","last_peered":"2024-06-02T16:49:06.902776+0000","last_clean":"2024-06-02T16:49:06.902776+0000","last_became_active":"2024-06-02T16:49:05.852340+0000","last_became_peered":"2024-06-02T16:49:05.852340+0000","last_unstale":"2024-06-02T16:49:06.902776+0000","last_undegraded":"2024-06-02T16:49:06.902776+0000","last_fullsized":"2024-06-02T16:49:06.902776+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:10.082580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857516+0000","last_change":"2024-06-02T16:49:04.845110+0000","last_active":"2024-06-02T16:49:06.857516+0000","last_peered":"2024-06-02T16:49:06.857516+0000","last_clean":"2024-06-02T16:49:06.857516+0000","last_became_active":"2024-06-02T16:49:04.844807+0000","last_became_peered":"2024-06-02T16:49:04.844807+0000","last_unstale":"2024-06-02T16:49:06.857516+0000","last_undegraded":"2024-06-02T16:49:06.857516+0000","last_fullsized":"2024-06-02T16:49:06.857516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:12.838825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906285+0000","last_change":"2024-06-02T16:49:05.862796+0000","last_active":"2024-06-02T16:49:06.906285+0000","last_peered":"2024-06-02T16:49:06.906285+0000","last_clean":"2024-06-02T16:49:06.906285+0000","last_became_active":"2024-06-02T16:49:05.862471+0000","last_became_peered":"2024-06-02T16:49:05.862471+0000","last_unstale":"2024-06-02T16:49:06.906285+0000","last_undegraded":"2024-06-02T16:49:06.906285+0000","last_fullsized":"2024-06-02T16:49:06.906285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:02:09.290349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852290+0000","last_change":"2024-06-02T16:49:04.855304+0000","last_active":"2024-06-02T16:49:06.852290+0000","last_peered":"2024-06-02T16:49:06.852290+0000","last_clean":"2024-06-02T16:49:06.852290+0000","last_became_active":"2024-06-02T16:49:04.854985+0000","last_became_peered":"2024-06-02T16:49:04.854985+0000","last_unstale":"2024-06-02T16:49:06.852290+0000","last_undegraded":"2024-06-02T16:49:06.852290+0000","last_fullsized":"2024-06-02T16:49:06.852290+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:41.471235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904506+0000","last_change":"2024-06-02T16:49:05.866074+0000","last_active":"2024-06-02T16:49:06.904506+0000","last_peered":"2024-06-02T16:49:06.904506+0000","last_clean":"2024-06-02T16:49:06.904506+0000","last_became_active":"2024-06-02T16:49:05.865801+0000","last_became_peered":"2024-06-02T16:49:05.865801+0000","last_unstale":"2024-06-02T16:49:06.904506+0000","last_undegraded":"2024-06-02T16:49:06.904506+0000","last_fullsized":"2024-06-02T16:49:06.904506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:10.844175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.859055+0000","last_change":"2024-06-02T16:49:04.861472+0000","last_active":"2024-06-02T16:49:06.859055+0000","last_peered":"2024-06-02T16:49:06.859055+0000","last_clean":"2024-06-02T16:49:06.859055+0000","last_became_active":"2024-06-02T16:49:04.861067+0000","last_became_peered":"2024-06-02T16:49:04.861067+0000","last_unstale":"2024-06-02T16:49:06.859055+0000","last_undegraded":"2024-06-02T16:49:06.859055+0000","last_fullsized":"2024-06-02T16:49:06.859055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:09.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858884+0000","last_change":"2024-06-02T16:49:05.857560+0000","last_active":"2024-06-02T16:49:06.858884+0000","last_peered":"2024-06-02T16:49:06.858884+0000","last_clean":"2024-06-02T16:49:06.858884+0000","last_became_active":"2024-06-02T16:49:05.857289+0000","last_became_peered":"2024-06-02T16:49:05.857289+0000","last_unstale":"2024-06-02T16:49:06.858884+0000","last_undegraded":"2024-06-02T16:49:06.858884+0000","last_fullsized":"2024-06-02T16:49:06.858884+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:40:57.517191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903216+0000","last_change":"2024-06-02T16:49:04.845185+0000","last_active":"2024-06-02T16:49:06.903216+0000","last_peered":"2024-06-02T16:49:06.903216+0000","last_clean":"2024-06-02T16:49:06.903216+0000","last_became_active":"2024-06-02T16:49:04.844869+0000","last_became_peered":"2024-06-02T16:49:04.844869+0000","last_unstale":"2024-06-02T16:49:06.903216+0000","last_undegraded":"2024-06-02T16:49:06.903216+0000","last_fullsized":"2024-06-02T16:49:06.903216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:31:35.546992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851723+0000","last_change":"2024-06-02T16:49:05.861470+0000","last_active":"2024-06-02T16:49:06.851723+0000","last_peered":"2024-06-02T16:49:06.851723+0000","last_clean":"2024-06-02T16:49:06.851723+0000","last_became_active":"2024-06-02T16:49:05.861129+0000","last_became_peered":"2024-06-02T16:49:05.861129+0000","last_unstale":"2024-06-02T16:49:06.851723+0000","last_undegraded":"2024-06-02T16:49:06.851723+0000","last_fullsized":"2024-06-02T16:49:06.851723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:18:52.285315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858549+0000","last_change":"2024-06-02T16:49:04.861970+0000","last_active":"2024-06-02T16:49:06.858549+0000","last_peered":"2024-06-02T16:49:06.858549+0000","last_clean":"2024-06-02T16:49:06.858549+0000","last_became_active":"2024-06-02T16:49:04.861566+0000","last_became_peered":"2024-06-02T16:49:04.861566+0000","last_unstale":"2024-06-02T16:49:06.858549+0000","last_undegraded":"2024-06-02T16:49:06.858549+0000","last_fullsized":"2024-06-02T16:49:06.858549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:35.408203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851903+0000","last_change":"2024-06-02T16:49:05.856568+0000","last_active":"2024-06-02T16:49:06.851903+0000","last_peered":"2024-06-02T16:49:06.851903+0000","last_clean":"2024-06-02T16:49:06.851903+0000","last_became_active":"2024-06-02T16:49:05.856146+0000","last_became_peered":"2024-06-02T16:49:05.856146+0000","last_unstale":"2024-06-02T16:49:06.851903+0000","last_undegraded":"2024-06-02T16:49:06.851903+0000","last_fullsized":"2024-06-02T16:49:06.851903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:16:03.579603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903337+0000","last_change":"2024-06-02T16:49:04.851437+0000","last_active":"2024-06-02T16:49:06.903337+0000","last_peered":"2024-06-02T16:49:06.903337+0000","last_clean":"2024-06-02T16:49:06.903337+0000","last_became_active":"2024-06-02T16:49:04.851140+0000","last_became_peered":"2024-06-02T16:49:04.851140+0000","last_unstale":"2024-06-02T16:49:06.903337+0000","last_undegraded":"2024-06-02T16:49:06.903337+0000","last_fullsized":"2024-06-02T16:49:06.903337+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:41.018755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902749+0000","last_change":"2024-06-02T16:49:05.848591+0000","last_active":"2024-06-02T16:49:06.902749+0000","last_peered":"2024-06-02T16:49:06.902749+0000","last_clean":"2024-06-02T16:49:06.902749+0000","last_became_active":"2024-06-02T16:49:05.848171+0000","last_became_peered":"2024-06-02T16:49:05.848171+0000","last_unstale":"2024-06-02T16:49:06.902749+0000","last_undegraded":"2024-06-02T16:49:06.902749+0000","last_fullsized":"2024-06-02T16:49:06.902749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:53:25.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902841+0000","last_change":"2024-06-02T16:49:04.857722+0000","last_active":"2024-06-02T16:49:06.902841+0000","last_peered":"2024-06-02T16:49:06.902841+0000","last_clean":"2024-06-02T16:49:06.902841+0000","last_became_active":"2024-06-02T16:49:04.857407+0000","last_became_peered":"2024-06-02T16:49:04.857407+0000","last_unstale":"2024-06-02T16:49:06.902841+0000","last_undegraded":"2024-06-02T16:49:06.902841+0000","last_fullsized":"2024-06-02T16:49:06.902841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:02:12.008903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902607+0000","last_change":"2024-06-02T16:49:05.860197+0000","last_active":"2024-06-02T16:49:06.902607+0000","last_peered":"2024-06-02T16:49:06.902607+0000","last_clean":"2024-06-02T16:49:06.902607+0000","last_became_active":"2024-06-02T16:49:05.859270+0000","last_became_peered":"2024-06-02T16:49:05.859270+0000","last_unstale":"2024-06-02T16:49:06.902607+0000","last_undegraded":"2024-06-02T16:49:06.902607+0000","last_fullsized":"2024-06-02T16:49:06.902607+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:13.844902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903749+0000","last_change":"2024-06-02T16:49:04.840212+0000","last_active":"2024-06-02T16:49:06.903749+0000","last_peered":"2024-06-02T16:49:06.903749+0000","last_clean":"2024-06-02T16:49:06.903749+0000","last_became_active":"2024-06-02T16:49:04.839674+0000","last_became_peered":"2024-06-02T16:49:04.839674+0000","last_unstale":"2024-06-02T16:49:06.903749+0000","last_undegraded":"2024-06-02T16:49:06.903749+0000","last_fullsized":"2024-06-02T16:49:06.903749+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:40.639543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906059+0000","last_change":"2024-06-02T16:49:05.862177+0000","last_active":"2024-06-02T16:49:06.906059+0000","last_peered":"2024-06-02T16:49:06.906059+0000","last_clean":"2024-06-02T16:49:06.906059+0000","last_became_active":"2024-06-02T16:49:05.861899+0000","last_became_peered":"2024-06-02T16:49:05.861899+0000","last_unstale":"2024-06-02T16:49:06.906059+0000","last_undegraded":"2024-06-02T16:49:06.906059+0000","last_fullsized":"2024-06-02T16:49:06.906059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:59.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904353+0000","last_change":"2024-06-02T16:49:04.850223+0000","last_active":"2024-06-02T16:49:06.904353+0000","last_peered":"2024-06-02T16:49:06.904353+0000","last_clean":"2024-06-02T16:49:06.904353+0000","last_became_active":"2024-06-02T16:49:04.849924+0000","last_became_peered":"2024-06-02T16:49:04.849924+0000","last_unstale":"2024-06-02T16:49:06.904353+0000","last_undegraded":"2024-06-02T16:49:06.904353+0000","last_fullsized":"2024-06-02T16:49:06.904353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:12.838825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":155,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857577+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:06.857577+0000","last_peered":"2024-06-02T16:49:06.857577+0000","last_clean":"2024-06-02T16:49:06.857577+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:06.857577+0000","last_undegraded":"2024-06-02T16:49:06.857577+0000","last_fullsized":"2024-06-02T16:49:06.857577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476791,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":815718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476788,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35896,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":561152,"data_stored":225932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":557056,"data_stored":225330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476790,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40052,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331788,"statfs":{"total":96636764160,"available":96595750912,"internally_reserved":0,"allocated":565248,"data_stored":226872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40056,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331784,"statfs":{"total":96636764160,"available":96595746816,"internally_reserved":0,"allocated":565248,"data_stored":225898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35900,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335940,"statfs":{"total":96636764160,"available":96600002560,"internally_reserved":0,"allocated":569344,"data_stored":226894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36472,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335368,"statfs":{"total":96636764160,"available":96599416832,"internally_reserved":0,"allocated":1150976,"data_stored":815662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40052,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331788,"statfs":{"total":96636764160,"available":96595750912,"internally_reserved":0,"allocated":557056,"data_stored":225330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:10.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:10.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.584+0000 7f49cea00640 1 Processor -- start 2024-06-02T16:49:10.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.584+0000 7f49cea00640 1 -- start start 2024-06-02T16:49:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49c815f980 0x7f49c80d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cea00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c80b57d0 con 0x7f49c81590d0 2024-06-02T16:49:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cea00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c80b5ab0 con 0x7f49c815fe80 2024-06-02T16:49:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f49c80b5d90 con 0x7f49c815f980 2024-06-02T16:49:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cd600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f49c81590d0 0x7f49c815f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43946/0 (socket says 172.21.15.52:43946) 2024-06-02T16:49:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49cd600640 1 -- 172.21.15.52:0/1695344863 learned_addr learned my addr 172.21.15.52:0/1695344863 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247331424 0 0) 0x7f49c80b57d0 con 0x7f49c81590d0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.586+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49b0003520 con 0x7f49c81590d0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49ccc00640 1 --2- 172.21.15.52:0/1695344863 >> v2:172.21.15.114:3300/0 conn(0x7f49c815f980 0x7f49c80d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2384005674 0 0) 0x7f49b0003520 con 0x7f49c81590d0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 >> v2:172.21.15.114:3300/0 conn(0x7f49c815f980 msgr2=0x7f49c80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 --2- 172.21.15.52:0/1695344863 >> v2:172.21.15.114:3300/0 conn(0x7f49c815f980 0x7f49c80d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 >> v1:172.21.15.114:6789/0 conn(0x7f49c815fe80 legacy=0x7f49c80b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c80b6070 con 0x7f49c81590d0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f49bc0016f0 con 0x7f49c81590d0 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 >> v1:172.21.15.52:6789/0 conn(0x7f49c81590d0 legacy=0x7f49c815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b0004800 0x7f49b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b0005290 0x7f49b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80b5d90 con 0x7f49b0003a00 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49b000c1e0 con 0x7f49b0004800 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f49b000c3e0 con 0x7f49b0005290 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.587+0000 7f49cd600640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49cd600640 1 -- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b0005290 msgr2=0x7f49b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49cd600640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b0005290 0x7f49b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49cd600640 1 -- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b0004800 msgr2=0x7f49b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49cd600640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b0004800 0x7f49b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49cd600640 1 -- 172.21.15.52:0/1695344863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b0003520 con 0x7f49b0003a00 2024-06-02T16:49:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.588+0000 7f49ce000640 1 -- 172.21.15.52:0/1695344863 reap_dead start 2024-06-02T16:49:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.589+0000 7f49cd600640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49b0003e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f49bc007d10 tx=0x7f49b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1e755eb6deef8d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.589+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc007d50 con 0x7f49b0003a00 2024-06-02T16:49:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.589+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49bc036070 con 0x7f49b0003a00 2024-06-02T16:49:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.589+0000 7f49c7e00640 1 -- 172.21.15.52:0/1695344863 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc005d50 con 0x7f49b0003a00 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 -- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 msgr2=0x7f49b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49b0003e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f49bc007d10 tx=0x7f49b0005830 comp rx=0 tx=0).stop 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 -- 172.21.15.52:0/1695344863 shutdown_connections 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 --2- 172.21.15.52:0/1695344863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49b0003e00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 -- 172.21.15.52:0/1695344863 >> 172.21.15.52:0/1695344863 conn(0x7f49c806c380 msgr2=0x7f49c806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 -- 172.21.15.52:0/1695344863 shutdown_connections 2024-06-02T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.590+0000 7f49cea00640 1 -- 172.21.15.52:0/1695344863 wait complete. 2024-06-02T16:49:10.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.592+0000 7f49cea00640 1 Processor -- start 2024-06-02T16:49:10.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.592+0000 7f49cea00640 1 -- start start 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49c8159810 0x7f49c8153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49c8159c70 0x7f49c81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49c81594b0 con 0x7f49b0003a00 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80b5460 con 0x7f49c8159c70 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cea00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f49c8159630 con 0x7f49c8159810 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36770/0 (socket says 172.21.15.52:36770) 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 -- 172.21.15.52:0/1943853955 learned_addr learned my addr 172.21.15.52:0/1943853955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49ccc00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49c8159810 0x7f49c8153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 -- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49c8159810 msgr2=0x7f49c8153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49c8159810 0x7f49c8153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 -- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49c8159c70 msgr2=0x7f49c81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49c8159c70 0x7f49c81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.593+0000 7f49cd600640 1 -- 172.21.15.52:0/1943853955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c815a1f0 con 0x7f49b0003a00 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49cd600640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f49bc02cfb0 tx=0x7f49c80b6240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc007d50 con 0x7f49b0003a00 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49bc03f070 con 0x7f49b0003a00 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc001c80 con 0x7f49b0003a00 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c815a4d0 con 0x7f49b0003a00 2024-06-02T16:49:10.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.594+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c8156a40 con 0x7f49b0003a00 2024-06-02T16:49:10.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.596+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c80507e0 con 0x7f49b0003a00 2024-06-02T16:49:10.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.597+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f49bc007470 con 0x7f49b0003a00 2024-06-02T16:49:10.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.598+0000 7f49c5600640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 0x7f49a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:10.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.598+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f49bc0b7bc0 con 0x7f49b0003a00 2024-06-02T16:49:10.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.599+0000 7f49ccc00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 0x7f49a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.600+0000 7f49ccc00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 0x7f49a8078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006a90 tx=0x7f49b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.603+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f49bc00f070 con 0x7f49b0003a00 2024-06-02T16:49:10.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.813+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49c80cf910 con 0x7f49a80762d0 2024-06-02T16:49:10.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.833+0000 7f49c5600640 1 -- 172.21.15.52:0/1943853955 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f49c80cf910 con 0x7f49a80762d0 2024-06-02T16:49:10.834 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:10.836 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 msgr2=0x7f49a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 0x7f49a8078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006a90 tx=0x7f49b4008040 comp rx=0 tx=0).stop 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 msgr2=0x7f49c81f4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f49bc02cfb0 tx=0x7f49c80b6240 comp rx=0 tx=0).stop 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 shutdown_connections 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f49a80762d0 0x7f49a8078790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49c8159c70 0x7f49c81542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49c8159810 0x7f49c8153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 --2- 172.21.15.52:0/1943853955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49b0003a00 0x7f49c81f4620 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:10.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 >> 172.21.15.52:0/1943853955 conn(0x7f49c806c380 msgr2=0x7f49c80afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:10.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.839+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 shutdown_connections 2024-06-02T16:49:10.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:10.840+0000 7f49cea00640 1 -- 172.21.15.52:0/1943853955 wait complete. 2024-06-02T16:49:10.857 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-06-02T16:49:10.082756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300784,"kb_used_data":5544,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754673936,"statfs":{"total":773094113280,"available":772786110464,"internally_reserved":0,"allocated":5677056,"data_stored":2987636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":302173758},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002032"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858461+0000","last_change":"2024-06-02T16:49:05.860988+0000","last_active":"2024-06-02T16:49:06.858461+0000","last_peered":"2024-06-02T16:49:06.858461+0000","last_clean":"2024-06-02T16:49:06.858461+0000","last_became_active":"2024-06-02T16:49:05.857904+0000","last_became_peered":"2024-06-02T16:49:05.857904+0000","last_unstale":"2024-06-02T16:49:06.858461+0000","last_undegraded":"2024-06-02T16:49:06.858461+0000","last_fullsized":"2024-06-02T16:49:06.858461+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:51.645958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903926+0000","last_change":"2024-06-02T16:49:05.845661+0000","last_active":"2024-06-02T16:49:06.903926+0000","last_peered":"2024-06-02T16:49:06.903926+0000","last_clean":"2024-06-02T16:49:06.903926+0000","last_became_active":"2024-06-02T16:49:05.843622+0000","last_became_peered":"2024-06-02T16:49:05.843622+0000","last_unstale":"2024-06-02T16:49:06.903926+0000","last_undegraded":"2024-06-02T16:49:06.903926+0000","last_fullsized":"2024-06-02T16:49:06.903926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:02:18.819138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903809+0000","last_change":"2024-06-02T16:49:05.852824+0000","last_active":"2024-06-02T16:49:06.903809+0000","last_peered":"2024-06-02T16:49:06.903809+0000","last_clean":"2024-06-02T16:49:06.903809+0000","last_became_active":"2024-06-02T16:49:05.852043+0000","last_became_peered":"2024-06-02T16:49:05.852043+0000","last_unstale":"2024-06-02T16:49:06.903809+0000","last_undegraded":"2024-06-02T16:49:06.903809+0000","last_fullsized":"2024-06-02T16:49:06.903809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:10.844175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904301+0000","last_change":"2024-06-02T16:49:05.853205+0000","last_active":"2024-06-02T16:49:06.904301+0000","last_peered":"2024-06-02T16:49:06.904301+0000","last_clean":"2024-06-02T16:49:06.904301+0000","last_became_active":"2024-06-02T16:49:05.852926+0000","last_became_peered":"2024-06-02T16:49:05.852926+0000","last_unstale":"2024-06-02T16:49:06.904301+0000","last_undegraded":"2024-06-02T16:49:06.904301+0000","last_fullsized":"2024-06-02T16:49:06.904301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:38.932871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902209+0000","last_change":"2024-06-02T16:49:05.855786+0000","last_active":"2024-06-02T16:49:06.902209+0000","last_peered":"2024-06-02T16:49:06.902209+0000","last_clean":"2024-06-02T16:49:06.902209+0000","last_became_active":"2024-06-02T16:49:05.855388+0000","last_became_peered":"2024-06-02T16:49:05.855388+0000","last_unstale":"2024-06-02T16:49:06.902209+0000","last_undegraded":"2024-06-02T16:49:06.902209+0000","last_fullsized":"2024-06-02T16:49:06.902209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:42.477312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851559+0000","last_change":"2024-06-02T16:49:05.860387+0000","last_active":"2024-06-02T16:49:06.851559+0000","last_peered":"2024-06-02T16:49:06.851559+0000","last_clean":"2024-06-02T16:49:06.851559+0000","last_became_active":"2024-06-02T16:49:05.860098+0000","last_became_peered":"2024-06-02T16:49:05.860098+0000","last_unstale":"2024-06-02T16:49:06.851559+0000","last_undegraded":"2024-06-02T16:49:06.851559+0000","last_fullsized":"2024-06-02T16:49:06.851559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:50:20.452827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857899+0000","last_change":"2024-06-02T16:49:05.863973+0000","last_active":"2024-06-02T16:49:06.857899+0000","last_peered":"2024-06-02T16:49:06.857899+0000","last_clean":"2024-06-02T16:49:06.857899+0000","last_became_active":"2024-06-02T16:49:05.863011+0000","last_became_peered":"2024-06-02T16:49:05.863011+0000","last_unstale":"2024-06-02T16:49:06.857899+0000","last_undegraded":"2024-06-02T16:49:06.857899+0000","last_fullsized":"2024-06-02T16:49:06.857899+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:45.314258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902868+0000","last_change":"2024-06-02T16:49:05.848839+0000","last_active":"2024-06-02T16:49:06.902868+0000","last_peered":"2024-06-02T16:49:06.902868+0000","last_clean":"2024-06-02T16:49:06.902868+0000","last_became_active":"2024-06-02T16:49:05.848539+0000","last_became_peered":"2024-06-02T16:49:05.848539+0000","last_unstale":"2024-06-02T16:49:06.902868+0000","last_undegraded":"2024-06-02T16:49:06.902868+0000","last_fullsized":"2024-06-02T16:49:06.902868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:36.414280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906372+0000","last_change":"2024-06-02T16:49:05.863261+0000","last_active":"2024-06-02T16:49:06.906372+0000","last_peered":"2024-06-02T16:49:06.906372+0000","last_clean":"2024-06-02T16:49:06.906372+0000","last_became_active":"2024-06-02T16:49:05.862974+0000","last_became_peered":"2024-06-02T16:49:05.862974+0000","last_unstale":"2024-06-02T16:49:06.906372+0000","last_undegraded":"2024-06-02T16:49:06.906372+0000","last_fullsized":"2024-06-02T16:49:06.906372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:53:25.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905906+0000","last_change":"2024-06-02T16:49:05.851543+0000","last_active":"2024-06-02T16:49:06.905906+0000","last_peered":"2024-06-02T16:49:06.905906+0000","last_clean":"2024-06-02T16:49:06.905906+0000","last_became_active":"2024-06-02T16:49:05.851216+0000","last_became_peered":"2024-06-02T16:49:05.851216+0000","last_unstale":"2024-06-02T16:49:06.905906+0000","last_undegraded":"2024-06-02T16:49:06.905906+0000","last_fullsized":"2024-06-02T16:49:06.905906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:35.044617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906029+0000","last_change":"2024-06-02T16:49:05.848679+0000","last_active":"2024-06-02T16:49:06.906029+0000","last_peered":"2024-06-02T16:49:06.906029+0000","last_clean":"2024-06-02T16:49:06.906029+0000","last_became_active":"2024-06-02T16:49:05.848313+0000","last_became_peered":"2024-06-02T16:49:05.848313+0000","last_unstale":"2024-06-02T16:49:06.906029+0000","last_undegraded":"2024-06-02T16:49:06.906029+0000","last_fullsized":"2024-06-02T16:49:06.906029+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:42.477312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902569+0000","last_change":"2024-06-02T16:49:05.865011+0000","last_active":"2024-06-02T16:49:06.902569+0000","last_peered":"2024-06-02T16:49:06.902569+0000","last_clean":"2024-06-02T16:49:06.902569+0000","last_became_active":"2024-06-02T16:49:05.864631+0000","last_became_peered":"2024-06-02T16:49:05.864631+0000","last_unstale":"2024-06-02T16:49:06.902569+0000","last_undegraded":"2024-06-02T16:49:06.902569+0000","last_fullsized":"2024-06-02T16:49:06.902569+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:59.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901535+0000","last_change":"2024-06-02T16:49:05.869225+0000","last_active":"2024-06-02T16:49:06.901535+0000","last_peered":"2024-06-02T16:49:06.901535+0000","last_clean":"2024-06-02T16:49:06.901535+0000","last_became_active":"2024-06-02T16:49:05.868619+0000","last_became_peered":"2024-06-02T16:49:05.868619+0000","last_unstale":"2024-06-02T16:49:06.901535+0000","last_undegraded":"2024-06-02T16:49:06.901535+0000","last_fullsized":"2024-06-02T16:49:06.901535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:09:55.690061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902059+0000","last_change":"2024-06-02T16:49:05.861557+0000","last_active":"2024-06-02T16:49:06.902059+0000","last_peered":"2024-06-02T16:49:06.902059+0000","last_clean":"2024-06-02T16:49:06.902059+0000","last_became_active":"2024-06-02T16:49:05.860795+0000","last_became_peered":"2024-06-02T16:49:05.860795+0000","last_unstale":"2024-06-02T16:49:06.902059+0000","last_undegraded":"2024-06-02T16:49:06.902059+0000","last_fullsized":"2024-06-02T16:49:06.902059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:20:00.942208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851500+0000","last_change":"2024-06-02T16:49:05.852691+0000","last_active":"2024-06-02T16:49:06.851500+0000","last_peered":"2024-06-02T16:49:06.851500+0000","last_clean":"2024-06-02T16:49:06.851500+0000","last_became_active":"2024-06-02T16:49:05.852399+0000","last_became_peered":"2024-06-02T16:49:05.852399+0000","last_unstale":"2024-06-02T16:49:06.851500+0000","last_undegraded":"2024-06-02T16:49:06.851500+0000","last_fullsized":"2024-06-02T16:49:06.851500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:54:43.552795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902932+0000","last_change":"2024-06-02T16:49:05.862677+0000","last_active":"2024-06-02T16:49:06.902932+0000","last_peered":"2024-06-02T16:49:06.902932+0000","last_clean":"2024-06-02T16:49:06.902932+0000","last_became_active":"2024-06-02T16:49:05.861774+0000","last_became_peered":"2024-06-02T16:49:05.861774+0000","last_unstale":"2024-06-02T16:49:06.902932+0000","last_undegraded":"2024-06-02T16:49:06.902932+0000","last_fullsized":"2024-06-02T16:49:06.902932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:43.500968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903896+0000","last_change":"2024-06-02T16:49:05.848500+0000","last_active":"2024-06-02T16:49:06.903896+0000","last_peered":"2024-06-02T16:49:06.903896+0000","last_clean":"2024-06-02T16:49:06.903896+0000","last_became_active":"2024-06-02T16:49:05.846572+0000","last_became_peered":"2024-06-02T16:49:05.846572+0000","last_unstale":"2024-06-02T16:49:06.903896+0000","last_undegraded":"2024-06-02T16:49:06.903896+0000","last_fullsized":"2024-06-02T16:49:06.903896+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:01.881856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903351+0000","last_change":"2024-06-02T16:49:05.865503+0000","last_active":"2024-06-02T16:49:06.903351+0000","last_peered":"2024-06-02T16:49:06.903351+0000","last_clean":"2024-06-02T16:49:06.903351+0000","last_became_active":"2024-06-02T16:49:05.865010+0000","last_became_peered":"2024-06-02T16:49:05.865010+0000","last_unstale":"2024-06-02T16:49:06.903351+0000","last_undegraded":"2024-06-02T16:49:06.903351+0000","last_fullsized":"2024-06-02T16:49:06.903351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:59.495776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905572+0000","last_change":"2024-06-02T16:49:05.862445+0000","last_active":"2024-06-02T16:49:06.905572+0000","last_peered":"2024-06-02T16:49:06.905572+0000","last_clean":"2024-06-02T16:49:06.905572+0000","last_became_active":"2024-06-02T16:49:05.861972+0000","last_became_peered":"2024-06-02T16:49:05.861972+0000","last_unstale":"2024-06-02T16:49:06.905572+0000","last_undegraded":"2024-06-02T16:49:06.905572+0000","last_fullsized":"2024-06-02T16:49:06.905572+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:34.884218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902025+0000","last_change":"2024-06-02T16:49:05.855619+0000","last_active":"2024-06-02T16:49:06.902025+0000","last_peered":"2024-06-02T16:49:06.902025+0000","last_clean":"2024-06-02T16:49:06.902025+0000","last_became_active":"2024-06-02T16:49:05.855308+0000","last_became_peered":"2024-06-02T16:49:05.855308+0000","last_unstale":"2024-06-02T16:49:06.902025+0000","last_undegraded":"2024-06-02T16:49:06.902025+0000","last_fullsized":"2024-06-02T16:49:06.902025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:25:50.785058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851781+0000","last_change":"2024-06-02T16:49:05.855704+0000","last_active":"2024-06-02T16:49:06.851781+0000","last_peered":"2024-06-02T16:49:06.851781+0000","last_clean":"2024-06-02T16:49:06.851781+0000","last_became_active":"2024-06-02T16:49:05.855412+0000","last_became_peered":"2024-06-02T16:49:05.855412+0000","last_unstale":"2024-06-02T16:49:06.851781+0000","last_undegraded":"2024-06-02T16:49:06.851781+0000","last_fullsized":"2024-06-02T16:49:06.851781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:21.764600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902314+0000","last_change":"2024-06-02T16:49:05.861313+0000","last_active":"2024-06-02T16:49:06.902314+0000","last_peered":"2024-06-02T16:49:06.902314+0000","last_clean":"2024-06-02T16:49:06.902314+0000","last_became_active":"2024-06-02T16:49:05.860467+0000","last_became_peered":"2024-06-02T16:49:05.860467+0000","last_unstale":"2024-06-02T16:49:06.902314+0000","last_undegraded":"2024-06-02T16:49:06.902314+0000","last_fullsized":"2024-06-02T16:49:06.902314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:09.153906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905436+0000","last_change":"2024-06-02T16:49:05.857889+0000","last_active":"2024-06-02T16:49:06.905436+0000","last_peered":"2024-06-02T16:49:06.905436+0000","last_clean":"2024-06-02T16:49:06.905436+0000","last_became_active":"2024-06-02T16:49:05.857607+0000","last_became_peered":"2024-06-02T16:49:05.857607+0000","last_unstale":"2024-06-02T16:49:06.905436+0000","last_undegraded":"2024-06-02T16:49:06.905436+0000","last_fullsized":"2024-06-02T16:49:06.905436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:09:47.337679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903334+0000","last_change":"2024-06-02T16:49:05.858206+0000","last_active":"2024-06-02T16:49:06.903334+0000","last_peered":"2024-06-02T16:49:06.903334+0000","last_clean":"2024-06-02T16:49:06.903334+0000","last_became_active":"2024-06-02T16:49:05.857928+0000","last_became_peered":"2024-06-02T16:49:05.857928+0000","last_unstale":"2024-06-02T16:49:06.903334+0000","last_undegraded":"2024-06-02T16:49:06.903334+0000","last_fullsized":"2024-06-02T16:49:06.903334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:08.771424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905987+0000","last_change":"2024-06-02T16:49:05.854844+0000","last_active":"2024-06-02T16:49:06.905987+0000","last_peered":"2024-06-02T16:49:06.905987+0000","last_clean":"2024-06-02T16:49:06.905987+0000","last_became_active":"2024-06-02T16:49:05.854530+0000","last_became_peered":"2024-06-02T16:49:05.854530+0000","last_unstale":"2024-06-02T16:49:06.905987+0000","last_undegraded":"2024-06-02T16:49:06.905987+0000","last_fullsized":"2024-06-02T16:49:06.905987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:15:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904528+0000","last_change":"2024-06-02T16:49:05.866018+0000","last_active":"2024-06-02T16:49:06.904528+0000","last_peered":"2024-06-02T16:49:06.904528+0000","last_clean":"2024-06-02T16:49:06.904528+0000","last_became_active":"2024-06-02T16:49:05.865694+0000","last_became_peered":"2024-06-02T16:49:05.865694+0000","last_unstale":"2024-06-02T16:49:06.904528+0000","last_undegraded":"2024-06-02T16:49:06.904528+0000","last_fullsized":"2024-06-02T16:49:06.904528+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:57:57.690250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903257+0000","last_change":"2024-06-02T16:49:05.845433+0000","last_active":"2024-06-02T16:49:06.903257+0000","last_peered":"2024-06-02T16:49:06.903257+0000","last_clean":"2024-06-02T16:49:06.903257+0000","last_became_active":"2024-06-02T16:49:05.845228+0000","last_became_peered":"2024-06-02T16:49:05.845228+0000","last_unstale":"2024-06-02T16:49:06.903257+0000","last_undegraded":"2024-06-02T16:49:06.903257+0000","last_fullsized":"2024-06-02T16:49:06.903257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:36.414280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903002+0000","last_change":"2024-06-02T16:49:05.864888+0000","last_active":"2024-06-02T16:49:06.903002+0000","last_peered":"2024-06-02T16:49:06.903002+0000","last_clean":"2024-06-02T16:49:06.903002+0000","last_became_active":"2024-06-02T16:49:05.864587+0000","last_became_peered":"2024-06-02T16:49:05.864587+0000","last_unstale":"2024-06-02T16:49:06.903002+0000","last_undegraded":"2024-06-02T16:49:06.903002+0000","last_fullsized":"2024-06-02T16:49:06.903002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:25:14.803213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904601+0000","last_change":"2024-06-02T16:49:05.846337+0000","last_active":"2024-06-02T16:49:06.904601+0000","last_peered":"2024-06-02T16:49:06.904601+0000","last_clean":"2024-06-02T16:49:06.904601+0000","last_became_active":"2024-06-02T16:49:05.846060+0000","last_became_peered":"2024-06-02T16:49:05.846060+0000","last_unstale":"2024-06-02T16:49:06.904601+0000","last_undegraded":"2024-06-02T16:49:06.904601+0000","last_fullsized":"2024-06-02T16:49:06.904601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:42.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902391+0000","last_change":"2024-06-02T16:49:05.858382+0000","last_active":"2024-06-02T16:49:06.902391+0000","last_peered":"2024-06-02T16:49:06.902391+0000","last_clean":"2024-06-02T16:49:06.902391+0000","last_became_active":"2024-06-02T16:49:05.858064+0000","last_became_peered":"2024-06-02T16:49:05.858064+0000","last_unstale":"2024-06-02T16:49:06.902391+0000","last_undegraded":"2024-06-02T16:49:06.902391+0000","last_fullsized":"2024-06-02T16:49:06.902391+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:09.153906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851577+0000","last_change":"2024-06-02T16:49:05.859869+0000","last_active":"2024-06-02T16:49:06.851577+0000","last_peered":"2024-06-02T16:49:06.851577+0000","last_clean":"2024-06-02T16:49:06.851577+0000","last_became_active":"2024-06-02T16:49:05.859476+0000","last_became_peered":"2024-06-02T16:49:05.859476+0000","last_unstale":"2024-06-02T16:49:06.851577+0000","last_undegraded":"2024-06-02T16:49:06.851577+0000","last_fullsized":"2024-06-02T16:49:06.851577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:26.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901592+0000","last_change":"2024-06-02T16:49:05.849340+0000","last_active":"2024-06-02T16:49:06.901592+0000","last_peered":"2024-06-02T16:49:06.901592+0000","last_clean":"2024-06-02T16:49:06.901592+0000","last_became_active":"2024-06-02T16:49:05.849061+0000","last_became_peered":"2024-06-02T16:49:05.849061+0000","last_unstale":"2024-06-02T16:49:06.901592+0000","last_undegraded":"2024-06-02T16:49:06.901592+0000","last_fullsized":"2024-06-02T16:49:06.901592+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:48:37.128816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903508+0000","last_change":"2024-06-02T16:49:05.857206+0000","last_active":"2024-06-02T16:49:06.903508+0000","last_peered":"2024-06-02T16:49:06.903508+0000","last_clean":"2024-06-02T16:49:06.903508+0000","last_became_active":"2024-06-02T16:49:05.856917+0000","last_became_peered":"2024-06-02T16:49:05.856917+0000","last_unstale":"2024-06-02T16:49:06.903508+0000","last_undegraded":"2024-06-02T16:49:06.903508+0000","last_fullsized":"2024-06-02T16:49:06.903508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:50:52.463515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852091+0000","last_change":"2024-06-02T16:49:04.858872+0000","last_active":"2024-06-02T16:49:06.852091+0000","last_peered":"2024-06-02T16:49:06.852091+0000","last_clean":"2024-06-02T16:49:06.852091+0000","last_became_active":"2024-06-02T16:49:04.858524+0000","last_became_peered":"2024-06-02T16:49:04.858524+0000","last_unstale":"2024-06-02T16:49:06.852091+0000","last_undegraded":"2024-06-02T16:49:06.852091+0000","last_fullsized":"2024-06-02T16:49:06.852091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:58.326038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906022+0000","last_change":"2024-06-02T16:49:05.844541+0000","last_active":"2024-06-02T16:49:06.906022+0000","last_peered":"2024-06-02T16:49:06.906022+0000","last_clean":"2024-06-02T16:49:06.906022+0000","last_became_active":"2024-06-02T16:49:05.844257+0000","last_became_peered":"2024-06-02T16:49:05.844257+0000","last_unstale":"2024-06-02T16:49:06.906022+0000","last_undegraded":"2024-06-02T16:49:06.906022+0000","last_fullsized":"2024-06-02T16:49:06.906022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:37:54.748360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903978+0000","last_change":"2024-06-02T16:49:04.857316+0000","last_active":"2024-06-02T16:49:06.903978+0000","last_peered":"2024-06-02T16:49:06.903978+0000","last_clean":"2024-06-02T16:49:06.903978+0000","last_became_active":"2024-06-02T16:49:04.856598+0000","last_became_peered":"2024-06-02T16:49:04.856598+0000","last_unstale":"2024-06-02T16:49:06.903978+0000","last_undegraded":"2024-06-02T16:49:06.903978+0000","last_fullsized":"2024-06-02T16:49:06.903978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:51.735167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903373+0000","last_change":"2024-06-02T16:49:05.859845+0000","last_active":"2024-06-02T16:49:06.903373+0000","last_peered":"2024-06-02T16:49:06.903373+0000","last_clean":"2024-06-02T16:49:06.903373+0000","last_became_active":"2024-06-02T16:49:05.859547+0000","last_became_peered":"2024-06-02T16:49:05.859547+0000","last_unstale":"2024-06-02T16:49:06.903373+0000","last_undegraded":"2024-06-02T16:49:06.903373+0000","last_fullsized":"2024-06-02T16:49:06.903373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:13:45.314258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902833+0000","last_change":"2024-06-02T16:49:04.844723+0000","last_active":"2024-06-02T16:49:06.902833+0000","last_peered":"2024-06-02T16:49:06.902833+0000","last_clean":"2024-06-02T16:49:06.902833+0000","last_became_active":"2024-06-02T16:49:04.844402+0000","last_became_peered":"2024-06-02T16:49:04.844402+0000","last_unstale":"2024-06-02T16:49:06.902833+0000","last_undegraded":"2024-06-02T16:49:06.902833+0000","last_fullsized":"2024-06-02T16:49:06.902833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:39:20.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902713+0000","last_change":"2024-06-02T16:49:05.845283+0000","last_active":"2024-06-02T16:49:06.902713+0000","last_peered":"2024-06-02T16:49:06.902713+0000","last_clean":"2024-06-02T16:49:06.902713+0000","last_became_active":"2024-06-02T16:49:05.843664+0000","last_became_peered":"2024-06-02T16:49:05.843664+0000","last_unstale":"2024-06-02T16:49:06.902713+0000","last_undegraded":"2024-06-02T16:49:06.902713+0000","last_fullsized":"2024-06-02T16:49:06.902713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:55:41.500382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858177+0000","last_change":"2024-06-02T16:49:04.854952+0000","last_active":"2024-06-02T16:49:06.858177+0000","last_peered":"2024-06-02T16:49:06.858177+0000","last_clean":"2024-06-02T16:49:06.858177+0000","last_became_active":"2024-06-02T16:49:04.854152+0000","last_became_peered":"2024-06-02T16:49:04.854152+0000","last_unstale":"2024-06-02T16:49:06.858177+0000","last_undegraded":"2024-06-02T16:49:06.858177+0000","last_fullsized":"2024-06-02T16:49:06.858177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:58.489699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902768+0000","last_change":"2024-06-02T16:49:05.847980+0000","last_active":"2024-06-02T16:49:06.902768+0000","last_peered":"2024-06-02T16:49:06.902768+0000","last_clean":"2024-06-02T16:49:06.902768+0000","last_became_active":"2024-06-02T16:49:05.847687+0000","last_became_peered":"2024-06-02T16:49:05.847687+0000","last_unstale":"2024-06-02T16:49:06.902768+0000","last_undegraded":"2024-06-02T16:49:06.902768+0000","last_fullsized":"2024-06-02T16:49:06.902768+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:10.082580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851825+0000","last_change":"2024-06-02T16:49:04.848777+0000","last_active":"2024-06-02T16:49:06.851825+0000","last_peered":"2024-06-02T16:49:06.851825+0000","last_clean":"2024-06-02T16:49:06.851825+0000","last_became_active":"2024-06-02T16:49:04.848425+0000","last_became_peered":"2024-06-02T16:49:04.848425+0000","last_unstale":"2024-06-02T16:49:06.851825+0000","last_undegraded":"2024-06-02T16:49:06.851825+0000","last_fullsized":"2024-06-02T16:49:06.851825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:58.489699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902678+0000","last_change":"2024-06-02T16:49:05.859132+0000","last_active":"2024-06-02T16:49:06.902678+0000","last_peered":"2024-06-02T16:49:06.902678+0000","last_clean":"2024-06-02T16:49:06.902678+0000","last_became_active":"2024-06-02T16:49:05.854935+0000","last_became_peered":"2024-06-02T16:49:05.854935+0000","last_unstale":"2024-06-02T16:49:06.902678+0000","last_undegraded":"2024-06-02T16:49:06.902678+0000","last_fullsized":"2024-06-02T16:49:06.902678+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:13.844902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903039+0000","last_change":"2024-06-02T16:49:04.849972+0000","last_active":"2024-06-02T16:49:06.903039+0000","last_peered":"2024-06-02T16:49:06.903039+0000","last_clean":"2024-06-02T16:49:06.903039+0000","last_became_active":"2024-06-02T16:49:04.849677+0000","last_became_peered":"2024-06-02T16:49:04.849677+0000","last_unstale":"2024-06-02T16:49:06.903039+0000","last_undegraded":"2024-06-02T16:49:06.903039+0000","last_fullsized":"2024-06-02T16:49:06.903039+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:07.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903162+0000","last_change":"2024-06-02T16:49:05.861669+0000","last_active":"2024-06-02T16:49:06.903162+0000","last_peered":"2024-06-02T16:49:06.903162+0000","last_clean":"2024-06-02T16:49:06.903162+0000","last_became_active":"2024-06-02T16:49:05.861294+0000","last_became_peered":"2024-06-02T16:49:05.861294+0000","last_unstale":"2024-06-02T16:49:06.903162+0000","last_undegraded":"2024-06-02T16:49:06.903162+0000","last_fullsized":"2024-06-02T16:49:06.903162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:49:59.495776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901907+0000","last_change":"2024-06-02T16:49:04.844955+0000","last_active":"2024-06-02T16:49:06.901907+0000","last_peered":"2024-06-02T16:49:06.901907+0000","last_clean":"2024-06-02T16:49:06.901907+0000","last_became_active":"2024-06-02T16:49:04.844075+0000","last_became_peered":"2024-06-02T16:49:04.844075+0000","last_unstale":"2024-06-02T16:49:06.901907+0000","last_undegraded":"2024-06-02T16:49:06.901907+0000","last_fullsized":"2024-06-02T16:49:06.901907+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:19:59.936131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905351+0000","last_change":"2024-06-02T16:49:05.857352+0000","last_active":"2024-06-02T16:49:06.905351+0000","last_peered":"2024-06-02T16:49:06.905351+0000","last_clean":"2024-06-02T16:49:06.905351+0000","last_became_active":"2024-06-02T16:49:05.857090+0000","last_became_peered":"2024-06-02T16:49:05.857090+0000","last_unstale":"2024-06-02T16:49:06.905351+0000","last_undegraded":"2024-06-02T16:49:06.905351+0000","last_fullsized":"2024-06-02T16:49:06.905351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:38:21.530558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903267+0000","last_change":"2024-06-02T16:49:04.842013+0000","last_active":"2024-06-02T16:49:06.903267+0000","last_peered":"2024-06-02T16:49:06.903267+0000","last_clean":"2024-06-02T16:49:06.903267+0000","last_became_active":"2024-06-02T16:49:04.841716+0000","last_became_peered":"2024-06-02T16:49:04.841716+0000","last_unstale":"2024-06-02T16:49:06.903267+0000","last_undegraded":"2024-06-02T16:49:06.903267+0000","last_fullsized":"2024-06-02T16:49:06.903267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:25:49.778982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903751+0000","last_change":"2024-06-02T16:49:05.866001+0000","last_active":"2024-06-02T16:49:06.903751+0000","last_peered":"2024-06-02T16:49:06.903751+0000","last_clean":"2024-06-02T16:49:06.903751+0000","last_became_active":"2024-06-02T16:49:05.864622+0000","last_became_peered":"2024-06-02T16:49:05.864622+0000","last_unstale":"2024-06-02T16:49:06.903751+0000","last_undegraded":"2024-06-02T16:49:06.903751+0000","last_fullsized":"2024-06-02T16:49:06.903751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:38.932871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904148+0000","last_change":"2024-06-02T16:49:04.853618+0000","last_active":"2024-06-02T16:49:06.904148+0000","last_peered":"2024-06-02T16:49:06.904148+0000","last_clean":"2024-06-02T16:49:06.904148+0000","last_became_active":"2024-06-02T16:49:04.853343+0000","last_became_peered":"2024-06-02T16:49:04.853343+0000","last_unstale":"2024-06-02T16:49:06.904148+0000","last_undegraded":"2024-06-02T16:49:06.904148+0000","last_fullsized":"2024-06-02T16:49:06.904148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:59:16.376362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858712+0000","last_change":"2024-06-02T16:49:05.860395+0000","last_active":"2024-06-02T16:49:06.858712+0000","last_peered":"2024-06-02T16:49:06.858712+0000","last_clean":"2024-06-02T16:49:06.858712+0000","last_became_active":"2024-06-02T16:49:05.860135+0000","last_became_peered":"2024-06-02T16:49:05.860135+0000","last_unstale":"2024-06-02T16:49:06.858712+0000","last_undegraded":"2024-06-02T16:49:06.858712+0000","last_fullsized":"2024-06-02T16:49:06.858712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:47:00.696107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906001+0000","last_change":"2024-06-02T16:49:04.842122+0000","last_active":"2024-06-02T16:49:06.906001+0000","last_peered":"2024-06-02T16:49:06.906001+0000","last_clean":"2024-06-02T16:49:06.906001+0000","last_became_active":"2024-06-02T16:49:04.841575+0000","last_became_peered":"2024-06-02T16:49:04.841575+0000","last_unstale":"2024-06-02T16:49:06.906001+0000","last_undegraded":"2024-06-02T16:49:06.906001+0000","last_fullsized":"2024-06-02T16:49:06.906001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:48:36.122740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852121+0000","last_change":"2024-06-02T16:49:05.865460+0000","last_active":"2024-06-02T16:49:06.852121+0000","last_peered":"2024-06-02T16:49:06.852121+0000","last_clean":"2024-06-02T16:49:06.852121+0000","last_became_active":"2024-06-02T16:49:05.865174+0000","last_became_peered":"2024-06-02T16:49:05.865174+0000","last_unstale":"2024-06-02T16:49:06.852121+0000","last_undegraded":"2024-06-02T16:49:06.852121+0000","last_fullsized":"2024-06-02T16:49:06.852121+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:31:56.772769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.859023+0000","last_change":"2024-06-02T16:49:04.862317+0000","last_active":"2024-06-02T16:49:06.859023+0000","last_peered":"2024-06-02T16:49:06.859023+0000","last_clean":"2024-06-02T16:49:06.859023+0000","last_became_active":"2024-06-02T16:49:04.862012+0000","last_became_peered":"2024-06-02T16:49:04.862012+0000","last_unstale":"2024-06-02T16:49:06.859023+0000","last_undegraded":"2024-06-02T16:49:06.859023+0000","last_fullsized":"2024-06-02T16:49:06.859023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:37.926794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858882+0000","last_change":"2024-06-02T16:49:05.865054+0000","last_active":"2024-06-02T16:49:06.858882+0000","last_peered":"2024-06-02T16:49:06.858882+0000","last_clean":"2024-06-02T16:49:06.858882+0000","last_became_active":"2024-06-02T16:49:05.864602+0000","last_became_peered":"2024-06-02T16:49:05.864602+0000","last_unstale":"2024-06-02T16:49:06.858882+0000","last_undegraded":"2024-06-02T16:49:06.858882+0000","last_fullsized":"2024-06-02T16:49:06.858882+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:15:55.614467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902139+0000","last_change":"2024-06-02T16:49:04.845668+0000","last_active":"2024-06-02T16:49:06.902139+0000","last_peered":"2024-06-02T16:49:06.902139+0000","last_clean":"2024-06-02T16:49:06.902139+0000","last_became_active":"2024-06-02T16:49:04.845353+0000","last_became_peered":"2024-06-02T16:49:04.845353+0000","last_unstale":"2024-06-02T16:49:06.902139+0000","last_undegraded":"2024-06-02T16:49:06.902139+0000","last_fullsized":"2024-06-02T16:49:06.902139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:54:31.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905897+0000","last_change":"2024-06-02T16:49:05.852440+0000","last_active":"2024-06-02T16:49:06.905897+0000","last_peered":"2024-06-02T16:49:06.905897+0000","last_clean":"2024-06-02T16:49:06.905897+0000","last_became_active":"2024-06-02T16:49:05.852128+0000","last_became_peered":"2024-06-02T16:49:05.852128+0000","last_unstale":"2024-06-02T16:49:06.905897+0000","last_undegraded":"2024-06-02T16:49:06.905897+0000","last_fullsized":"2024-06-02T16:49:06.905897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:17:36.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851938+0000","last_change":"2024-06-02T16:49:04.846144+0000","last_active":"2024-06-02T16:49:06.851938+0000","last_peered":"2024-06-02T16:49:06.851938+0000","last_clean":"2024-06-02T16:49:06.851938+0000","last_became_active":"2024-06-02T16:49:04.845895+0000","last_became_peered":"2024-06-02T16:49:04.845895+0000","last_unstale":"2024-06-02T16:49:06.851938+0000","last_undegraded":"2024-06-02T16:49:06.851938+0000","last_fullsized":"2024-06-02T16:49:06.851938+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:37.926794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905417+0000","last_change":"2024-06-02T16:49:05.871797+0000","last_active":"2024-06-02T16:49:06.905417+0000","last_peered":"2024-06-02T16:49:06.905417+0000","last_clean":"2024-06-02T16:49:06.905417+0000","last_became_active":"2024-06-02T16:49:05.870953+0000","last_became_peered":"2024-06-02T16:49:05.870953+0000","last_unstale":"2024-06-02T16:49:06.905417+0000","last_undegraded":"2024-06-02T16:49:06.905417+0000","last_fullsized":"2024-06-02T16:49:06.905417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:01.881856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858036+0000","last_change":"2024-06-02T16:49:04.851245+0000","last_active":"2024-06-02T16:49:06.858036+0000","last_peered":"2024-06-02T16:49:06.858036+0000","last_clean":"2024-06-02T16:49:06.858036+0000","last_became_active":"2024-06-02T16:49:04.850886+0000","last_became_peered":"2024-06-02T16:49:04.850886+0000","last_unstale":"2024-06-02T16:49:06.858036+0000","last_undegraded":"2024-06-02T16:49:06.858036+0000","last_fullsized":"2024-06-02T16:49:06.858036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:09.076503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851328+0000","last_change":"2024-06-02T16:49:05.857394+0000","last_active":"2024-06-02T16:49:06.851328+0000","last_peered":"2024-06-02T16:49:06.851328+0000","last_clean":"2024-06-02T16:49:06.851328+0000","last_became_active":"2024-06-02T16:49:05.856400+0000","last_became_peered":"2024-06-02T16:49:05.856400+0000","last_unstale":"2024-06-02T16:49:06.851328+0000","last_undegraded":"2024-06-02T16:49:06.851328+0000","last_fullsized":"2024-06-02T16:49:06.851328+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:51:10.096734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851588+0000","last_change":"2024-06-02T16:49:04.847272+0000","last_active":"2024-06-02T16:49:06.851588+0000","last_peered":"2024-06-02T16:49:06.851588+0000","last_clean":"2024-06-02T16:49:06.851588+0000","last_became_active":"2024-06-02T16:49:04.846925+0000","last_became_peered":"2024-06-02T16:49:04.846925+0000","last_unstale":"2024-06-02T16:49:06.851588+0000","last_undegraded":"2024-06-02T16:49:06.851588+0000","last_fullsized":"2024-06-02T16:49:06.851588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:38:00.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858089+0000","last_change":"2024-06-02T16:49:05.857321+0000","last_active":"2024-06-02T16:49:06.858089+0000","last_peered":"2024-06-02T16:49:06.858089+0000","last_clean":"2024-06-02T16:49:06.858089+0000","last_became_active":"2024-06-02T16:49:05.856977+0000","last_became_peered":"2024-06-02T16:49:05.856977+0000","last_unstale":"2024-06-02T16:49:06.858089+0000","last_undegraded":"2024-06-02T16:49:06.858089+0000","last_fullsized":"2024-06-02T16:49:06.858089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:02:18.819138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903472+0000","last_change":"2024-06-02T16:49:04.836399+0000","last_active":"2024-06-02T16:49:06.903472+0000","last_peered":"2024-06-02T16:49:06.903472+0000","last_clean":"2024-06-02T16:49:06.903472+0000","last_became_active":"2024-06-02T16:49:04.836106+0000","last_became_peered":"2024-06-02T16:49:04.836106+0000","last_unstale":"2024-06-02T16:49:06.903472+0000","last_undegraded":"2024-06-02T16:49:06.903472+0000","last_fullsized":"2024-06-02T16:49:06.903472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:57:56.684173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904944+0000","last_change":"2024-06-02T16:49:05.862992+0000","last_active":"2024-06-02T16:49:06.904944+0000","last_peered":"2024-06-02T16:49:06.904944+0000","last_clean":"2024-06-02T16:49:06.904944+0000","last_became_active":"2024-06-02T16:49:05.862697+0000","last_became_peered":"2024-06-02T16:49:05.862697+0000","last_unstale":"2024-06-02T16:49:06.904944+0000","last_undegraded":"2024-06-02T16:49:06.904944+0000","last_fullsized":"2024-06-02T16:49:06.904944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:41.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.901547+0000","last_change":"2024-06-02T16:49:04.841220+0000","last_active":"2024-06-02T16:49:06.901547+0000","last_peered":"2024-06-02T16:49:06.901547+0000","last_clean":"2024-06-02T16:49:06.901547+0000","last_became_active":"2024-06-02T16:49:04.840836+0000","last_became_peered":"2024-06-02T16:49:04.840836+0000","last_unstale":"2024-06-02T16:49:06.901547+0000","last_undegraded":"2024-06-02T16:49:06.901547+0000","last_fullsized":"2024-06-02T16:49:06.901547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:55:12.937190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906427+0000","last_change":"2024-06-02T16:49:05.868543+0000","last_active":"2024-06-02T16:49:06.906427+0000","last_peered":"2024-06-02T16:49:06.906427+0000","last_clean":"2024-06-02T16:49:06.906427+0000","last_became_active":"2024-06-02T16:49:05.868227+0000","last_became_peered":"2024-06-02T16:49:05.868227+0000","last_unstale":"2024-06-02T16:49:06.906427+0000","last_undegraded":"2024-06-02T16:49:06.906427+0000","last_fullsized":"2024-06-02T16:49:06.906427+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:25:14.803213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904140+0000","last_change":"2024-06-02T16:49:04.852954+0000","last_active":"2024-06-02T16:49:06.904140+0000","last_peered":"2024-06-02T16:49:06.904140+0000","last_clean":"2024-06-02T16:49:06.904140+0000","last_became_active":"2024-06-02T16:49:04.852534+0000","last_became_peered":"2024-06-02T16:49:04.852534+0000","last_unstale":"2024-06-02T16:49:06.904140+0000","last_undegraded":"2024-06-02T16:49:06.904140+0000","last_fullsized":"2024-06-02T16:49:06.904140+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:09:46.331602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905022+0000","last_change":"2024-06-02T16:49:05.855196+0000","last_active":"2024-06-02T16:49:06.905022+0000","last_peered":"2024-06-02T16:49:06.905022+0000","last_clean":"2024-06-02T16:49:06.905022+0000","last_became_active":"2024-06-02T16:49:05.854522+0000","last_became_peered":"2024-06-02T16:49:05.854522+0000","last_unstale":"2024-06-02T16:49:06.905022+0000","last_undegraded":"2024-06-02T16:49:06.905022+0000","last_fullsized":"2024-06-02T16:49:06.905022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:59:17.382438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903397+0000","last_change":"2024-06-02T16:49:04.848288+0000","last_active":"2024-06-02T16:49:06.903397+0000","last_peered":"2024-06-02T16:49:06.903397+0000","last_clean":"2024-06-02T16:49:06.903397+0000","last_became_active":"2024-06-02T16:49:04.847874+0000","last_became_peered":"2024-06-02T16:49:04.847874+0000","last_unstale":"2024-06-02T16:49:06.903397+0000","last_undegraded":"2024-06-02T16:49:06.903397+0000","last_fullsized":"2024-06-02T16:49:06.903397+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:09.076503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.905092+0000","last_change":"2024-06-02T16:49:05.849739+0000","last_active":"2024-06-02T16:49:06.905092+0000","last_peered":"2024-06-02T16:49:06.905092+0000","last_clean":"2024-06-02T16:49:06.905092+0000","last_became_active":"2024-06-02T16:49:05.849473+0000","last_became_peered":"2024-06-02T16:49:05.849473+0000","last_unstale":"2024-06-02T16:49:06.905092+0000","last_undegraded":"2024-06-02T16:49:06.905092+0000","last_fullsized":"2024-06-02T16:49:06.905092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:52.741243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851997+0000","last_change":"2024-06-02T16:49:04.860959+0000","last_active":"2024-06-02T16:49:06.851997+0000","last_peered":"2024-06-02T16:49:06.851997+0000","last_clean":"2024-06-02T16:49:06.851997+0000","last_became_active":"2024-06-02T16:49:04.860732+0000","last_became_peered":"2024-06-02T16:49:04.860732+0000","last_unstale":"2024-06-02T16:49:06.851997+0000","last_undegraded":"2024-06-02T16:49:06.851997+0000","last_fullsized":"2024-06-02T16:49:06.851997+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:34.038541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851621+0000","last_change":"2024-06-02T16:49:05.860759+0000","last_active":"2024-06-02T16:49:06.851621+0000","last_peered":"2024-06-02T16:49:06.851621+0000","last_clean":"2024-06-02T16:49:06.851621+0000","last_became_active":"2024-06-02T16:49:05.856482+0000","last_became_peered":"2024-06-02T16:49:05.856482+0000","last_unstale":"2024-06-02T16:49:06.851621+0000","last_undegraded":"2024-06-02T16:49:06.851621+0000","last_fullsized":"2024-06-02T16:49:06.851621+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:13.634138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852105+0000","last_change":"2024-06-02T16:49:04.848319+0000","last_active":"2024-06-02T16:49:06.852105+0000","last_peered":"2024-06-02T16:49:06.852105+0000","last_clean":"2024-06-02T16:49:06.852105+0000","last_became_active":"2024-06-02T16:49:04.847685+0000","last_became_peered":"2024-06-02T16:49:04.847685+0000","last_unstale":"2024-06-02T16:49:06.852105+0000","last_undegraded":"2024-06-02T16:49:06.852105+0000","last_fullsized":"2024-06-02T16:49:06.852105+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:09.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903084+0000","last_change":"2024-06-02T16:49:05.845014+0000","last_active":"2024-06-02T16:49:06.903084+0000","last_peered":"2024-06-02T16:49:06.903084+0000","last_clean":"2024-06-02T16:49:06.903084+0000","last_became_active":"2024-06-02T16:49:05.844738+0000","last_became_peered":"2024-06-02T16:49:05.844738+0000","last_unstale":"2024-06-02T16:49:06.903084+0000","last_undegraded":"2024-06-02T16:49:06.903084+0000","last_fullsized":"2024-06-02T16:49:06.903084+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:25:22.230560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902107+0000","last_change":"2024-06-02T16:49:04.855724+0000","last_active":"2024-06-02T16:49:06.902107+0000","last_peered":"2024-06-02T16:49:06.902107+0000","last_clean":"2024-06-02T16:49:06.902107+0000","last_became_active":"2024-06-02T16:49:04.855449+0000","last_became_peered":"2024-06-02T16:49:04.855449+0000","last_unstale":"2024-06-02T16:49:06.902107+0000","last_undegraded":"2024-06-02T16:49:06.902107+0000","last_fullsized":"2024-06-02T16:49:06.902107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:07:08.147829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904955+0000","last_change":"2024-06-02T16:49:05.857785+0000","last_active":"2024-06-02T16:49:06.904955+0000","last_peered":"2024-06-02T16:49:06.904955+0000","last_clean":"2024-06-02T16:49:06.904955+0000","last_became_active":"2024-06-02T16:49:05.857488+0000","last_became_peered":"2024-06-02T16:49:05.857488+0000","last_unstale":"2024-06-02T16:49:06.904955+0000","last_undegraded":"2024-06-02T16:49:06.904955+0000","last_fullsized":"2024-06-02T16:49:06.904955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T21:22:20.184744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902881+0000","last_change":"2024-06-02T16:49:04.848650+0000","last_active":"2024-06-02T16:49:06.902881+0000","last_peered":"2024-06-02T16:49:06.902881+0000","last_clean":"2024-06-02T16:49:06.902881+0000","last_became_active":"2024-06-02T16:49:04.848243+0000","last_became_peered":"2024-06-02T16:49:04.848243+0000","last_unstale":"2024-06-02T16:49:06.902881+0000","last_undegraded":"2024-06-02T16:49:06.902881+0000","last_fullsized":"2024-06-02T16:49:06.902881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:09:54.683984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902776+0000","last_change":"2024-06-02T16:49:05.852801+0000","last_active":"2024-06-02T16:49:06.902776+0000","last_peered":"2024-06-02T16:49:06.902776+0000","last_clean":"2024-06-02T16:49:06.902776+0000","last_became_active":"2024-06-02T16:49:05.852340+0000","last_became_peered":"2024-06-02T16:49:05.852340+0000","last_unstale":"2024-06-02T16:49:06.902776+0000","last_undegraded":"2024-06-02T16:49:06.902776+0000","last_fullsized":"2024-06-02T16:49:06.902776+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:26:10.082580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857516+0000","last_change":"2024-06-02T16:49:04.845110+0000","last_active":"2024-06-02T16:49:06.857516+0000","last_peered":"2024-06-02T16:49:06.857516+0000","last_clean":"2024-06-02T16:49:06.857516+0000","last_became_active":"2024-06-02T16:49:04.844807+0000","last_became_peered":"2024-06-02T16:49:04.844807+0000","last_unstale":"2024-06-02T16:49:06.857516+0000","last_undegraded":"2024-06-02T16:49:06.857516+0000","last_fullsized":"2024-06-02T16:49:06.857516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:12.838825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906285+0000","last_change":"2024-06-02T16:49:05.862796+0000","last_active":"2024-06-02T16:49:06.906285+0000","last_peered":"2024-06-02T16:49:06.906285+0000","last_clean":"2024-06-02T16:49:06.906285+0000","last_became_active":"2024-06-02T16:49:05.862471+0000","last_became_peered":"2024-06-02T16:49:05.862471+0000","last_unstale":"2024-06-02T16:49:06.906285+0000","last_undegraded":"2024-06-02T16:49:06.906285+0000","last_fullsized":"2024-06-02T16:49:06.906285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:02:09.290349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.852290+0000","last_change":"2024-06-02T16:49:04.855304+0000","last_active":"2024-06-02T16:49:06.852290+0000","last_peered":"2024-06-02T16:49:06.852290+0000","last_clean":"2024-06-02T16:49:06.852290+0000","last_became_active":"2024-06-02T16:49:04.854985+0000","last_became_peered":"2024-06-02T16:49:04.854985+0000","last_unstale":"2024-06-02T16:49:06.852290+0000","last_undegraded":"2024-06-02T16:49:06.852290+0000","last_fullsized":"2024-06-02T16:49:06.852290+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:41.471235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904506+0000","last_change":"2024-06-02T16:49:05.866074+0000","last_active":"2024-06-02T16:49:06.904506+0000","last_peered":"2024-06-02T16:49:06.904506+0000","last_clean":"2024-06-02T16:49:06.904506+0000","last_became_active":"2024-06-02T16:49:05.865801+0000","last_became_peered":"2024-06-02T16:49:05.865801+0000","last_unstale":"2024-06-02T16:49:06.904506+0000","last_undegraded":"2024-06-02T16:49:06.904506+0000","last_fullsized":"2024-06-02T16:49:06.904506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:10.844175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.859055+0000","last_change":"2024-06-02T16:49:04.861472+0000","last_active":"2024-06-02T16:49:06.859055+0000","last_peered":"2024-06-02T16:49:06.859055+0000","last_clean":"2024-06-02T16:49:06.859055+0000","last_became_active":"2024-06-02T16:49:04.861067+0000","last_became_peered":"2024-06-02T16:49:04.861067+0000","last_unstale":"2024-06-02T16:49:06.859055+0000","last_undegraded":"2024-06-02T16:49:06.859055+0000","last_fullsized":"2024-06-02T16:49:06.859055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:27:09.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858884+0000","last_change":"2024-06-02T16:49:05.857560+0000","last_active":"2024-06-02T16:49:06.858884+0000","last_peered":"2024-06-02T16:49:06.858884+0000","last_clean":"2024-06-02T16:49:06.858884+0000","last_became_active":"2024-06-02T16:49:05.857289+0000","last_became_peered":"2024-06-02T16:49:05.857289+0000","last_unstale":"2024-06-02T16:49:06.858884+0000","last_undegraded":"2024-06-02T16:49:06.858884+0000","last_fullsized":"2024-06-02T16:49:06.858884+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T19:40:57.517191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903216+0000","last_change":"2024-06-02T16:49:04.845185+0000","last_active":"2024-06-02T16:49:06.903216+0000","last_peered":"2024-06-02T16:49:06.903216+0000","last_clean":"2024-06-02T16:49:06.903216+0000","last_became_active":"2024-06-02T16:49:04.844869+0000","last_became_peered":"2024-06-02T16:49:04.844869+0000","last_unstale":"2024-06-02T16:49:06.903216+0000","last_undegraded":"2024-06-02T16:49:06.903216+0000","last_fullsized":"2024-06-02T16:49:06.903216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:31:35.546992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851723+0000","last_change":"2024-06-02T16:49:05.861470+0000","last_active":"2024-06-02T16:49:06.851723+0000","last_peered":"2024-06-02T16:49:06.851723+0000","last_clean":"2024-06-02T16:49:06.851723+0000","last_became_active":"2024-06-02T16:49:05.861129+0000","last_became_peered":"2024-06-02T16:49:05.861129+0000","last_unstale":"2024-06-02T16:49:06.851723+0000","last_undegraded":"2024-06-02T16:49:06.851723+0000","last_fullsized":"2024-06-02T16:49:06.851723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:18:52.285315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.858549+0000","last_change":"2024-06-02T16:49:04.861970+0000","last_active":"2024-06-02T16:49:06.858549+0000","last_peered":"2024-06-02T16:49:06.858549+0000","last_clean":"2024-06-02T16:49:06.858549+0000","last_became_active":"2024-06-02T16:49:04.861566+0000","last_became_peered":"2024-06-02T16:49:04.861566+0000","last_unstale":"2024-06-02T16:49:06.858549+0000","last_undegraded":"2024-06-02T16:49:06.858549+0000","last_fullsized":"2024-06-02T16:49:06.858549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:12:35.408203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.851903+0000","last_change":"2024-06-02T16:49:05.856568+0000","last_active":"2024-06-02T16:49:06.851903+0000","last_peered":"2024-06-02T16:49:06.851903+0000","last_clean":"2024-06-02T16:49:06.851903+0000","last_became_active":"2024-06-02T16:49:05.856146+0000","last_became_peered":"2024-06-02T16:49:05.856146+0000","last_unstale":"2024-06-02T16:49:06.851903+0000","last_undegraded":"2024-06-02T16:49:06.851903+0000","last_fullsized":"2024-06-02T16:49:06.851903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:16:03.579603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903337+0000","last_change":"2024-06-02T16:49:04.851437+0000","last_active":"2024-06-02T16:49:06.903337+0000","last_peered":"2024-06-02T16:49:06.903337+0000","last_clean":"2024-06-02T16:49:06.903337+0000","last_became_active":"2024-06-02T16:49:04.851140+0000","last_became_peered":"2024-06-02T16:49:04.851140+0000","last_unstale":"2024-06-02T16:49:06.903337+0000","last_undegraded":"2024-06-02T16:49:06.903337+0000","last_fullsized":"2024-06-02T16:49:06.903337+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:41.018755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902749+0000","last_change":"2024-06-02T16:49:05.848591+0000","last_active":"2024-06-02T16:49:06.902749+0000","last_peered":"2024-06-02T16:49:06.902749+0000","last_clean":"2024-06-02T16:49:06.902749+0000","last_became_active":"2024-06-02T16:49:05.848171+0000","last_became_peered":"2024-06-02T16:49:05.848171+0000","last_unstale":"2024-06-02T16:49:06.902749+0000","last_undegraded":"2024-06-02T16:49:06.902749+0000","last_fullsized":"2024-06-02T16:49:06.902749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T17:53:25.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902841+0000","last_change":"2024-06-02T16:49:04.857722+0000","last_active":"2024-06-02T16:49:06.902841+0000","last_peered":"2024-06-02T16:49:06.902841+0000","last_clean":"2024-06-02T16:49:06.902841+0000","last_became_active":"2024-06-02T16:49:04.857407+0000","last_became_peered":"2024-06-02T16:49:04.857407+0000","last_unstale":"2024-06-02T16:49:06.902841+0000","last_undegraded":"2024-06-02T16:49:06.902841+0000","last_fullsized":"2024-06-02T16:49:06.902841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T20:02:12.008903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.902607+0000","last_change":"2024-06-02T16:49:05.860197+0000","last_active":"2024-06-02T16:49:06.902607+0000","last_peered":"2024-06-02T16:49:06.902607+0000","last_clean":"2024-06-02T16:49:06.902607+0000","last_became_active":"2024-06-02T16:49:05.859270+0000","last_became_peered":"2024-06-02T16:49:05.859270+0000","last_unstale":"2024-06-02T16:49:06.902607+0000","last_undegraded":"2024-06-02T16:49:06.902607+0000","last_fullsized":"2024-06-02T16:49:06.902607+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:13.844902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.903749+0000","last_change":"2024-06-02T16:49:04.840212+0000","last_active":"2024-06-02T16:49:06.903749+0000","last_peered":"2024-06-02T16:49:06.903749+0000","last_clean":"2024-06-02T16:49:06.903749+0000","last_became_active":"2024-06-02T16:49:04.839674+0000","last_became_peered":"2024-06-02T16:49:04.839674+0000","last_unstale":"2024-06-02T16:49:06.903749+0000","last_undegraded":"2024-06-02T16:49:06.903749+0000","last_fullsized":"2024-06-02T16:49:06.903749+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:40.639543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.906059+0000","last_change":"2024-06-02T16:49:05.862177+0000","last_active":"2024-06-02T16:49:06.906059+0000","last_peered":"2024-06-02T16:49:06.906059+0000","last_clean":"2024-06-02T16:49:06.906059+0000","last_became_active":"2024-06-02T16:49:05.861899+0000","last_became_peered":"2024-06-02T16:49:05.861899+0000","last_unstale":"2024-06-02T16:49:06.906059+0000","last_undegraded":"2024-06-02T16:49:06.906059+0000","last_fullsized":"2024-06-02T16:49:06.906059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:04.802895+0000","last_clean_scrub_stamp":"2024-06-02T16:49:04.802895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:36:59.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.904353+0000","last_change":"2024-06-02T16:49:04.850223+0000","last_active":"2024-06-02T16:49:06.904353+0000","last_peered":"2024-06-02T16:49:06.904353+0000","last_clean":"2024-06-02T16:49:06.904353+0000","last_became_active":"2024-06-02T16:49:04.849924+0000","last_became_peered":"2024-06-02T16:49:04.849924+0000","last_unstale":"2024-06-02T16:49:06.904353+0000","last_undegraded":"2024-06-02T16:49:06.904353+0000","last_fullsized":"2024-06-02T16:49:06.904353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:49:03.796818+0000","last_clean_scrub_stamp":"2024-06-02T16:49:03.796818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T18:56:12.838825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":155,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-02T16:49:06.857577+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:06.857577+0000","last_peered":"2024-06-02T16:49:06.857577+0000","last_clean":"2024-06-02T16:49:06.857577+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:06.857577+0000","last_undegraded":"2024-06-02T16:49:06.857577+0000","last_fullsized":"2024-06-02T16:49:06.857577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476791,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":815718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476788,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35896,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":561152,"data_stored":225932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":557056,"data_stored":225330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476790,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40052,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331788,"statfs":{"total":96636764160,"available":96595750912,"internally_reserved":0,"allocated":565248,"data_stored":226872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40056,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331784,"statfs":{"total":96636764160,"available":96595746816,"internally_reserved":0,"allocated":565248,"data_stored":225898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35900,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335940,"statfs":{"total":96636764160,"available":96600002560,"internally_reserved":0,"allocated":569344,"data_stored":226894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36472,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335368,"statfs":{"total":96636764160,"available":96599416832,"internally_reserved":0,"allocated":1150976,"data_stored":815662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40052,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331788,"statfs":{"total":96636764160,"available":96595750912,"internally_reserved":0,"allocated":557056,"data_stored":225330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:10.861 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T16:49:10.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T16:49:11.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.125+0000 7fc3c5c00640 1 Processor -- start 2024-06-02T16:49:11.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.125+0000 7fc3c5c00640 1 -- start start 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 0x7fc3c00723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3c00b5de0 0x7fc3c006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0072e50 con 0x7fc3c00728f0 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c00b4320 con 0x7fc3c00b5de0 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c00b4600 con 0x7fc3c015f470 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.127+0000 7fc3c5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3c00b5de0 0x7fc3c006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3c00b5de0 0x7fc3c006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36780/0 (socket says 172.21.15.52:36780) 2024-06-02T16:49:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 -- 172.21.15.52:0/2663178584 learned_addr learned my addr 172.21.15.52:0/2663178584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3bfe00640 1 --2- 172.21.15.52:0/2663178584 >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 0x7fc3c00723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 -- 172.21.15.52:0/2663178584 >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 msgr2=0x7fc3c00723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 --2- 172.21.15.52:0/2663178584 >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 0x7fc3c00723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 -- 172.21.15.52:0/2663178584 >> v1:172.21.15.114:6789/0 conn(0x7fc3c00728f0 legacy=0x7fc3c00b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3c5200640 1 -- 172.21.15.52:0/2663178584 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00b48e0 con 0x7fc3c00b5de0 2024-06-02T16:49:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.128+0000 7fc3bfe00640 1 --2- 172.21.15.52:0/2663178584 >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 0x7fc3c00723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.129+0000 7fc3c5200640 1 --2- 172.21.15.52:0/2663178584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00b5de0 0x7fc3c006e410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0070630 tx=0x7fc3b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30a0f47c6bdbc30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3bf400640 1 -- 172.21.15.52:0/2663178584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8036070 con 0x7fc3c00b5de0 2024-06-02T16:49:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3bf400640 1 -- 172.21.15.52:0/2663178584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8031600 con 0x7fc3c00b5de0 2024-06-02T16:49:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3bf400640 1 -- 172.21.15.52:0/2663178584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80319d0 con 0x7fc3c00b5de0 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2663178584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00b5de0 msgr2=0x7fc3c006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2663178584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00b5de0 0x7fc3c006e410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0070630 tx=0x7fc3b802a6a0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2663178584 shutdown_connections 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2663178584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00b5de0 0x7fc3c006e410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2663178584 >> v2:172.21.15.114:3300/0 conn(0x7fc3c015f470 0x7fc3c00723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.130+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2663178584 >> 172.21.15.52:0/2663178584 conn(0x7fc3c00b2b60 msgr2=0x7fc3c00b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:11.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.131+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2663178584 shutdown_connections 2024-06-02T16:49:11.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.131+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2663178584 wait complete. 2024-06-02T16:49:11.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.132+0000 7fc3c5c00640 1 Processor -- start 2024-06-02T16:49:11.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.133+0000 7fc3c5c00640 1 -- start start 2024-06-02T16:49:11.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3c00b5de0 0x7fc3c009d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3c015f470 0x7fc3c00cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00b5260 con 0x7fc3c00728f0 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00b50e0 con 0x7fc3c015f470 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c0160680 con 0x7fc3c00b5de0 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36792/0 (socket says 172.21.15.52:36792) 2024-06-02T16:49:11.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 -- 172.21.15.52:0/2303161266 learned_addr learned my addr 172.21.15.52:0/2303161266 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 -- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3c00b5de0 msgr2=0x7fc3c009d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3c00b5de0 0x7fc3c009d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 -- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3c015f470 msgr2=0x7fc3c00cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3c015f470 0x7fc3c00cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.134+0000 7fc3bfe00640 1 -- 172.21.15.52:0/2303161266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c014ef20 con 0x7fc3c00728f0 2024-06-02T16:49:11.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3bfe00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c7f0 tx=0x7fc3b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0015070 con 0x7fc3c00728f0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0007820 con 0x7fc3c00728f0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0007bd0 con 0x7fc3c00728f0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c009dec0 con 0x7fc3c00728f0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.135+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c009e480 con 0x7fc3c00728f0 2024-06-02T16:49:11.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.137+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c00507e0 con 0x7fc3c00728f0 2024-06-02T16:49:11.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.138+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3b0018070 con 0x7fc3c00728f0 2024-06-02T16:49:11.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.139+0000 7fc3bcc00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 0x7fc39c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.139+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fc3b0097790 con 0x7fc3c00728f0 2024-06-02T16:49:11.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.139+0000 7fc3b7e00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 0x7fc39c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.141+0000 7fc3b7e00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 0x7fc39c078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006e290 tx=0x7fc3a80079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.143+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3c014ef20 con 0x7fc3c00728f0 2024-06-02T16:49:11.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.435+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc3c006d390 con 0x7fc3c00728f0 2024-06-02T16:49:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.441+0000 7fc3bcc00640 1 -- 172.21.15.52:0/2303161266 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7fc3b0061050 con 0x7fc3c00728f0 2024-06-02T16:49:11.439 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-06-02T16:49:11.440 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBZoVxmZEnJMxAAr4yfzMPfZh+kMj5NzDEdyQ== 2024-06-02T16:49:11.440 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-06-02T16:49:11.440 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-06-02T16:49:11.440 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T16:49:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-06-02T16:49:11.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 msgr2=0x7fc39c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 0x7fc39c078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006e290 tx=0x7fc3a80079b0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 msgr2=0x7fc3c014e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c7f0 tx=0x7fc3b000ccb0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 shutdown_connections 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc39c0762d0 0x7fc39c078790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3c015f470 0x7fc3c00cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc3c00b5de0 0x7fc3c009d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.443+0000 7fc3c5c00640 1 --2- 172.21.15.52:0/2303161266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3c00728f0 0x7fc3c014e9e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.444+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 >> 172.21.15.52:0/2303161266 conn(0x7fc3c00b2b60 msgr2=0x7fc3c00b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.444+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 shutdown_connections 2024-06-02T16:49:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.444+0000 7fc3c5c00640 1 -- 172.21.15.52:0/2303161266 wait complete. 2024-06-02T16:49:11.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.674+0000 7f57d7200640 1 Processor -- start 2024-06-02T16:49:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.674+0000 7f57d7200640 1 -- start start 2024-06-02T16:49:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.676+0000 7f57d7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 0x7f57d8072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.676+0000 7f57d7200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.676+0000 7f57d7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d8163be0 con 0x7f57d8162ea0 2024-06-02T16:49:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.676+0000 7f57d7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f57d806d490 con 0x7f57d8148460 2024-06-02T16:49:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.676+0000 7f57d7200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f57d806d6e0 con 0x7f57d80d2a30 2024-06-02T16:49:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.677+0000 7f57d6800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.677+0000 7f57d6800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:55716/0 (socket says 172.21.15.52:55716) 2024-06-02T16:49:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.677+0000 7f57d6800640 1 -- 172.21.15.52:0/2474604086 learned_addr learned my addr 172.21.15.52:0/2474604086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.677+0000 7f57cd400640 1 --1- 172.21.15.52:0/2474604086 >> v1:172.21.15.114:6789/0 conn(0x7f57d8162ea0 0x7f57d8163330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:40172/0 (socket says 172.21.15.52:40172) 2024-06-02T16:49:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.677+0000 7f57d5e00640 1 --2- 172.21.15.52:0/2474604086 >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 0x7f57d8072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d6800640 1 -- 172.21.15.52:0/2474604086 >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 msgr2=0x7f57d8072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d6800640 1 --2- 172.21.15.52:0/2474604086 >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 0x7f57d8072930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d6800640 1 -- 172.21.15.52:0/2474604086 >> v1:172.21.15.114:6789/0 conn(0x7f57d8162ea0 legacy=0x7f57d8163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d5400640 1 -- 172.21.15.52:0/2474604086 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881837119 0 0) 0x7f57d8163be0 con 0x7f57d8162ea0 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d6800640 1 -- 172.21.15.52:0/2474604086 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d806d9c0 con 0x7f57d80d2a30 2024-06-02T16:49:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.678+0000 7f57d5e00640 1 --2- 172.21.15.52:0/2474604086 >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 0x7f57d8072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T16:49:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.680+0000 7f57d6800640 1 --2- 172.21.15.52:0/2474604086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7b013ea132aeaa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.680+0000 7f57d5400640 1 -- 172.21.15.52:0/2474604086 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0036070 con 0x7f57d80d2a30 2024-06-02T16:49:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.680+0000 7f57d5400640 1 -- 172.21.15.52:0/2474604086 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d0031600 con 0x7f57d80d2a30 2024-06-02T16:49:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.680+0000 7f57d5400640 1 -- 172.21.15.52:0/2474604086 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00319d0 con 0x7f57d80d2a30 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 -- 172.21.15.52:0/2474604086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 msgr2=0x7f57d80c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 --2- 172.21.15.52:0/2474604086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d002a680 comp rx=0 tx=0).stop 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 -- 172.21.15.52:0/2474604086 shutdown_connections 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 --2- 172.21.15.52:0/2474604086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d80d2a30 0x7f57d80c7f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 --2- 172.21.15.52:0/2474604086 >> v2:172.21.15.114:3300/0 conn(0x7f57d8148460 0x7f57d8072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 -- 172.21.15.52:0/2474604086 >> 172.21.15.52:0/2474604086 conn(0x7f57d8070720 msgr2=0x7f57d8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 -- 172.21.15.52:0/2474604086 shutdown_connections 2024-06-02T16:49:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.681+0000 7f57d7200640 1 -- 172.21.15.52:0/2474604086 wait complete. 2024-06-02T16:49:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.683+0000 7f57d7200640 1 Processor -- start 2024-06-02T16:49:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.683+0000 7f57d7200640 1 -- start start 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d80d2a30 0x7f57d8143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d8162ea0 0x7f57d80b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57d80c8460 con 0x7f57d8148460 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8148a50 con 0x7f57d80d2a30 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57d7200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f57d80c85e0 con 0x7f57d8162ea0 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57cd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57cd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36794/0 (socket says 172.21.15.52:36794) 2024-06-02T16:49:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.684+0000 7f57cd400640 1 -- 172.21.15.52:0/2123398140 learned_addr learned my addr 172.21.15.52:0/2123398140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57d6800640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d8162ea0 0x7f57d80b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57d5e00640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d80d2a30 0x7f57d8143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 -- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d8162ea0 msgr2=0x7f57d80b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d8162ea0 0x7f57d80b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 -- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d80d2a30 msgr2=0x7f57d8143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d80d2a30 0x7f57d8143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 -- 172.21.15.52:0/2123398140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d81438a0 con 0x7f57d8148460 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cd400640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c3e0 tx=0x7f57c000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.685+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00074e0 con 0x7f57d8148460 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.686+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c00047e0 con 0x7f57d8148460 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.686+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d8161e00 con 0x7f57d8148460 2024-06-02T16:49:11.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.686+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0004bd0 con 0x7f57d8148460 2024-06-02T16:49:11.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.686+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d81623c0 con 0x7f57d8148460 2024-06-02T16:49:11.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.687+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d80507e0 con 0x7f57d8148460 2024-06-02T16:49:11.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.688+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57c0011070 con 0x7f57d8148460 2024-06-02T16:49:11.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.690+0000 7f57cea00640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 0x7f57b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:11.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.690+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f57c00972a0 con 0x7f57d8148460 2024-06-02T16:49:11.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.690+0000 7f57d5e00640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 0x7f57b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:11.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.692+0000 7f57d5e00640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 0x7f57b4078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d8146f00 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:11.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.694+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f57c0060b60 con 0x7f57d8148460 2024-06-02T16:49:11.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.948+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57d8072710 con 0x7f57d8148460 2024-06-02T16:49:11.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.949+0000 7f57cea00640 1 -- 172.21.15.52:0/2123398140 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f57c0060460 con 0x7f57d8148460 2024-06-02T16:49:11.948 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:11.948 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:11.949 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 msgr2=0x7f57b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 0x7f57b4078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d8146f00 tx=0x7f57c8008040 comp rx=0 tx=0).stop 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 msgr2=0x7f57d8143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c3e0 tx=0x7f57c000c8a0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 shutdown_connections 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f57b40762d0 0x7f57b4078790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57d8162ea0 0x7f57d80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57d8148460 0x7f57d8143360 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 --2- 172.21.15.52:0/2123398140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d80d2a30 0x7f57d8143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:11.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.952+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 >> 172.21.15.52:0/2123398140 conn(0x7f57d8070720 msgr2=0x7f57d8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:11.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.953+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 shutdown_connections 2024-06-02T16:49:11.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:11.953+0000 7f57d7200640 1 -- 172.21.15.52:0/2123398140 wait complete. 2024-06-02T16:49:12.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T16:49:05.320433+0000', 'modified': '2024-06-02T16:49:08.367179+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5208': {'gid': 5208, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/2393791862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2393791862}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2393791862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5208, 'qdb_cluster': [5208]} 2024-06-02T16:49:12.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T16:49:12.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-06-02T16:49:12.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.597+0000 7f301b200640 1 Processor -- start 2024-06-02T16:49:12.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.597+0000 7f301b200640 1 -- start start 2024-06-02T16:49:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f301b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f301b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30140b77a0 0x7f30140d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f301b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30140b9e90 con 0x7f30140d3e90 2024-06-02T16:49:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f301b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f30140b7c00 con 0x7f30140b77a0 2024-06-02T16:49:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f301b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f30140ba170 con 0x7f301415f590 2024-06-02T16:49:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.599+0000 7f3019e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:55740/0 (socket says 172.21.15.52:55740) 2024-06-02T16:49:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 -- 172.21.15.52:0/3947386521 learned_addr learned my addr 172.21.15.52:0/3947386521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019400640 1 --2- 172.21.15.52:0/3947386521 >> v2:172.21.15.114:3300/0 conn(0x7f30140b77a0 0x7f30140d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 -- 172.21.15.52:0/3947386521 >> v2:172.21.15.114:3300/0 conn(0x7f30140b77a0 msgr2=0x7f30140d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 --2- 172.21.15.52:0/3947386521 >> v2:172.21.15.114:3300/0 conn(0x7f30140b77a0 0x7f30140d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 -- 172.21.15.52:0/3947386521 >> v1:172.21.15.114:6789/0 conn(0x7f30140d3e90 legacy=0x7f30140d42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.600+0000 7f3019e00640 1 -- 172.21.15.52:0/3947386521 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30140ba450 con 0x7f301415f590 2024-06-02T16:49:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.602+0000 7f3019e00640 1 --2- 172.21.15.52:0/3947386521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f300c009e50 tx=0x7f300c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38903770a60f96fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.602+0000 7f3018a00640 1 -- 172.21.15.52:0/3947386521 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c036070 con 0x7f301415f590 2024-06-02T16:49:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.602+0000 7f3018a00640 1 -- 172.21.15.52:0/3947386521 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c031600 con 0x7f301415f590 2024-06-02T16:49:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.602+0000 7f3018a00640 1 -- 172.21.15.52:0/3947386521 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0319d0 con 0x7f301415f590 2024-06-02T16:49:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 -- 172.21.15.52:0/3947386521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 msgr2=0x7f30140b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 --2- 172.21.15.52:0/3947386521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f300c009e50 tx=0x7f300c02a680 comp rx=0 tx=0).stop 2024-06-02T16:49:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 -- 172.21.15.52:0/3947386521 shutdown_connections 2024-06-02T16:49:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 --2- 172.21.15.52:0/3947386521 >> v2:172.21.15.114:3300/0 conn(0x7f30140b77a0 0x7f30140d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 --2- 172.21.15.52:0/3947386521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30140b7260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 -- 172.21.15.52:0/3947386521 >> 172.21.15.52:0/3947386521 conn(0x7f3014073ea0 msgr2=0x7f30140742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 -- 172.21.15.52:0/3947386521 shutdown_connections 2024-06-02T16:49:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.603+0000 7f301b200640 1 -- 172.21.15.52:0/3947386521 wait complete. 2024-06-02T16:49:12.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.604+0000 7f301b200640 1 Processor -- start 2024-06-02T16:49:12.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.605+0000 7f301b200640 1 -- start start 2024-06-02T16:49:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.605+0000 7f301b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 0x7f301414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30141f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30140d49b0 con 0x7f30140b77a0 2024-06-02T16:49:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30140bad40 con 0x7f30140d3e90 2024-06-02T16:49:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f30140d4b30 con 0x7f301415f590 2024-06-02T16:49:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36796/0 (socket says 172.21.15.52:36796) 2024-06-02T16:49:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 -- 172.21.15.52:0/3162133334 learned_addr learned my addr 172.21.15.52:0/3162133334 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f301a800640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30141f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019400640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 0x7f301414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 -- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 msgr2=0x7f30141f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30141f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 -- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 msgr2=0x7f301414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 0x7f301414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019e00640 1 -- 172.21.15.52:0/3162133334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3014150a40 con 0x7f30140b77a0 2024-06-02T16:49:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.606+0000 7f3019400640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 0x7f301414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f3019e00640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f300c000f80 tx=0x7f300c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f300a000640 1 -- 172.21.15.52:0/3162133334 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c036050 con 0x7f30140b77a0 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f300a000640 1 -- 172.21.15.52:0/3162133334 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c042070 con 0x7f30140b77a0 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f300a000640 1 -- 172.21.15.52:0/3162133334 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c009510 con 0x7f30140b77a0 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30140cedc0 con 0x7f30140b77a0 2024-06-02T16:49:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.607+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3014150ce0 con 0x7f30140b77a0 2024-06-02T16:49:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.610+0000 7f300a000640 1 -- 172.21.15.52:0/3162133334 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f300c007c70 con 0x7f30140b77a0 2024-06-02T16:49:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.611+0000 7f300a000640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 0x7f2ff8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.611+0000 7f300a000640 1 -- 172.21.15.52:0/3162133334 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f300c0b83d0 con 0x7f30140b77a0 2024-06-02T16:49:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.612+0000 7f301f7d3740 1 Processor -- start 2024-06-02T16:49:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.612+0000 7f301f7d3740 1 -- start start 2024-06-02T16:49:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.612+0000 7f3019400640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 0x7f2ff8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770395b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f7702dcdf0 con 0x55f770365cb0 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f7702cc990 con 0x55f7703931a0 2024-06-02T16:49:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55f7702d09d0 con 0x55f770392dc0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f3019400640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 0x7f2ff8078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3014074330 tx=0x7f3004008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36808/0 (socket says 172.21.15.52:36808) 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f301a800640 1 -- 172.21.15.52:0/4233685709 learned_addr learned my addr 172.21.15.52:0/4233685709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f3019400640 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770395b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.613+0000 7f3019e00640 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 -- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 msgr2=0x55f7703955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 -- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 msgr2=0x55f770395b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770395b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 -- 172.21.15.52:0/4233685709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f77026d9b0 con 0x55f770365cb0 2024-06-02T16:49:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f301a800640 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30100015d0 tx=0x7f3010001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b266abfc1bbdb79 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f2ffe600640 1 -- 172.21.15.52:0/4233685709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010019070 con 0x55f770365cb0 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f2ffe600640 1 -- 172.21.15.52:0/4233685709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3010001ce0 con 0x55f770365cb0 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.614+0000 7f2ffe600640 1 -- 172.21.15.52:0/4233685709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301000e6e0 con 0x55f770365cb0 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 -- 172.21.15.52:0/4233685709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 msgr2=0x55f770369230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30100015d0 tx=0x7f3010001a90 comp rx=0 tx=0).stop 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 -- 172.21.15.52:0/4233685709 shutdown_connections 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770365cb0 0x55f770369230 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770395b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 --2- 172.21.15.52:0/4233685709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 -- 172.21.15.52:0/4233685709 >> 172.21.15.52:0/4233685709 conn(0x55f770367f20 msgr2=0x55f7703b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 -- 172.21.15.52:0/4233685709 shutdown_connections 2024-06-02T16:49:12.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.615+0000 7f301f7d3740 1 -- 172.21.15.52:0/4233685709 wait complete. 2024-06-02T16:49:12.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.616+0000 7f301f7d3740 1 -- start start 2024-06-02T16:49:12.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.616+0000 7f301f7d3740 1 Processor -- start 2024-06-02T16:49:12.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f770392dc0 0x55f7703b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703b2750 0x55f7703b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f76ffb2850 con 0x55f7703931a0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f770274f20 con 0x55f770392dc0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55f77036ae40 con 0x55f7703b2750 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f301f7d3740 10 client.0 _ll_register_callbacks cb 0x55f7702c6ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f3019400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f3019400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36818/0 (socket says 172.21.15.52:36818) 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.617+0000 7f3019400640 1 -- 172.21.15.52:0/379267327 learned_addr learned my addr 172.21.15.52:0/379267327 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 -- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703b2750 msgr2=0x55f7703b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703b2750 0x55f7703b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 -- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f770392dc0 msgr2=0x55f7703b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f770392dc0 0x55f7703b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 -- 172.21.15.52:0/379267327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f770265d00 con 0x55f7703931a0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f3019400640 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3004015820 tx=0x7f3004004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bc5535fc0d06ac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f2ff2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300401c070 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3004004020 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.618+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3010001ce0 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f300402e050 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 10 client.5322 fetch_fsmap learned FSMap version 26 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f76ffe12d0 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3010001ce0 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f3004031020 con 0x55f7703931a0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 10 client.5322 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 10 client.5322 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 20 client.5322 populate_metadata read hostname 'smithi052' 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f77038ccd0 0x55f77038d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 4 client.5322 mds_command: new command op to 5208 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.619+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 --> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7702ded40 con 0x55f77038ccd0 2024-06-02T16:49:12.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.620+0000 7f3019e00640 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f77038ccd0 0x55f77038d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.621+0000 7f3019e00640 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f77038ccd0 0x55f77038d0b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f0f89f34e29495 server_cookie=cf8502fd8cfdfb21 in_seq=0 out_seq=0 2024-06-02T16:49:12.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.621+0000 7f2ff2a00640 10 client.5322 ms_handle_connect on v2:172.21.15.114:6835/2393791862 2024-06-02T16:49:12.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f2ff2a00640 1 -- 172.21.15.52:0/379267327 <== mds.0 v2:172.21.15.114:6835/2393791862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f7702ded40 con 0x55f77038ccd0 2024-06-02T16:49:12.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f2ff2a00640 10 client.5322 handle_command_reply: tid=0 2024-06-02T16:49:12.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 client.5322 shutdown 2024-06-02T16:49:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 msgr2=0x55f7703b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3004015820 tx=0x7f3004004730 comp rx=0 tx=0).stop 2024-06-02T16:49:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 shutdown_connections 2024-06-02T16:49:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f77038ccd0 0x55f77038d0b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703b2750 0x55f7703b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703931a0 0x55f7703b3ce0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 --2- 172.21.15.52:0/379267327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f770392dc0 0x55f7703b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f2ff2a00640 0 client.5322 ms_handle_reset on v2:172.21.15.114:6835/2393791862 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 >> 172.21.15.52:0/379267327 conn(0x55f770365cb0 msgr2=0x55f7703955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 shutdown_connections 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.624+0000 7f301f7d3740 1 -- 172.21.15.52:0/379267327 wait complete. 2024-06-02T16:49:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.625+0000 7f301f7d3740 20 client.5322 trim_cache size 0 max 16384 2024-06-02T16:49:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.647+0000 7f301f7d3740 1 Processor -- start 2024-06-02T16:49:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.648+0000 7f301f7d3740 1 -- start start 2024-06-02T16:49:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703931a0 0x55f7703610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3014200880 con 0x55f770392dc0 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3014152460 con 0x55f7703b2750 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f30140cd780 con 0x55f7703931a0 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36822/0 (socket says 172.21.15.52:36822) 2024-06-02T16:49:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 -- 172.21.15.52:0/2705466061 learned_addr learned my addr 172.21.15.52:0/2705466061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 -- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703931a0 msgr2=0x55f7703610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703931a0 0x55f7703610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 -- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703b2750 msgr2=0x55f77036add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.649+0000 7f3019e00640 1 -- 172.21.15.52:0/2705466061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7700ab6b0 con 0x55f770392dc0 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f3019e00640 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f300c07dc10 tx=0x7f300c0b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44f193898c90091 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f2ffdc00640 1 -- 172.21.15.52:0/2705466061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c081130 con 0x55f770392dc0 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f2ffdc00640 1 -- 172.21.15.52:0/2705466061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c037040 con 0x55f770392dc0 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f2ffdc00640 1 -- 172.21.15.52:0/2705466061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c081d20 con 0x55f770392dc0 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f301f7d3740 1 -- 172.21.15.52:0/2705466061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 msgr2=0x55f7703cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.650+0000 7f301f7d3740 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f300c07dc10 tx=0x7f300c0b8040 comp rx=0 tx=0).stop 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 -- 172.21.15.52:0/2705466061 shutdown_connections 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f7703931a0 0x55f7703610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 --2- 172.21.15.52:0/2705466061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f770392dc0 0x55f7703cb640 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 -- 172.21.15.52:0/2705466061 >> 172.21.15.52:0/2705466061 conn(0x55f770365cb0 msgr2=0x55f770364da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 -- 172.21.15.52:0/2705466061 shutdown_connections 2024-06-02T16:49:12.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.651+0000 7f301f7d3740 1 -- 172.21.15.52:0/2705466061 wait complete. 2024-06-02T16:49:12.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.652+0000 7f301f7d3740 1 -- start start 2024-06-02T16:49:12.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.652+0000 7f301f7d3740 1 Processor -- start 2024-06-02T16:49:12.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770369230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f77037e550 con 0x55f7703b2750 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f770399a90 con 0x55f7703931a0 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x55f770378b10 con 0x55f770392dc0 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301f7d3740 10 client.0 _ll_register_callbacks cb 0x7f3004009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36824/0 (socket says 172.21.15.52:36824) 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.653+0000 7f301a800640 1 -- 172.21.15.52:0/1659171583 learned_addr learned my addr 172.21.15.52:0/1659171583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f3019e00640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 -- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 msgr2=0x55f7703a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 -- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 msgr2=0x55f770369230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770369230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 -- 172.21.15.52:0/1659171583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f77038d870 con 0x55f7703b2750 2024-06-02T16:49:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f301a800640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ab5b8e9d63b1c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f2ff2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-06-02T16:49:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.654+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010022060 con 0x55f7703b2750 2024-06-02T16:49:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f301000e8f0 con 0x55f7703b2750 2024-06-02T16:49:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f300c037040 con 0x55f7703b2750 2024-06-02T16:49:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3010028050 con 0x55f7703b2750 2024-06-02T16:49:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 10 client.5328 fetch_fsmap learned FSMap version 26 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f7703a6ed0 con 0x55f7703b2750 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c037040 con 0x55f7703b2750 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f301002b020 con 0x55f7703b2750 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 10 client.5328 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 10 client.5328 resolve_mds: resolved name 'd' to daemon mds.d 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 20 client.5328 populate_metadata read hostname 'smithi052' 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f7703980f0 0x55f7703984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 4 client.5328 mds_command: new command op to 5208 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.655+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 --> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] -- command(tid 0: {"prefix": "status"}) -- 0x55f7702d8520 con 0x55f7703980f0 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.656+0000 7f3019e00640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f7703980f0 0x55f7703984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.657+0000 7f3019e00640 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f7703980f0 0x55f7703984d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fedf37abe61176e server_cookie=395c45c4cc60b815 in_seq=0 out_seq=0 2024-06-02T16:49:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.657+0000 7f2ff2a00640 10 client.5328 ms_handle_connect on v2:172.21.15.114:6835/2393791862 2024-06-02T16:49:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.657+0000 7f2ff2a00640 1 -- 172.21.15.52:0/1659171583 <== mds.0 v2:172.21.15.114:6835/2393791862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f7702d8520 con 0x55f7703980f0 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.657+0000 7f2ff2a00640 10 client.5328 handle_command_reply: tid=0 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 client.5328 shutdown 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 msgr2=0x55f77036add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005510 comp rx=0 tx=0).stop 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 shutdown_connections 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:6835/2393791862,v1:172.21.15.114:6837/2393791862] conn(0x55f7703980f0 0x55f7703984d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7703b2750 0x55f77036add0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f7703931a0 0x55f770369230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 --2- 172.21.15.52:0/1659171583 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f770392dc0 0x55f7703a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 >> 172.21.15.52:0/1659171583 conn(0x55f770365cb0 msgr2=0x55f7703afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f2ff2a00640 0 client.5328 ms_handle_reset on v2:172.21.15.114:6835/2393791862 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 shutdown_connections 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 1 -- 172.21.15.52:0/1659171583 wait complete. 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.658+0000 7f301f7d3740 20 client.5328 trim_cache size 0 max 16384 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "39df44fa-6b94-46ae-87c4-569eff4461cc", 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 5208, 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-06-02T16:49:12.659 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.8354968649999996, 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 26, 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 48, 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 48, 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 11.194551752000001 2024-06-02T16:49:12.660 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 msgr2=0x7f2ff8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 0x7f2ff8078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3014074330 tx=0x7f3004008040 comp rx=0 tx=0).stop 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 msgr2=0x7f30140cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f300c000f80 tx=0x7f300c004a40 comp rx=0 tx=0).stop 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 shutdown_connections 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2ff80762d0 0x7f2ff8078790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f301415f590 0x7f30141f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30140d3e90 0x7f301414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 --2- 172.21.15.52:0/3162133334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30140b77a0 0x7f30140cc4b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 >> 172.21.15.52:0/3162133334 conn(0x7f3014073ea0 msgr2=0x7f30140cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 shutdown_connections 2024-06-02T16:49:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.659+0000 7f301b200640 1 -- 172.21.15.52:0/3162133334 wait complete. 2024-06-02T16:49:12.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T16:49:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.894+0000 7f36f0a00640 1 Processor -- start 2024-06-02T16:49:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.894+0000 7f36f0a00640 1 -- start start 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.895+0000 7f36f0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec0b6c80 0x7f36ec0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.895+0000 7f36f0a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec1607c0 con 0x7f36ec0ba430 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.895+0000 7f36f0a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec163040 con 0x7f36ec15d060 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.895+0000 7f36f0a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec163c50 con 0x7f36ec0b6c80 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec0b6c80 0x7f36ec0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec0b6c80 0x7f36ec0b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35522/0 (socket says 172.21.15.52:35522) 2024-06-02T16:49:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 -- 172.21.15.52:0/759830618 learned_addr learned my addr 172.21.15.52:0/759830618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 -- 172.21.15.52:0/759830618 >> v1:172.21.15.114:6789/0 conn(0x7f36ec15d060 legacy=0x7f36ec0d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 -- 172.21.15.52:0/759830618 >> v1:172.21.15.52:6789/0 conn(0x7f36ec0ba430 legacy=0x7f36ec0ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.896+0000 7f36eaa00640 1 -- 172.21.15.52:0/759830618 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec163320 con 0x7f36ec0b6c80 2024-06-02T16:49:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.898+0000 7f36eaa00640 1 --2- 172.21.15.52:0/759830618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b6c80 0x7f36ec0b7100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009870 tx=0x7f36d802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a05cd617dc8ac37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.898+0000 7f36ea000640 1 -- 172.21.15.52:0/759830618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8037070 con 0x7f36ec0b6c80 2024-06-02T16:49:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.898+0000 7f36ea000640 1 -- 172.21.15.52:0/759830618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d802ae50 con 0x7f36ec0b6c80 2024-06-02T16:49:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.898+0000 7f36ea000640 1 -- 172.21.15.52:0/759830618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8032860 con 0x7f36ec0b6c80 2024-06-02T16:49:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 -- 172.21.15.52:0/759830618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b6c80 msgr2=0x7f36ec0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 --2- 172.21.15.52:0/759830618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b6c80 0x7f36ec0b7100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009870 tx=0x7f36d802a300 comp rx=0 tx=0).stop 2024-06-02T16:49:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 -- 172.21.15.52:0/759830618 shutdown_connections 2024-06-02T16:49:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 --2- 172.21.15.52:0/759830618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b6c80 0x7f36ec0b7100 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 -- 172.21.15.52:0/759830618 >> 172.21.15.52:0/759830618 conn(0x7f36ec0740e0 msgr2=0x7f36ec0d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 -- 172.21.15.52:0/759830618 shutdown_connections 2024-06-02T16:49:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.899+0000 7f36f0a00640 1 -- 172.21.15.52:0/759830618 wait complete. 2024-06-02T16:49:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.901+0000 7f36f0a00640 1 Processor -- start 2024-06-02T16:49:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.901+0000 7f36f0a00640 1 -- start start 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36ec0b6c80 0x7f36ec159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36ec15d060 0x7f36ec0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec0d0880 con 0x7f36ec0ba430 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1638e0 con 0x7f36ec15d060 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36f0a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec0d0a00 con 0x7f36ec0b6c80 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35526/0 (socket says 172.21.15.52:35526) 2024-06-02T16:49:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.902+0000 7f36eaa00640 1 -- 172.21.15.52:0/3041546747 learned_addr learned my addr 172.21.15.52:0/3041546747 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eb400640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36ec0b6c80 0x7f36ec159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36ebe00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36ec15d060 0x7f36ec0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 -- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36ec0b6c80 msgr2=0x7f36ec159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36ec0b6c80 0x7f36ec159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 -- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36ec15d060 msgr2=0x7f36ec0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36ec15d060 0x7f36ec0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 -- 172.21.15.52:0/3041546747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec159dc0 con 0x7f36ec0ba430 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.903+0000 7f36eaa00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f36d8000c00 tx=0x7f36d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.904+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8041070 con 0x7f36ec0ba430 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.904+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d803c890 con 0x7f36ec0ba430 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.904+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec15a0a0 con 0x7f36ec0ba430 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.904+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8037040 con 0x7f36ec0ba430 2024-06-02T16:49:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.904+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec15a660 con 0x7f36ec0ba430 2024-06-02T16:49:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.905+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec0507e0 con 0x7f36ec0ba430 2024-06-02T16:49:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.907+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36d8044070 con 0x7f36ec0ba430 2024-06-02T16:49:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.908+0000 7f36e3400640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 0x7f36cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.908+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f36d80b7ea0 con 0x7f36ec0ba430 2024-06-02T16:49:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.908+0000 7f36eb400640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 0x7f36cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.909+0000 7f36eb400640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 0x7f36cc078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000f60 tx=0x7f36dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:12.912+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36d8081800 con 0x7f36ec0ba430 2024-06-02T16:49:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.163+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f36ec15b9a0 con 0x7f36ec0ba430 2024-06-02T16:49:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.164+0000 7f36e3400640 1 -- 172.21.15.52:0/3041546747 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f36d8081100 con 0x7f36ec0ba430 2024-06-02T16:49:13.162 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T16:49:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 msgr2=0x7f36cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 0x7f36cc078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000f60 tx=0x7f36dc009040 comp rx=0 tx=0).stop 2024-06-02T16:49:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 msgr2=0x7f36ec15ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f36d8000c00 tx=0x7f36d80046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 shutdown_connections 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f36cc0762d0 0x7f36cc078790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36ec15d060 0x7f36ec0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0ba430 0x7f36ec15ae60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 --2- 172.21.15.52:0/3041546747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36ec0b6c80 0x7f36ec159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 >> 172.21.15.52:0/3041546747 conn(0x7f36ec0740e0 msgr2=0x7f36ec161400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.166+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 shutdown_connections 2024-06-02T16:49:13.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13.167+0000 7f36f0a00640 1 -- 172.21.15.52:0/3041546747 wait complete. 2024-06-02T16:49:13.183 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T16:49:13.184 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:49:13.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.184 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.239 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42366sec preferred_lft 42366sec 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.240 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 82:0f:40:a3:03:06 brd ff:ff:ff:ff:ff:ff 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::bcb9:74ff:fea9:58a3/64 scope link 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 86:1a:53:a2:08:58 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::841a:53ff:fea2:858/64 scope link 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 82:0f:40:a3:03:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T16:49:13.241 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::800f:40ff:fea3:306/64 scope link 2024-06-02T16:49:13.242 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-06-02T16:49:13.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.242 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T16:49:13.324 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-06-02T16:49:13.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.329 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-06-02T16:49:13.385 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-06-02T16:49:13.385 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T16:49:13.385 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T16:49:13.385 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T16:49:13.386 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T16:49:13.386 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-06-02T16:49:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T16:49:13.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:49:13.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.615 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:49:13.663 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T16:49:13.663 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T16:49:13.663 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:49:13.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-06-02T16:49:13.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:49:13.742 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:13.795 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T16:49:13.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T16:49:13.795 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:13.850 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-06-02T16:49:13.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:13.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:49:13.977 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:49:13.977 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:49:13.978 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:49:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:49:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:49:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:49:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:49:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:49:14.028 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-06-02T16:49:14.028 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.114:3300,172.21.15.114:3301" 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790" 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.52:6789,172.21.15.114:6789,172.21.15.114:6790:/ 2024-06-02T16:49:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=39df44fa-6b94-46ae-87c4-569eff4461cc" will pass to kernel 2024-06-02T16:49:14.033 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-02T16:49:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-06-02T16:49:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-02T16:49:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-06-02T16:49:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-02T16:49:14.038 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T16:49:14.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:14.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:14.119 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T16:49:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T16:49:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T16:49:14.258 INFO:teuthology.orchestra.run.smithi052.stdout:client5337 2024-06-02T16:49:14.258 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:14.258 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:14.314 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:14.315 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-06-02T16:49:14.315 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-06-02T16:49:14.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:14.315 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> import json 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> import sys 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> except OSError as e: 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> sys.exit(e.errno) 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-06-02T16:49:14.392 DEBUG:teuthology.orchestra.run.smithi052:> print(json.dumps( 2024-06-02T16:49:14.393 DEBUG:teuthology.orchestra.run.smithi052:> dict([(a, getattr(s, a)) for a in attrs]), 2024-06-02T16:49:14.393 DEBUG:teuthology.orchestra.run.smithi052:> indent=2)) 2024-06-02T16:49:14.393 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-06-02T16:49:14.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:14 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-06-02T16:49:14.564 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-06-02T16:49:14.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:14.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-06-02T16:49:14.672 INFO:teuthology.orchestra.run.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-06-02T16:49:15.014 INFO:teuthology.orchestra.run.smithi052.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-06-02T16:49:24.302 INFO:teuthology.orchestra.run.smithi052.stderr:Updating files: 14% (204/1398) Updating files: 15% (210/1398) Updating files: 16% (224/1398) Updating files: 17% (238/1398) Updating files: 18% (252/1398) Updating files: 19% (266/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 28% (393/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 44% (617/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 52% (734/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 80% (1127/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 90% (1272/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-06-02T16:49:24.318 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-06-02T16:49:24.318 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-06-02T16:49:24.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.545+0000 7f831d400640 1 Processor -- start 2024-06-02T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.545+0000 7f831d400640 1 -- start start 2024-06-02T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.546+0000 7f831d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.546+0000 7f831d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f831806fed0 0x7f831806f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.546+0000 7f831d400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83180ae8e0 con 0x7f83180d1450 2024-06-02T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.546+0000 7f831d400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f831815d6b0 con 0x7f831806fed0 2024-06-02T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.546+0000 7f831d400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f831806ed90 con 0x7f831815d2d0 2024-06-02T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.547+0000 7f8316800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.547+0000 7f8316800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:50276/0 (socket says 172.21.15.52:50276) 2024-06-02T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.547+0000 7f8316800640 1 -- 172.21.15.52:0/2171388950 learned_addr learned my addr 172.21.15.52:0/2171388950 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.547+0000 7f8315e00640 1 --2- 172.21.15.52:0/2171388950 >> v2:172.21.15.114:3300/0 conn(0x7f831806fed0 0x7f831806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.548+0000 7f8316800640 1 -- 172.21.15.52:0/2171388950 >> v2:172.21.15.114:3300/0 conn(0x7f831806fed0 msgr2=0x7f831806f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.548+0000 7f8316800640 1 --2- 172.21.15.52:0/2171388950 >> v2:172.21.15.114:3300/0 conn(0x7f831806fed0 0x7f831806f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.548+0000 7f8316800640 1 -- 172.21.15.52:0/2171388950 >> v1:172.21.15.114:6789/0 conn(0x7f83180d1450 legacy=0x7f83180727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.548+0000 7f8315400640 1 -- 172.21.15.52:0/2171388950 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687986919 0 0) 0x7f8310001110 con 0x7f83180d1450 2024-06-02T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.548+0000 7f8316800640 1 -- 172.21.15.52:0/2171388950 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83180ae600 con 0x7f831815d2d0 2024-06-02T16:49:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.550+0000 7f8316800640 1 --2- 172.21.15.52:0/2171388950 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8308009e50 tx=0x7f830802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62944919e046db3b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f8315400640 1 -- 172.21.15.52:0/2171388950 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308036070 con 0x7f831815d2d0 2024-06-02T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f8315400640 1 -- 172.21.15.52:0/2171388950 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8308031600 con 0x7f831815d2d0 2024-06-02T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f8315400640 1 -- 172.21.15.52:0/2171388950 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080319d0 con 0x7f831815d2d0 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 -- 172.21.15.52:0/2171388950 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 msgr2=0x7f83180ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 --2- 172.21.15.52:0/2171388950 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8308009e50 tx=0x7f830802a710 comp rx=0 tx=0).stop 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 -- 172.21.15.52:0/2171388950 shutdown_connections 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 --2- 172.21.15.52:0/2171388950 >> v2:172.21.15.114:3300/0 conn(0x7f831806fed0 0x7f831806f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 --2- 172.21.15.52:0/2171388950 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f831815d2d0 0x7f83180ae020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.551+0000 7f831d400640 1 -- 172.21.15.52:0/2171388950 >> 172.21.15.52:0/2171388950 conn(0x7f831806c7a0 msgr2=0x7f831806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.552+0000 7f831d400640 1 -- 172.21.15.52:0/2171388950 shutdown_connections 2024-06-02T16:49:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.552+0000 7f831d400640 1 -- 172.21.15.52:0/2171388950 wait complete. 2024-06-02T16:49:24.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.553+0000 7f831d400640 1 Processor -- start 2024-06-02T16:49:24.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.553+0000 7f831d400640 1 -- start start 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831806fed0 0x7f8318150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 0x7f83181567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83180741b0 con 0x7f831815d2d0 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f831806ea20 con 0x7f831806fed0 2024-06-02T16:49:24.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.554+0000 7f831d400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f83181f56e0 con 0x7f83180d1450 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.555+0000 7f8317200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.555+0000 7f8316800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831806fed0 0x7f8318150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.555+0000 7f8317200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35152/0 (socket says 172.21.15.52:35152) 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.555+0000 7f8317200640 1 -- 172.21.15.52:0/470060757 learned_addr learned my addr 172.21.15.52:0/470060757 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.555+0000 7f8315e00640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 0x7f83181567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 -- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 msgr2=0x7f83181567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 0x7f83181567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 -- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831806fed0 msgr2=0x7f8318150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831806fed0 0x7f8318150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 -- 172.21.15.52:0/470060757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8318156e30 con 0x7f831815d2d0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8315e00640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 0x7f83181567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f8317200640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f831000c390 tx=0x7f831000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310017070 con 0x7f831815d2d0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83100035f0 con 0x7f831815d2d0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8318157110 con 0x7f831815d2d0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.556+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83100039e0 con 0x7f831815d2d0 2024-06-02T16:49:24.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.557+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181576d0 con 0x7f831815d2d0 2024-06-02T16:49:24.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.558+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8318069520 con 0x7f831815d2d0 2024-06-02T16:49:24.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.559+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f831001a070 con 0x7f831815d2d0 2024-06-02T16:49:24.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.560+0000 7f830ea00640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 0x7f82f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:24.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.560+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f8310096900 con 0x7f831815d2d0 2024-06-02T16:49:24.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.561+0000 7f8316800640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 0x7f82f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:24.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.562+0000 7f8316800640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 0x7f82f8078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8308033000 tx=0x7f8308009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:24.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.565+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83180ae8e0 con 0x7f831815d2d0 2024-06-02T16:49:24.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.819+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8318161ab0 con 0x7f831815d2d0 2024-06-02T16:49:24.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.820+0000 7f830ea00640 1 -- 172.21.15.52:0/470060757 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f8310096090 con 0x7f831815d2d0 2024-06-02T16:49:24.819 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:24.819 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:24.820 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 msgr2=0x7f82f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 0x7f82f8078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8308033000 tx=0x7f8308009000 comp rx=0 tx=0).stop 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 msgr2=0x7f83181f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f831000c390 tx=0x7f831000c850 comp rx=0 tx=0).stop 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 shutdown_connections 2024-06-02T16:49:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f82f80762d0 0x7f82f8078790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831815d2d0 0x7f83181f51a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f83180d1450 0x7f83181567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 --2- 172.21.15.52:0/470060757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831806fed0 0x7f8318150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.822+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 >> 172.21.15.52:0/470060757 conn(0x7f831806c7a0 msgr2=0x7f831815fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.823+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 shutdown_connections 2024-06-02T16:49:24.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:24.823+0000 7f831d400640 1 -- 172.21.15.52:0/470060757 wait complete. 2024-06-02T16:49:24.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/i/dont/exist 2024-06-02T16:49:25.057 INFO:teuthology.orchestra.run.smithi114.stdout:ERROR: (2) No such file or directory 2024-06-02T16:49:25.057 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-06-02T16:49:25.073 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T16:49:25.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:49:25.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T16:49:25.298 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T16:49:25.298 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:49:25.298 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:25.298 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:25.360 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:25.360 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:25.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T16:49:25.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.639+0000 7f4383a00640 1 Processor -- start 2024-06-02T16:49:25.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.639+0000 7f4383a00640 1 -- start start 2024-06-02T16:49:25.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.640+0000 7f4383a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c0d1b60 0x7f437c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.640+0000 7f4383a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f437c0b5a80 0x7f437c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.640+0000 7f4383a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f437c0b6300 con 0x7f437c163880 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4383a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f437c06e640 con 0x7f437c0b5a80 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4383a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f437c06e920 con 0x7f437c0d1b60 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4381a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f437c0b5a80 0x7f437c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4381000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f437c163880 0x7f437c0d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33720/0 (socket says 172.21.15.52:33720) 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4381a00640 1 --2- 172.21.15.52:0/2190034791 >> v2:172.21.15.52:3300/0 conn(0x7f437c0b5a80 0x7f437c0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35156/0 (socket says 172.21.15.52:35156) 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f4381000640 1 -- 172.21.15.52:0/2190034791 learned_addr learned my addr 172.21.15.52:0/2190034791 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:25.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.641+0000 7f437be00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c0d1b60 0x7f437c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.642+0000 7f4381a00640 1 -- 172.21.15.52:0/2190034791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c0d1b60 msgr2=0x7f437c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:25.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.642+0000 7f4381a00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c0d1b60 0x7f437c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.642+0000 7f4381a00640 1 -- 172.21.15.52:0/2190034791 >> v1:172.21.15.52:6789/0 conn(0x7f437c163880 legacy=0x7f437c0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.642+0000 7f4381a00640 1 -- 172.21.15.52:0/2190034791 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c06ec00 con 0x7f437c0b5a80 2024-06-02T16:49:25.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.642+0000 7f437b400640 1 -- 172.21.15.52:0/2190034791 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495219126 0 0) 0x7f437c0b6300 con 0x7f437c163880 2024-06-02T16:49:25.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.643+0000 7f4381a00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0b5a80 0x7f437c0b4b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43740097a0 tx=0x7f437402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ba6cccd9921936 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.643+0000 7f437b400640 1 -- 172.21.15.52:0/2190034791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374037070 con 0x7f437c0b5a80 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.643+0000 7f437b400640 1 -- 172.21.15.52:0/2190034791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4374032440 con 0x7f437c0b5a80 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.643+0000 7f437b400640 1 -- 172.21.15.52:0/2190034791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374032810 con 0x7f437c0b5a80 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 -- 172.21.15.52:0/2190034791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0b5a80 msgr2=0x7f437c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0b5a80 0x7f437c0b4b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43740097a0 tx=0x7f437402a180 comp rx=0 tx=0).stop 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 -- 172.21.15.52:0/2190034791 shutdown_connections 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0b5a80 0x7f437c0b4b50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 --2- 172.21.15.52:0/2190034791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c0d1b60 0x7f437c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 -- 172.21.15.52:0/2190034791 >> 172.21.15.52:0/2190034791 conn(0x7f437c06c7a0 msgr2=0x7f437c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 -- 172.21.15.52:0/2190034791 shutdown_connections 2024-06-02T16:49:25.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.644+0000 7f4383a00640 1 -- 172.21.15.52:0/2190034791 wait complete. 2024-06-02T16:49:25.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.646+0000 7f4383a00640 1 Processor -- start 2024-06-02T16:49:25.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.646+0000 7f4383a00640 1 -- start start 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437c0b5a80 0x7f437c0d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c163880 0x7f437c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f437c163c60 con 0x7f437c0d1b60 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f437c0b5fd0 con 0x7f437c0b5a80 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.647+0000 7f4383a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f437c163de0 con 0x7f437c163880 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35158/0 (socket says 172.21.15.52:35158) 2024-06-02T16:49:25.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 -- 172.21.15.52:0/3668410464 learned_addr learned my addr 172.21.15.52:0/3668410464 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f4381a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c163880 0x7f437c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f4381000640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437c0b5a80 0x7f437c0d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 -- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c163880 msgr2=0x7f437c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c163880 0x7f437c165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 -- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437c0b5a80 msgr2=0x7f437c0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437c0b5a80 0x7f437c0d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.648+0000 7f437be00640 1 -- 172.21.15.52:0/3668410464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c0ceca0 con 0x7f437c0d1b60 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f437be00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f436400d800 tx=0x7f436400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400b6c0 con 0x7f437c0d1b60 2024-06-02T16:49:25.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364019070 con 0x7f437c0d1b60 2024-06-02T16:49:25.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400ba80 con 0x7f437c0d1b60 2024-06-02T16:49:25.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c0cef80 con 0x7f437c0d1b60 2024-06-02T16:49:25.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.649+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c0cf540 con 0x7f437c0d1b60 2024-06-02T16:49:25.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.650+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c069520 con 0x7f437c0d1b60 2024-06-02T16:49:25.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.651+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f436400bc20 con 0x7f437c0d1b60 2024-06-02T16:49:25.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.652+0000 7f4378c00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 0x7f43580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:25.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.653+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f4364097a90 con 0x7f437c0d1b60 2024-06-02T16:49:25.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.653+0000 7f4381000640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 0x7f43580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:25.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.654+0000 7f4381000640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 0x7f43580787c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f436c007ed0 tx=0x7f436c007e60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:25.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.657+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43640613e0 con 0x7f437c0d1b60 2024-06-02T16:49:25.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.886+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f437c070350 con 0x7f437c0d1b60 2024-06-02T16:49:25.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.887+0000 7f4378c00640 1 -- 172.21.15.52:0/3668410464 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f4364060ce0 con 0x7f437c0d1b60 2024-06-02T16:49:25.887 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-06-02T16:49:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 msgr2=0x7f43580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 0x7f43580787c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f436c007ed0 tx=0x7f436c007e60 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 msgr2=0x7f437c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f436400d800 tx=0x7f436400dcc0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 shutdown_connections 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4358076300 0x7f43580787c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f437c163880 0x7f437c165f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c0d1b60 0x7f437c15e450 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 --2- 172.21.15.52:0/3668410464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437c0b5a80 0x7f437c0d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 >> 172.21.15.52:0/3668410464 conn(0x7f437c06c7a0 msgr2=0x7f437c0ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:25.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 shutdown_connections 2024-06-02T16:49:25.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:25.890+0000 7f4383a00640 1 -- 172.21.15.52:0/3668410464 wait complete. 2024-06-02T16:49:25.908 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-02T16:49:25.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:25.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-02T16:49:29.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:49:29.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:29.136 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T16:49:29.194 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:49:29.195 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:29.195 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:29.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:29.243 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:49:29.243 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:29.243 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:29.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:49:29.303 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T16:49:29.303 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:29.303 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:29.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:29.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:29.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.585+0000 7ffb52800640 1 Processor -- start 2024-06-02T16:49:29.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.586+0000 7ffb52800640 1 -- start start 2024-06-02T16:49:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.587+0000 7ffb52800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb4c13f140 0x7ffb4c15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb52800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb4c0d0890 con 0x7ffb4c06e840 2024-06-02T16:49:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb52800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb4c1416c0 con 0x7ffb4c13ed60 2024-06-02T16:49:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb52800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4c160970 con 0x7ffb4c13f140 2024-06-02T16:49:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb51e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffb4c06e840 0x7ffb4c160180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33728/0 (socket says 172.21.15.52:33728) 2024-06-02T16:49:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb51e00640 1 -- 172.21.15.52:0/2145348857 learned_addr learned my addr 172.21.15.52:0/2145348857 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.588+0000 7ffb50a00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb4c13f140 0x7ffb4c15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081123850 0 0) 0x7ffb4c0d0890 con 0x7ffb4c06e840 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb30003520 con 0x7ffb4c06e840 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3397422233 0 0) 0x7ffb30003520 con 0x7ffb4c06e840 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb4c13f140 msgr2=0x7ffb4c15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb4c13f140 0x7ffb4c15fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 >> v1:172.21.15.114:6789/0 conn(0x7ffb4c13ed60 legacy=0x7ffb4c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c141960 con 0x7ffb4c06e840 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7ffb440016f0 con 0x7ffb4c06e840 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 >> v1:172.21.15.52:6789/0 conn(0x7ffb4c06e840 legacy=0x7ffb4c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb30003a80 0x7ffb30003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb30004800 0x7ffb30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb300052e0 0x7ffb3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c160970 con 0x7ffb30004800 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3000c010 con 0x7ffb30003a80 2024-06-02T16:49:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3000e420 con 0x7ffb300052e0 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.589+0000 7ffb50a00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb30004800 0x7ffb30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb51400640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb30003a80 0x7ffb30003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb50a00640 1 -- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb300052e0 msgr2=0x7ffb3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb50a00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb300052e0 0x7ffb3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb50a00640 1 -- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb30003a80 msgr2=0x7ffb30003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb50a00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb30003a80 0x7ffb30003ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.590+0000 7ffb50a00640 1 -- 172.21.15.52:0/2145348857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb30003520 con 0x7ffb30004800 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.591+0000 7ffb50a00640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb30004800 0x7ffb30004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009fc0 tx=0x7ffb30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df5f0af8341c19d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.591+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38009c10 con 0x7ffb30004800 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.591+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb38036070 con 0x7ffb30004800 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.591+0000 7ffb4be00640 1 -- 172.21.15.52:0/2145348857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3802d070 con 0x7ffb30004800 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 -- 172.21.15.52:0/2145348857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb30004800 msgr2=0x7ffb30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 --2- 172.21.15.52:0/2145348857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb30004800 0x7ffb30004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009fc0 tx=0x7ffb30005830 comp rx=0 tx=0).stop 2024-06-02T16:49:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb51e00640 1 -- 172.21.15.52:0/2145348857 reap_dead start 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 -- 172.21.15.52:0/2145348857 shutdown_connections 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 -- 172.21.15.52:0/2145348857 >> 172.21.15.52:0/2145348857 conn(0x7ffb4c06c380 msgr2=0x7ffb4c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 -- 172.21.15.52:0/2145348857 shutdown_connections 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.592+0000 7ffb52800640 1 -- 172.21.15.52:0/2145348857 wait complete. 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.594+0000 7ffb52800640 1 Processor -- start 2024-06-02T16:49:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.594+0000 7ffb52800640 1 -- start start 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb30004800 0x7ffb4c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4c1f4470 0x7ffb4c1f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c142440 con 0x7ffb4c13cb40 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c141f20 con 0x7ffb4c1f4470 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.595+0000 7ffb52800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4c1425c0 con 0x7ffb30004800 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35184/0 (socket says 172.21.15.52:35184) 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 -- 172.21.15.52:0/1628174959 learned_addr learned my addr 172.21.15.52:0/1628174959 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51400640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb30004800 0x7ffb4c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb50a00640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4c1f4470 0x7ffb4c1f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 -- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb30004800 msgr2=0x7ffb4c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb30004800 0x7ffb4c0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 -- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4c1f4470 msgr2=0x7ffb4c1f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4c1f4470 0x7ffb4c1f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 -- 172.21.15.52:0/1628174959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c1f4e30 con 0x7ffb4c13cb40 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.596+0000 7ffb51e00640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400c4d0 tx=0x7ffb4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.597+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb440074e0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.597+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb440047e0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.597+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44004b90 con 0x7ffb4c13cb40 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.597+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4c13c1a0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.597+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4c13b6c0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.598+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4c075ea0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.599+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb4401c3f0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.600+0000 7ffb49600640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 0x7ffb2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.600+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7ffb44096c60 con 0x7ffb4c13cb40 2024-06-02T16:49:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.601+0000 7ffb51400640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 0x7ffb2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.602+0000 7ffb51400640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 0x7ffb2c078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000c00 tx=0x7ffb3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.605+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb440605b0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.865+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb4c0507e0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.866+0000 7ffb49600640 1 -- 172.21.15.52:0/1628174959 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7ffb4405feb0 con 0x7ffb4c13cb40 2024-06-02T16:49:29.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:29.866 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:29.866 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 msgr2=0x7ffb2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 0x7ffb2c078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000c00 tx=0x7ffb3c009040 comp rx=0 tx=0).stop 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 msgr2=0x7ffb4c13cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400c4d0 tx=0x7ffb4400c990 comp rx=0 tx=0).stop 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 shutdown_connections 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ffb2c0762d0 0x7ffb2c078790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4c13cb40 0x7ffb4c13cfc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4c1f4470 0x7ffb4c1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 --2- 172.21.15.52:0/1628174959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb30004800 0x7ffb4c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 >> 172.21.15.52:0/1628174959 conn(0x7ffb4c06c380 msgr2=0x7ffb4c073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 shutdown_connections 2024-06-02T16:49:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:29.869+0000 7ffb52800640 1 -- 172.21.15.52:0/1628174959 wait complete. 2024-06-02T16:49:29.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:30.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.100+0000 7f2feb200640 1 Processor -- start 2024-06-02T16:49:30.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.100+0000 7f2feb200640 1 -- start start 2024-06-02T16:49:30.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.101+0000 7f2feb200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fec06e130 0x7f2fec06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.101+0000 7f2feb200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec160c80 con 0x7f2fec1577f0 2024-06-02T16:49:30.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.101+0000 7f2feb200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec160f60 con 0x7f2fec072340 2024-06-02T16:49:30.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.101+0000 7f2feb200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2fec161240 con 0x7f2fec06e130 2024-06-02T16:49:30.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.101+0000 7f2fe1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fec06e130 0x7f2fec06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe9e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2fec1577f0 0x7f2fec073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33740/0 (socket says 172.21.15.52:33740) 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe9e00640 1 -- 172.21.15.52:0/2498231948 learned_addr learned my addr 172.21.15.52:0/2498231948 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fec06e130 0x7f2fec06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35186/0 (socket says 172.21.15.52:35186) 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe1400640 1 -- 172.21.15.52:0/2498231948 >> v1:172.21.15.114:6789/0 conn(0x7f2fec072340 legacy=0x7f2fec0727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe1400640 1 -- 172.21.15.52:0/2498231948 >> v1:172.21.15.52:6789/0 conn(0x7f2fec1577f0 legacy=0x7f2fec073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.102+0000 7f2fe1400640 1 -- 172.21.15.52:0/2498231948 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec161520 con 0x7f2fec06e130 2024-06-02T16:49:30.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.103+0000 7f2fe1400640 1 --2- 172.21.15.52:0/2498231948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec06e5b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097a0 tx=0x7f2fd402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248ae21fa1dc2463 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2fe9400640 1 -- 172.21.15.52:0/2498231948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4037070 con 0x7f2fec06e130 2024-06-02T16:49:30.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2fe9400640 1 -- 172.21.15.52:0/2498231948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4032440 con 0x7f2fec06e130 2024-06-02T16:49:30.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2fe9400640 1 -- 172.21.15.52:0/2498231948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4032810 con 0x7f2fec06e130 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2feb200640 1 -- 172.21.15.52:0/2498231948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 msgr2=0x7f2fec06e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2feb200640 1 --2- 172.21.15.52:0/2498231948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec06e5b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097a0 tx=0x7f2fd402a180 comp rx=0 tx=0).stop 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2feb200640 1 -- 172.21.15.52:0/2498231948 shutdown_connections 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2feb200640 1 --2- 172.21.15.52:0/2498231948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec06e5b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.104+0000 7f2feb200640 1 -- 172.21.15.52:0/2498231948 >> 172.21.15.52:0/2498231948 conn(0x7f2fec06c380 msgr2=0x7f2fec06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.105+0000 7f2feb200640 1 -- 172.21.15.52:0/2498231948 shutdown_connections 2024-06-02T16:49:30.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.105+0000 7f2feb200640 1 -- 172.21.15.52:0/2498231948 wait complete. 2024-06-02T16:49:30.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.106+0000 7f2feb200640 1 Processor -- start 2024-06-02T16:49:30.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.107+0000 7f2feb200640 1 -- start start 2024-06-02T16:49:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2fec072340 0x7f2fec1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fec1577f0 0x7f2fec1f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec074580 con 0x7f2fec06e130 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec161a40 con 0x7f2fec1577f0 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2feb200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f2fec074180 con 0x7f2fec072340 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35200/0 (socket says 172.21.15.52:35200) 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe9e00640 1 -- 172.21.15.52:0/612564379 learned_addr learned my addr 172.21.15.52:0/612564379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe1400640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2fec072340 0x7f2fec1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fea800640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fec1577f0 0x7f2fec1f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe9e00640 1 -- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2fec072340 msgr2=0x7f2fec1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.108+0000 7f2fe9e00640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2fec072340 0x7f2fec1507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe9e00640 1 -- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fec1577f0 msgr2=0x7f2fec1f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe9e00640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fec1577f0 0x7f2fec1f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe9e00640 1 -- 172.21.15.52:0/612564379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec150d20 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe9e00640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001eb0 tx=0x7f2fdc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc017070 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc005d00 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec14e650 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007310 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.109+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec14ec10 con 0x7f2fec06e130 2024-06-02T16:49:30.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.111+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec075ea0 con 0x7f2fec06e130 2024-06-02T16:49:30.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.112+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fdc01a070 con 0x7f2fec06e130 2024-06-02T16:49:30.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.113+0000 7f2fe2a00640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 0x7f2fc8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.114+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc096a30 con 0x7f2fec06e130 2024-06-02T16:49:30.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.114+0000 7f2fe1400640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 0x7f2fc8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.115+0000 7f2fe1400640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 0x7f2fc8078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4034000 tx=0x7f2fd402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.118+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fdc0602f0 con 0x7f2fec06e130 2024-06-02T16:49:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.376+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fec0b5b00 con 0x7f2fec06e130 2024-06-02T16:49:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.376+0000 7f2fe2a00640 1 -- 172.21.15.52:0/612564379 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f2fdc05fbf0 con 0x7f2fec06e130 2024-06-02T16:49:30.376 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:30.376 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.379+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 msgr2=0x7f2fc8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.379+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 0x7f2fc8078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4034000 tx=0x7f2fd402e000 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 msgr2=0x7f2fec0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001eb0 tx=0x7f2fdc00c890 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 shutdown_connections 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f2fc80762d0 0x7f2fc8078790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fec1577f0 0x7f2fec1f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2fec072340 0x7f2fec1507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 --2- 172.21.15.52:0/612564379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec06e130 0x7f2fec0cd5c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 >> 172.21.15.52:0/612564379 conn(0x7f2fec06c380 msgr2=0x7f2fec1566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 shutdown_connections 2024-06-02T16:49:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.380+0000 7f2feb200640 1 -- 172.21.15.52:0/612564379 wait complete. 2024-06-02T16:49:30.399 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:30.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.608+0000 7f524f000640 1 Processor -- start 2024-06-02T16:49:30.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.608+0000 7f524f000640 1 -- start start 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524f000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5248072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524806ea40 con 0x7f52481577f0 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524f000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5248160c80 con 0x7f524806e130 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524f000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5248160f60 con 0x7f524806e5b0 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524dc00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f52481577f0 0x7f5248073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33754/0 (socket says 172.21.15.52:33754) 2024-06-02T16:49:30.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.609+0000 7f524dc00640 1 -- 172.21.15.52:0/664547331 learned_addr learned my addr 172.21.15.52:0/664547331 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:30.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f524e600640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5248072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962151403 0 0) 0x7f524806ea40 con 0x7f52481577f0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5230003520 con 0x7f52481577f0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2381780979 0 0) 0x7f5230003520 con 0x7f52481577f0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 msgr2=0x7f5248072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5248072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 >> v1:172.21.15.114:6789/0 conn(0x7f524806e130 legacy=0x7f5248072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5248161240 con 0x7f52481577f0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f523c0016f0 con 0x7f52481577f0 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 >> v1:172.21.15.52:6789/0 conn(0x7f52481577f0 legacy=0x7f5248073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.610+0000 7f5247e00640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5230003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f5247e00640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004000 0x7f5230004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f5247e00640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230004d40 0x7f52300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5248160f60 con 0x7f5230004000 2024-06-02T16:49:30.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f523000bb50 con 0x7f5230004d40 2024-06-02T16:49:30.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f523000bd50 con 0x7f524806e5b0 2024-06-02T16:49:30.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f524d200640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004000 0x7f5230004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f524dc00640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5230003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.611+0000 7f524e600640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230004d40 0x7f52300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.612+0000 7f524d200640 1 -- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 msgr2=0x7f5230003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.612+0000 7f524d200640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f524806e5b0 0x7f5230003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.612+0000 7f524d200640 1 -- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230004d40 msgr2=0x7f52300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.612+0000 7f524d200640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230004d40 0x7f52300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.612+0000 7f524d200640 1 -- 172.21.15.52:0/664547331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5230003520 con 0x7f5230004000 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.613+0000 7f524d200640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004000 0x7f5230004800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5234001370 tx=0x7f5230005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af18504c0e41add server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.613+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340013b0 con 0x7f5230004000 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.613+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52340050d0 con 0x7f5230004000 2024-06-02T16:49:30.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.613+0000 7f5247e00640 1 -- 172.21.15.52:0/664547331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234005480 con 0x7f5230004000 2024-06-02T16:49:30.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 -- 172.21.15.52:0/664547331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004000 msgr2=0x7f5230004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 --2- 172.21.15.52:0/664547331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004000 0x7f5230004800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5234001370 tx=0x7f5230005830 comp rx=0 tx=0).stop 2024-06-02T16:49:30.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524e600640 1 -- 172.21.15.52:0/664547331 reap_dead start 2024-06-02T16:49:30.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 -- 172.21.15.52:0/664547331 shutdown_connections 2024-06-02T16:49:30.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 -- 172.21.15.52:0/664547331 >> 172.21.15.52:0/664547331 conn(0x7f524806c380 msgr2=0x7f524806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:30.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 -- 172.21.15.52:0/664547331 shutdown_connections 2024-06-02T16:49:30.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.614+0000 7f524f000640 1 -- 172.21.15.52:0/664547331 wait complete. 2024-06-02T16:49:30.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.616+0000 7f524f000640 1 Processor -- start 2024-06-02T16:49:30.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.616+0000 7f524f000640 1 -- start start 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5230004000 0x7f524814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5248149160 0x7f5248144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5248161a40 con 0x7f524814c720 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f524815e510 con 0x7f5248149160 2024-06-02T16:49:30.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524f000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f5248074580 con 0x7f5230004000 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35214/0 (socket says 172.21.15.52:35214) 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.617+0000 7f524e600640 1 -- 172.21.15.52:0/1848958479 learned_addr learned my addr 172.21.15.52:0/1848958479 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524dc00640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5230004000 0x7f524814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524d200640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5248149160 0x7f5248144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 -- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5230004000 msgr2=0x7f524814d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5230004000 0x7f524814d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 -- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5248149160 msgr2=0x7f5248144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5248149160 0x7f5248144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 -- 172.21.15.52:0/1848958479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524814a1a0 con 0x7f524814c720 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f524e600640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f52480d0e40 tx=0x7f52400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.618+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240011e40 con 0x7f524814c720 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.619+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524001b070 con 0x7f524814c720 2024-06-02T16:49:30.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.619+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240003990 con 0x7f524814c720 2024-06-02T16:49:30.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.619+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5248149900 con 0x7f524814c720 2024-06-02T16:49:30.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.619+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5248149ec0 con 0x7f524814c720 2024-06-02T16:49:30.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.620+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248075ea0 con 0x7f524814c720 2024-06-02T16:49:30.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.621+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5240005d10 con 0x7f524814c720 2024-06-02T16:49:30.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.622+0000 7f5245600640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 0x7f52280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:30.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.622+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f5240097a10 con 0x7f524814c720 2024-06-02T16:49:30.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.623+0000 7f524dc00640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 0x7f52280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:30.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.624+0000 7f524dc00640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 0x7f52280787c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f523c000fb0 tx=0x7f523c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.627+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5240061360 con 0x7f524814c720 2024-06-02T16:49:30.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.837+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52480507e0 con 0x7f524814c720 2024-06-02T16:49:30.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.839+0000 7f5245600640 1 -- 172.21.15.52:0/1848958479 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16613 (secure 0 0 0) 0x7f5240060c60 con 0x7f524814c720 2024-06-02T16:49:30.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:30.840 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:06.834085+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:49:03.203481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-06-02T16:49:04.293800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.842+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 msgr2=0x7f52280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.842+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 0x7f52280787c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f523c000fb0 tx=0x7f523c009040 comp rx=0 tx=0).stop 2024-06-02T16:49:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.842+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 msgr2=0x7f524814cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.842+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f52480d0e40 tx=0x7f52400115a0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 shutdown_connections 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f5228076300 0x7f52280787c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f524814c720 0x7f524814cba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5248149160 0x7f5248144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 --2- 172.21.15.52:0/1848958479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5230004000 0x7f524814d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 >> 172.21.15.52:0/1848958479 conn(0x7f524806c380 msgr2=0x7f52480cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 shutdown_connections 2024-06-02T16:49:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:30.843+0000 7f524f000640 1 -- 172.21.15.52:0/1848958479 wait complete. 2024-06-02T16:49:30.862 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T16:49:30.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:31.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.070+0000 7f257b200640 1 Processor -- start 2024-06-02T16:49:31.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.070+0000 7f257b200640 1 -- start start 2024-06-02T16:49:31.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f257b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f257c1577f0 0x7f257c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f257b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f257c160c80 con 0x7f257c073fb0 2024-06-02T16:49:31.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f257b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f257c160f60 con 0x7f257c06e840 2024-06-02T16:49:31.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f257b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f257c161240 con 0x7f257c1577f0 2024-06-02T16:49:31.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f2571400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f257c073fb0 0x7f257c06e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33764/0 (socket says 172.21.15.52:33764) 2024-06-02T16:49:31.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f2571400640 1 -- 172.21.15.52:0/1851949404 learned_addr learned my addr 172.21.15.52:0/1851949404 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.072+0000 7f2579e00640 1 --2- 172.21.15.52:0/1851949404 >> v2:172.21.15.114:3300/0 conn(0x7f257c1577f0 0x7f257c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318818187 0 0) 0x7f257c160c80 con 0x7f257c073fb0 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2560003520 con 0x7f257c073fb0 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2790048490 0 0) 0x7f2560003520 con 0x7f257c073fb0 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 >> v2:172.21.15.114:3300/0 conn(0x7f257c1577f0 msgr2=0x7f257c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 --2- 172.21.15.52:0/1851949404 >> v2:172.21.15.114:3300/0 conn(0x7f257c1577f0 0x7f257c073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 >> v1:172.21.15.114:6789/0 conn(0x7f257c06e840 legacy=0x7f257c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c161520 con 0x7f257c073fb0 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f25640016f0 con 0x7f257c073fb0 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 >> v1:172.21.15.52:6789/0 conn(0x7f257c073fb0 legacy=0x7f257c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2560003a50 0x7f2560003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 0x7f2560004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25600051c0 0x7f256000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f257c161240 con 0x7f2560004800 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f256000c160 con 0x7f2560003a50 2024-06-02T16:49:31.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f256000c360 con 0x7f25600051c0 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.073+0000 7f2571400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 0x7f2560004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2579e00640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2560003a50 0x7f2560003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2571400640 1 -- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25600051c0 msgr2=0x7f256000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f257a800640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25600051c0 0x7f256000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2571400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25600051c0 0x7f256000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2571400640 1 -- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2560003a50 msgr2=0x7f2560003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2571400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2560003a50 0x7f2560003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2571400640 1 -- 172.21.15.52:0/1851949404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2560003520 con 0x7f2560004800 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f2579e00640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2560003a50 0x7f2560003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f257a800640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25600051c0 0x7f256000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.074+0000 7f257a800640 1 -- 172.21.15.52:0/1851949404 reap_dead start 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.075+0000 7f2571400640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 0x7f2560004c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f256400c240 tx=0x7f2560005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c04de3d98a655 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.075+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564007ce0 con 0x7f2560004800 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.075+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2564005ad0 con 0x7f2560004800 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.075+0000 7f2579400640 1 -- 172.21.15.52:0/1851949404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564007070 con 0x7f2560004800 2024-06-02T16:49:31.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 -- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 msgr2=0x7f2560004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 0x7f2560004c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f256400c240 tx=0x7f2560005830 comp rx=0 tx=0).stop 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 -- 172.21.15.52:0/1851949404 shutdown_connections 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 --2- 172.21.15.52:0/1851949404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2560004800 0x7f2560004c80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 -- 172.21.15.52:0/1851949404 >> 172.21.15.52:0/1851949404 conn(0x7f257c06c380 msgr2=0x7f257c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 -- 172.21.15.52:0/1851949404 shutdown_connections 2024-06-02T16:49:31.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.076+0000 7f257b200640 1 -- 172.21.15.52:0/1851949404 wait complete. 2024-06-02T16:49:31.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.078+0000 7f257b200640 1 Processor -- start 2024-06-02T16:49:31.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.078+0000 7f257b200640 1 -- start start 2024-06-02T16:49:31.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2560004800 0x7f257c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f257c0b4b40 0x7f257c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f257c074580 con 0x7f257c0b4fc0 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f257c161a40 con 0x7f257c0b4b40 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f257c073a70 con 0x7f2560004800 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.079+0000 7f257a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35242/0 (socket says 172.21.15.52:35242) 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 -- 172.21.15.52:0/3933124442 learned_addr learned my addr 172.21.15.52:0/3933124442 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:31.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f2579e00640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2560004800 0x7f257c148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f2571400640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f257c0b4b40 0x7f257c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 -- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2560004800 msgr2=0x7f257c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2560004800 0x7f257c148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 -- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f257c0b4b40 msgr2=0x7f257c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f257c0b4b40 0x7f257c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 -- 172.21.15.52:0/3933124442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c1e72e0 con 0x7f257c0b4fc0 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.080+0000 7f257a800640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f257c15e7b0 tx=0x7f257400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.081+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574018070 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.081+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2574006d70 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.081+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574003bb0 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.081+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c1e75c0 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.081+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c1e7b80 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.082+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257c075ea0 con 0x7f257c0b4fc0 2024-06-02T16:49:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.084+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2574005070 con 0x7f257c0b4fc0 2024-06-02T16:49:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.084+0000 7f2572a00640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 0x7f2558078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.085+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f25740966a0 con 0x7f257c0b4fc0 2024-06-02T16:49:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.085+0000 7f2579e00640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 0x7f2558078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.086+0000 7f2579e00640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 0x7f2558078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f257c0b3c30 tx=0x7f256c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.089+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f257405ff60 con 0x7f257c0b4fc0 2024-06-02T16:49:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.346+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f257c06f070 con 0x7f257c0b4fc0 2024-06-02T16:49:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.347+0000 7f2572a00640 1 -- 172.21.15.52:0/3933124442 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f257405f860 con 0x7f257c0b4fc0 2024-06-02T16:49:31.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:31.348 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.350+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 msgr2=0x7f2558078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.350+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 0x7f2558078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f257c0b3c30 tx=0x7f256c008040 comp rx=0 tx=0).stop 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.350+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 msgr2=0x7f257c0ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.350+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f257c15e7b0 tx=0x7f257400dc00 comp rx=0 tx=0).stop 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 shutdown_connections 2024-06-02T16:49:31.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f25580762d0 0x7f2558078790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f257c0b4fc0 0x7f257c0ca7e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f257c0b4b40 0x7f257c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 --2- 172.21.15.52:0/3933124442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2560004800 0x7f257c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 >> 172.21.15.52:0/3933124442 conn(0x7f257c06c380 msgr2=0x7f257c15c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 shutdown_connections 2024-06-02T16:49:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.351+0000 7f257b200640 1 -- 172.21.15.52:0/3933124442 wait complete. 2024-06-02T16:49:31.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:49:31.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.592+0000 7f6dd7e00640 1 Processor -- start 2024-06-02T16:49:31.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.593+0000 7f6dd7e00640 1 -- start start 2024-06-02T16:49:31.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.594+0000 7f6dd7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dd815d060 0x7f6dd80d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.594+0000 7f6dd7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 0x7f6dd80ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.594+0000 7f6dd7e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd81607c0 con 0x7f6dd80d06b0 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.594+0000 7f6dd7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd8163c50 con 0x7f6dd815d060 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.594+0000 7f6dd7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd8163040 con 0x7f6dd80b7390 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6dd80d06b0 0x7f6dd80b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33766/0 (socket says 172.21.15.52:33766) 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6000640 1 -- 172.21.15.52:0/1207422721 learned_addr learned my addr 172.21.15.52:0/1207422721 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/1207422721 >> v2:172.21.15.52:3300/0 conn(0x7f6dd815d060 0x7f6dd80d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd7400640 1 --2- 172.21.15.52:0/1207422721 >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 0x7f6dd80ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6a00640 1 -- 172.21.15.52:0/1207422721 >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 msgr2=0x7f6dd80ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/1207422721 >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 0x7f6dd80ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6a00640 1 -- 172.21.15.52:0/1207422721 >> v1:172.21.15.52:6789/0 conn(0x7f6dd80d06b0 legacy=0x7f6dd80b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd6a00640 1 -- 172.21.15.52:0/1207422721 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8163320 con 0x7f6dd815d060 2024-06-02T16:49:31.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.595+0000 7f6dd7400640 1 --2- 172.21.15.52:0/1207422721 >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 0x7f6dd80ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:31.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.596+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/1207422721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd815d060 0x7f6dd80d0170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80d2e40 tx=0x7f6dc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaae0401a28f4ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd5600640 1 -- 172.21.15.52:0/1207422721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8037070 con 0x7f6dd815d060 2024-06-02T16:49:31.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd5600640 1 -- 172.21.15.52:0/1207422721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8032440 con 0x7f6dd815d060 2024-06-02T16:49:31.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd5600640 1 -- 172.21.15.52:0/1207422721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8032810 con 0x7f6dd815d060 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 -- 172.21.15.52:0/1207422721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd815d060 msgr2=0x7f6dd80d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/1207422721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd815d060 0x7f6dd80d0170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80d2e40 tx=0x7f6dc802a1a0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 -- 172.21.15.52:0/1207422721 shutdown_connections 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/1207422721 >> v2:172.21.15.114:3300/0 conn(0x7f6dd80b7390 0x7f6dd80ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/1207422721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd815d060 0x7f6dd80d0170 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.597+0000 7f6dd7e00640 1 -- 172.21.15.52:0/1207422721 >> 172.21.15.52:0/1207422721 conn(0x7f6dd80740e0 msgr2=0x7f6dd80d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:31.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.598+0000 7f6dd7e00640 1 -- 172.21.15.52:0/1207422721 shutdown_connections 2024-06-02T16:49:31.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.598+0000 7f6dd7e00640 1 -- 172.21.15.52:0/1207422721 wait complete. 2024-06-02T16:49:31.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.599+0000 7f6dd7e00640 1 Processor -- start 2024-06-02T16:49:31.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.599+0000 7f6dd7e00640 1 -- start start 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dd80b7390 0x7f6dd80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 0x7f6dd815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd80ba970 con 0x7f6dd80d06b0 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81638e0 con 0x7f6dd815d060 2024-06-02T16:49:31.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.600+0000 7f6dd7e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd80baaf0 con 0x7f6dd80b7390 2024-06-02T16:49:31.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35258/0 (socket says 172.21.15.52:35258) 2024-06-02T16:49:31.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 -- 172.21.15.52:0/3469470444 learned_addr learned my addr 172.21.15.52:0/3469470444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:31.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd7400640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 0x7f6dd815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dd80b7390 0x7f6dd80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 -- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dd80b7390 msgr2=0x7f6dd80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dd80b7390 0x7f6dd80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 -- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 msgr2=0x7f6dd815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 0x7f6dd815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd6000640 1 -- 172.21.15.52:0/3469470444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd81f5ef0 con 0x7f6dd80d06b0 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.601+0000 7f6dd7400640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 0x7f6dd815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:31.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dd6000640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000cbc0 tx=0x7f6dc000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0017070 con 0x7f6dd80d06b0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc000ad40 con 0x7f6dd80d06b0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0012640 con 0x7f6dd80d06b0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd81f61d0 con 0x7f6dd80d06b0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.602+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81f6790 con 0x7f6dd80d06b0 2024-06-02T16:49:31.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.603+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd80cc390 con 0x7f6dd80d06b0 2024-06-02T16:49:31.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.605+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6dc001a070 con 0x7f6dd80d06b0 2024-06-02T16:49:31.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.606+0000 7f6dcf400640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 0x7f6db4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:31.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.606+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc00978a0 con 0x7f6dd80d06b0 2024-06-02T16:49:31.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.607+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 0x7f6db4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.608+0000 7f6dd6a00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 0x7f6db4078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8034000 tx=0x7f6dc802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:31.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.610+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6dd80cc390 con 0x7f6dd80d06b0 2024-06-02T16:49:31.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.864+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dd80507e0 con 0x7f6dd80d06b0 2024-06-02T16:49:31.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.865+0000 7f6dcf400640 1 -- 172.21.15.52:0/3469470444 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5187 (secure 0 0 0) 0x7f6dc0021020 con 0x7f6dd80d06b0 2024-06-02T16:49:31.865 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:31.865 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T16:49:05.320433+0000","modified":"2024-06-02T16:49:08.367179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2393791862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2393791862},{"type":"v1","addr":"172.21.15.114:6837","nonce":2393791862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5208,"qdb_cluster":[5208]},"id":3}]} 2024-06-02T16:49:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-06-02T16:49:31.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 msgr2=0x7f6db4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 0x7f6db4078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8034000 tx=0x7f6dc802e000 comp rx=0 tx=0).stop 2024-06-02T16:49:31.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 msgr2=0x7f6dd815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000cbc0 tx=0x7f6dc000a430 comp rx=0 tx=0).stop 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 shutdown_connections 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6db40762d0 0x7f6db4078790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dd815d060 0x7f6dd815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd80d06b0 0x7f6dd815e490 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 --2- 172.21.15.52:0/3469470444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dd80b7390 0x7f6dd80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 >> 172.21.15.52:0/3469470444 conn(0x7f6dd80740e0 msgr2=0x7f6dd80cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 shutdown_connections 2024-06-02T16:49:31.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:31.869+0000 7f6dd7e00640 1 -- 172.21.15.52:0/3469470444 wait complete. 2024-06-02T16:49:31.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.099+0000 7f3a8d600640 1 Processor -- start 2024-06-02T16:49:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.100+0000 7f3a8d600640 1 -- start start 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a880b4170 0x7f3a880d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8d600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a880cfd40 con 0x7f3a880d21e0 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8d600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a880d0020 con 0x7f3a8815f6a0 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8d600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8815fa80 con 0x7f3a880b4170 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8cc00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a880d21e0 0x7f3a880d3650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33778/0 (socket says 172.21.15.52:33778) 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a7f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a880b4170 0x7f3a880d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.101+0000 7f3a8cc00640 1 -- 172.21.15.52:0/3699987667 learned_addr learned my addr 172.21.15.52:0/3699987667 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.102+0000 7f3a7f400640 1 -- 172.21.15.52:0/3699987667 >> v1:172.21.15.114:6789/0 conn(0x7f3a8815f6a0 legacy=0x7f3a88163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.102+0000 7f3a7f400640 1 -- 172.21.15.52:0/3699987667 >> v1:172.21.15.52:6789/0 conn(0x7f3a880d21e0 legacy=0x7f3a880d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.102+0000 7f3a7f400640 1 -- 172.21.15.52:0/3699987667 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880d0300 con 0x7f3a880b4170 2024-06-02T16:49:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.102+0000 7f3a87400640 1 -- 172.21.15.52:0/3699987667 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944880086 0 0) 0x7f3a880cfd40 con 0x7f3a880d21e0 2024-06-02T16:49:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.103+0000 7f3a7f400640 1 --2- 172.21.15.52:0/3699987667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880b4170 0x7f3a880d1ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a700097a0 tx=0x7f3a7002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f0817127dd33f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.103+0000 7f3a87400640 1 -- 172.21.15.52:0/3699987667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70037070 con 0x7f3a880b4170 2024-06-02T16:49:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.103+0000 7f3a87400640 1 -- 172.21.15.52:0/3699987667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a70032440 con 0x7f3a880b4170 2024-06-02T16:49:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.103+0000 7f3a87400640 1 -- 172.21.15.52:0/3699987667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70032810 con 0x7f3a880b4170 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 -- 172.21.15.52:0/3699987667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880b4170 msgr2=0x7f3a880d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 --2- 172.21.15.52:0/3699987667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880b4170 0x7f3a880d1ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a700097a0 tx=0x7f3a7002a230 comp rx=0 tx=0).stop 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 -- 172.21.15.52:0/3699987667 shutdown_connections 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 --2- 172.21.15.52:0/3699987667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880b4170 0x7f3a880d1ca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 -- 172.21.15.52:0/3699987667 >> 172.21.15.52:0/3699987667 conn(0x7f3a880740e0 msgr2=0x7f3a8806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 -- 172.21.15.52:0/3699987667 shutdown_connections 2024-06-02T16:49:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.104+0000 7f3a8d600640 1 -- 172.21.15.52:0/3699987667 wait complete. 2024-06-02T16:49:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.106+0000 7f3a8d600640 1 Processor -- start 2024-06-02T16:49:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.106+0000 7f3a8d600640 1 -- start start 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a880b4170 0x7f3a880b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a8815f6a0 0x7f3a88155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880d08c0 con 0x7f3a880d21e0 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880cfaf0 con 0x7f3a8815f6a0 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a8d600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f3a880d3d60 con 0x7f3a880b4170 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a7f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a7f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35286/0 (socket says 172.21.15.52:35286) 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a7f400640 1 -- 172.21.15.52:0/1450878961 learned_addr learned my addr 172.21.15.52:0/1450878961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.107+0000 7f3a87e00640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a880b4170 0x7f3a880b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a8cc00640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a8815f6a0 0x7f3a88155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 -- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a880b4170 msgr2=0x7f3a880b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a880b4170 0x7f3a880b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 -- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a8815f6a0 msgr2=0x7f3a88155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a8815f6a0 0x7f3a88155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 -- 172.21.15.52:0/1450878961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a88162a90 con 0x7f3a880d21e0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a7f400640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3a700097a0 tx=0x7f3a700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70037050 con 0x7f3a880d21e0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a70038040 con 0x7f3a880d21e0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.108+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70004490 con 0x7f3a880d21e0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.109+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a88155ab0 con 0x7f3a880d21e0 2024-06-02T16:49:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.109+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a880b65c0 con 0x7f3a880d21e0 2024-06-02T16:49:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.110+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a880507e0 con 0x7f3a880d21e0 2024-06-02T16:49:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.111+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3a70030900 con 0x7f3a880d21e0 2024-06-02T16:49:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.112+0000 7f3a84c00640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 0x7f3a64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.112+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3a700b8280 con 0x7f3a880d21e0 2024-06-02T16:49:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.113+0000 7f3a87e00640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 0x7f3a64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.114+0000 7f3a87e00640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 0x7f3a64078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000f60 tx=0x7f3a78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.117+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3a70081b40 con 0x7f3a880d21e0 2024-06-02T16:49:32.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.328+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a88075720 con 0x7f3a880d21e0 2024-06-02T16:49:32.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.329+0000 7f3a84c00640 1 -- 172.21.15.52:0/1450878961 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16613 (secure 0 0 0) 0x7f3a70081440 con 0x7f3a880d21e0 2024-06-02T16:49:32.329 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:32.329 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:06.834085+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-06-02T16:49:03.203481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-06-02T16:49:04.293800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 msgr2=0x7f3a64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 0x7f3a64078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000f60 tx=0x7f3a78009040 comp rx=0 tx=0).stop 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 msgr2=0x7f3a88162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3a700097a0 tx=0x7f3a700046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 shutdown_connections 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f3a640762d0 0x7f3a64078790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a8815f6a0 0x7f3a88155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a880d21e0 0x7f3a88162550 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 --2- 172.21.15.52:0/1450878961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a880b4170 0x7f3a880b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 >> 172.21.15.52:0/1450878961 conn(0x7f3a880740e0 msgr2=0x7f3a8815e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:32.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 shutdown_connections 2024-06-02T16:49:32.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.332+0000 7f3a8d600640 1 -- 172.21.15.52:0/1450878961 wait complete. 2024-06-02T16:49:32.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T16:49:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.565+0000 7fbe0b000640 1 Processor -- start 2024-06-02T16:49:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.565+0000 7fbe0b000640 1 -- start start 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe0b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe040b4750 0x7fbe040cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe0b000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040d37b0 con 0x7fbe0415f5f0 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe0b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040d3a90 con 0x7fbe040d09e0 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe0b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbe040d0130 con 0x7fbe040b4750 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe09c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbe0415f5f0 0x7fbe040d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33794/0 (socket says 172.21.15.52:33794) 2024-06-02T16:49:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.567+0000 7fbe09c00640 1 -- 172.21.15.52:0/1354532618 learned_addr learned my addr 172.21.15.52:0/1354532618 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220417563 0 0) 0x7fbe040d37b0 con 0x7fbe0415f5f0 2024-06-02T16:49:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdec003520 con 0x7fbe0415f5f0 2024-06-02T16:49:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe0a600640 1 --2- 172.21.15.52:0/1354532618 >> v2:172.21.15.114:3300/0 conn(0x7fbe040b4750 0x7fbe040cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2427863511 0 0) 0x7fbdec003520 con 0x7fbe0415f5f0 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 >> v2:172.21.15.114:3300/0 conn(0x7fbe040b4750 msgr2=0x7fbe040cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 --2- 172.21.15.52:0/1354532618 >> v2:172.21.15.114:3300/0 conn(0x7fbe040b4750 0x7fbe040cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 >> v1:172.21.15.114:6789/0 conn(0x7fbe040d09e0 legacy=0x7fbe040b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040d3d70 con 0x7fbe0415f5f0 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fbdf80016f0 con 0x7fbe0415f5f0 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 >> v1:172.21.15.52:6789/0 conn(0x7fbe0415f5f0 legacy=0x7fbe040d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.568+0000 7fbe03e00640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbdec003a50 0x7fbdec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe03e00640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec004800 0x7fbdec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe03e00640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 0x7fbdec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040d0130 con 0x7fbdec0051c0 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec00c160 con 0x7fbdec004800 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbdec00c360 con 0x7fbdec003a50 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 0x7fbdec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe09c00640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbdec003a50 0x7fbdec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 -- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbdec003a50 msgr2=0x7fbdec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbdec003a50 0x7fbdec003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 -- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec004800 msgr2=0x7fbdec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec004800 0x7fbdec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.569+0000 7fbe0a600640 1 -- 172.21.15.52:0/1354532618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec003520 con 0x7fbdec0051c0 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.570+0000 7fbe0a600640 1 -- 172.21.15.52:0/1354532618 reap_dead start 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.570+0000 7fbe0a600640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 0x7fbdec00b9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009fc0 tx=0x7fbdec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75efadf83d50348d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc035020 con 0x7fbdec0051c0 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc003bd0 con 0x7fbdec0051c0 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe03e00640 1 -- 172.21.15.52:0/1354532618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc009c10 con 0x7fbdec0051c0 2024-06-02T16:49:32.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe0b000640 1 -- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 msgr2=0x7fbdec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe0b000640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 0x7fbdec00b9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009fc0 tx=0x7fbdec005830 comp rx=0 tx=0).stop 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe0b000640 1 -- 172.21.15.52:0/1354532618 shutdown_connections 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe0b000640 1 --2- 172.21.15.52:0/1354532618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdec0051c0 0x7fbdec00b9c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.571+0000 7fbe0b000640 1 -- 172.21.15.52:0/1354532618 >> 172.21.15.52:0/1354532618 conn(0x7fbe040740e0 msgr2=0x7fbe0406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.572+0000 7fbe0b000640 1 -- 172.21.15.52:0/1354532618 shutdown_connections 2024-06-02T16:49:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.572+0000 7fbe0b000640 1 -- 172.21.15.52:0/1354532618 wait complete. 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.573+0000 7fbe0b000640 1 Processor -- start 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.573+0000 7fbe0b000640 1 -- start start 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec0051c0 0x7fbe040b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe041627c0 0x7fbe0415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040d4850 con 0x7fbe0415da80 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040d4330 con 0x7fbdec0051c0 2024-06-02T16:49:32.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.574+0000 7fbe0b000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0415f9d0 con 0x7fbe041627c0 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35302/0 (socket says 172.21.15.52:35302) 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 -- 172.21.15.52:0/3680657985 learned_addr learned my addr 172.21.15.52:0/3680657985 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe09c00640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec0051c0 0x7fbe040b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe09200640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe041627c0 0x7fbe0415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 -- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe041627c0 msgr2=0x7fbe0415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe041627c0 0x7fbe0415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 -- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec0051c0 msgr2=0x7fbe040b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec0051c0 0x7fbe040b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.575+0000 7fbe0a600640 1 -- 172.21.15.52:0/3680657985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0414d0d0 con 0x7fbe0415da80 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe0a600640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc02af10 tx=0x7fbdfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc035030 con 0x7fbe0415da80 2024-06-02T16:49:32.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc043070 con 0x7fbe0415da80 2024-06-02T16:49:32.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc02d070 con 0x7fbe0415da80 2024-06-02T16:49:32.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0414d3b0 con 0x7fbe0415da80 2024-06-02T16:49:32.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.576+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0414d970 con 0x7fbe0415da80 2024-06-02T16:49:32.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.577+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe040507e0 con 0x7fbe0415da80 2024-06-02T16:49:32.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.578+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbdfc005d10 con 0x7fbe0415da80 2024-06-02T16:49:32.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.579+0000 7fbe01600640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 0x7fbde4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:32.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.580+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fbdfc0b83a0 con 0x7fbe0415da80 2024-06-02T16:49:32.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.580+0000 7fbe09c00640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 0x7fbde4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:32.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.581+0000 7fbe09c00640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 0x7fbde4078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80059f0 tx=0x7fbdf8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:32.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.584+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbdfc081c60 con 0x7fbe0415da80 2024-06-02T16:49:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.837+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbe040cc930 con 0x7fbe0415da80 2024-06-02T16:49:32.838 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-06-02T16:49:32.839+0000 7f30fc200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T16:49:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.842+0000 7fbe01600640 1 -- 172.21.15.52:0/3680657985 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7fbdfc081560 con 0x7fbe0415da80 2024-06-02T16:49:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T16:49:32.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.845+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 msgr2=0x7fbde4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.845+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 0x7fbde4078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80059f0 tx=0x7fbdf8009040 comp rx=0 tx=0).stop 2024-06-02T16:49:32.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.845+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 msgr2=0x7fbe040b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:32.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.845+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc02af10 tx=0x7fbdfc009750 comp rx=0 tx=0).stop 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 shutdown_connections 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbde40762d0 0x7fbde4078790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe0415da80 0x7fbe040b6d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe041627c0 0x7fbe0415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 --2- 172.21.15.52:0/3680657985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdec0051c0 0x7fbe040b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 >> 172.21.15.52:0/3680657985 conn(0x7fbe040740e0 msgr2=0x7fbe040d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 shutdown_connections 2024-06-02T16:49:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:32.846+0000 7fbe0b000640 1 -- 172.21.15.52:0/3680657985 wait complete. 2024-06-02T16:49:32.866 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T16:49:32.967 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2024-06-02T16:49:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.075+0000 7fd312e00640 1 Processor -- start 2024-06-02T16:49:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.075+0000 7fd312e00640 1 -- start start 2024-06-02T16:49:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.076+0000 7fd312e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd30c15f640 0x7fd30c0d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd312e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd312e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c0d3850 con 0x7fd30c0d21d0 2024-06-02T16:49:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd312e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd30c0d3af0 con 0x7fd30c15f640 2024-06-02T16:49:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd312e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd30c0d3dd0 con 0x7fd30c0bab20 2024-06-02T16:49:33.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd311000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd311a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd30c15f640 0x7fd30c0d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd311000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:55284/0 (socket says 172.21.15.52:55284) 2024-06-02T16:49:33.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.077+0000 7fd311000640 1 -- 172.21.15.52:0/259660215 learned_addr learned my addr 172.21.15.52:0/259660215 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:33.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.078+0000 7fd311000640 1 -- 172.21.15.52:0/259660215 >> v2:172.21.15.114:3300/0 conn(0x7fd30c15f640 msgr2=0x7fd30c0d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:33.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.078+0000 7fd311000640 1 --2- 172.21.15.52:0/259660215 >> v2:172.21.15.114:3300/0 conn(0x7fd30c15f640 0x7fd30c0d4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.078+0000 7fd311000640 1 -- 172.21.15.52:0/259660215 >> v1:172.21.15.114:6789/0 conn(0x7fd30c0d21d0 legacy=0x7fd30c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.078+0000 7fd311000640 1 -- 172.21.15.52:0/259660215 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c0d40b0 con 0x7fd30c0bab20 2024-06-02T16:49:33.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.080+0000 7fd311000640 1 --2- 172.21.15.52:0/259660215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009870 tx=0x7fd2f802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55acc3c82c24622 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:33.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.080+0000 7fd30be00640 1 -- 172.21.15.52:0/259660215 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8037070 con 0x7fd30c0bab20 2024-06-02T16:49:33.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.080+0000 7fd30be00640 1 -- 172.21.15.52:0/259660215 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f8032440 con 0x7fd30c0bab20 2024-06-02T16:49:33.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.080+0000 7fd30be00640 1 -- 172.21.15.52:0/259660215 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8032810 con 0x7fd30c0bab20 2024-06-02T16:49:33.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 -- 172.21.15.52:0/259660215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 msgr2=0x7fd30c0d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 --2- 172.21.15.52:0/259660215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009870 tx=0x7fd2f802a270 comp rx=0 tx=0).stop 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 -- 172.21.15.52:0/259660215 shutdown_connections 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 --2- 172.21.15.52:0/259660215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c0bab20 0x7fd30c0d3310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 --2- 172.21.15.52:0/259660215 >> v2:172.21.15.114:3300/0 conn(0x7fd30c15f640 0x7fd30c0d4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 -- 172.21.15.52:0/259660215 >> 172.21.15.52:0/259660215 conn(0x7fd30c073ed0 msgr2=0x7fd30c0742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 -- 172.21.15.52:0/259660215 shutdown_connections 2024-06-02T16:49:33.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.081+0000 7fd312e00640 1 -- 172.21.15.52:0/259660215 wait complete. 2024-06-02T16:49:33.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.084+0000 7fd312e00640 1 Processor -- start 2024-06-02T16:49:33.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.084+0000 7fd312e00640 1 -- start start 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 0x7fd30c0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c15f640 0x7fd30c0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c0d27e0 con 0x7fd30c0d21d0 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c0d2660 con 0x7fd30c0bab20 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.085+0000 7fd312e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd30c0d2960 con 0x7fd30c15f640 2024-06-02T16:49:33.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48090/0 (socket says 172.21.15.52:48090) 2024-06-02T16:49:33.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 -- 172.21.15.52:0/1799230713 learned_addr learned my addr 172.21.15.52:0/1799230713 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd312400640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c15f640 0x7fd30c0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311a00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 0x7fd30c0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 -- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c15f640 msgr2=0x7fd30c0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c15f640 0x7fd30c0ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 -- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 msgr2=0x7fd30c0b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 0x7fd30c0b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311000640 1 -- 172.21.15.52:0/1799230713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c159cc0 con 0x7fd30c0d21d0 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.086+0000 7fd311a00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 0x7fd30c0b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd311000640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009990 tx=0x7fd2f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8037040 con 0x7fd30c0d21d0 2024-06-02T16:49:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f8042070 con 0x7fd30c0d21d0 2024-06-02T16:49:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8030940 con 0x7fd30c0d21d0 2024-06-02T16:49:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c150a60 con 0x7fd30c0d21d0 2024-06-02T16:49:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.087+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c0b5850 con 0x7fd30c0d21d0 2024-06-02T16:49:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.088+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30c0507e0 con 0x7fd30c0d21d0 2024-06-02T16:49:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.089+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2f8030ae0 con 0x7fd30c0d21d0 2024-06-02T16:49:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.091+0000 7fd309600640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 0x7fd2ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.091+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7fd2f80b7f00 con 0x7fd30c0d21d0 2024-06-02T16:49:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.091+0000 7fd311a00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 0x7fd2ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.092+0000 7fd311a00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 0x7fd2ec078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd300007440 tx=0x7fd30000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:33.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.095+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd30c159cc0 con 0x7fd30c0d21d0 2024-06-02T16:49:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.348+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd30c074450 con 0x7fd30c0d21d0 2024-06-02T16:49:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.846+0000 7fd309600640 1 -- 172.21.15.52:0/1799230713 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fd2f8081760 con 0x7fd30c0d21d0 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 msgr2=0x7fd2ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 0x7fd2ec078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd300007440 tx=0x7fd30000b040 comp rx=0 tx=0).stop 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 msgr2=0x7fd30c150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009990 tx=0x7fd2f80046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 shutdown_connections 2024-06-02T16:49:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd2ec0762d0 0x7fd2ec078790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd30c15f640 0x7fd30c0ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd30c0d21d0 0x7fd30c150520 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 --2- 172.21.15.52:0/1799230713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd30c0bab20 0x7fd30c0b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.849+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 >> 172.21.15.52:0/1799230713 conn(0x7fd30c073ed0 msgr2=0x7fd30c0cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.850+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 shutdown_connections 2024-06-02T16:49:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:33.850+0000 7fd312e00640 1 -- 172.21.15.52:0/1799230713 wait complete. 2024-06-02T16:49:33.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T16:49:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.094+0000 7f067a600640 1 Processor -- start 2024-06-02T16:49:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.094+0000 7f067a600640 1 -- start start 2024-06-02T16:49:34.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f067a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f067415f780 0x7f06740d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:34.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f067a600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740d1910 con 0x7f06740d1e80 2024-06-02T16:49:34.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f067a600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067406d900 con 0x7f067406d4a0 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f067a600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f067415fb60 con 0x7f067415f780 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f0673400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f067415f780 0x7f06740d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f0673400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f067415f780 0x7f06740d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48098/0 (socket says 172.21.15.52:48098) 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.096+0000 7f0673400640 1 -- 172.21.15.52:0/3728567237 learned_addr learned my addr 172.21.15.52:0/3728567237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.097+0000 7f0673400640 1 -- 172.21.15.52:0/3728567237 >> v1:172.21.15.114:6789/0 conn(0x7f067406d4a0 legacy=0x7f06740d5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.097+0000 7f0673400640 1 -- 172.21.15.52:0/3728567237 >> v1:172.21.15.52:6789/0 conn(0x7f06740d1e80 legacy=0x7f06740d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:34.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.097+0000 7f0673400640 1 -- 172.21.15.52:0/3728567237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740d1350 con 0x7f067415f780 2024-06-02T16:49:34.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f0673400640 1 --2- 172.21.15.52:0/3728567237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f067415f780 0x7f06740d0d70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0664009e50 tx=0x7f066402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba8b8d0755be1a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f0672000640 1 -- 172.21.15.52:0/3728567237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664036070 con 0x7f067415f780 2024-06-02T16:49:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f0672000640 1 -- 172.21.15.52:0/3728567237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0664031600 con 0x7f067415f780 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f0672000640 1 -- 172.21.15.52:0/3728567237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640319d0 con 0x7f067415f780 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f067a600640 1 -- 172.21.15.52:0/3728567237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f067415f780 msgr2=0x7f06740d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.098+0000 7f067a600640 1 --2- 172.21.15.52:0/3728567237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f067415f780 0x7f06740d0d70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0664009e50 tx=0x7f066402a610 comp rx=0 tx=0).stop 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.099+0000 7f067a600640 1 -- 172.21.15.52:0/3728567237 shutdown_connections 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.099+0000 7f067a600640 1 --2- 172.21.15.52:0/3728567237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f067415f780 0x7f06740d0d70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.099+0000 7f067a600640 1 -- 172.21.15.52:0/3728567237 >> 172.21.15.52:0/3728567237 conn(0x7f067408cf50 msgr2=0x7f06740d5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.099+0000 7f067a600640 1 -- 172.21.15.52:0/3728567237 shutdown_connections 2024-06-02T16:49:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.099+0000 7f067a600640 1 -- 172.21.15.52:0/3728567237 wait complete. 2024-06-02T16:49:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.100+0000 7f067a600640 1 Processor -- start 2024-06-02T16:49:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.101+0000 7f067a600640 1 -- start start 2024-06-02T16:49:34.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.101+0000 7f067a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 0x7f0674162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:34.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f067a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:34.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f067a600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 0x7f06741509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f067a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06740d3450 con 0x7f06740d1e80 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f067a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06740d3170 con 0x7f067406d4a0 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f067a600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f06740d2310 con 0x7f067415f780 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48104/0 (socket says 172.21.15.52:48104) 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 -- 172.21.15.52:0/2517739574 learned_addr learned my addr 172.21.15.52:0/2517739574 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:34.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0673400640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 0x7f0674162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:34.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0673e00640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 0x7f06741509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 -- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 msgr2=0x7f06741509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 0x7f06741509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 -- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 msgr2=0x7f0674162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.102+0000 7f0672a00640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 0x7f0674162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f0672a00640 1 -- 172.21.15.52:0/2517739574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740b9550 con 0x7f06740d1e80 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f0673400640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 0x7f0674162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f0673e00640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 0x7f06741509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f0672a00640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c450 tx=0x7f065c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c016020 con 0x7f06740d1e80 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c012830 con 0x7f06740d1e80 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c012c20 con 0x7f06740d1e80 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06740b9830 con 0x7f06740d1e80 2024-06-02T16:49:34.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.103+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06740b9df0 con 0x7f06740d1e80 2024-06-02T16:49:34.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.104+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06740d4a60 con 0x7f06740d1e80 2024-06-02T16:49:34.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.106+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f065c019020 con 0x7f06740d1e80 2024-06-02T16:49:34.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.107+0000 7f066b400640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 0x7f0650078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:34.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.107+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5795+0+0 (secure 0 0 0) 0x7f065c097490 con 0x7f06740d1e80 2024-06-02T16:49:34.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.107+0000 7f0673400640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 0x7f0650078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:34.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.109+0000 7f0673400640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 0x7f0650078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0664033000 tx=0x7f0664009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.111+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f065c060d80 con 0x7f06740d1e80 2024-06-02T16:49:34.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:34.325+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0674069520 con 0x7f06740d1e80 2024-06-02T16:49:35.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.234+0000 7f066b400640 1 -- 172.21.15.52:0/2517739574 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f065c060680 con 0x7f06740d1e80 2024-06-02T16:49:35.234 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 msgr2=0x7f0650078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 0x7f0650078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0664033000 tx=0x7f0664009000 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 msgr2=0x7f06740b8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c450 tx=0x7f065c00c910 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 shutdown_connections 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f06500762d0 0x7f0650078790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f067415f780 0x7f06741509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06740d1e80 0x7f06740b8de0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 --2- 172.21.15.52:0/2517739574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f067406d4a0 0x7f0674162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 >> 172.21.15.52:0/2517739574 conn(0x7f067408cf50 msgr2=0x7f067415df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 shutdown_connections 2024-06-02T16:49:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.239+0000 7f067a600640 1 -- 172.21.15.52:0/2517739574 wait complete. 2024-06-02T16:49:35.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T16:49:35.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.484+0000 7eff72000640 1 Processor -- start 2024-06-02T16:49:35.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.484+0000 7eff72000640 1 -- start start 2024-06-02T16:49:35.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.485+0000 7eff72000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.485+0000 7eff72000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff6c0b8780 0x7eff6c163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.485+0000 7eff72000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c0d0360 con 0x7eff6c15f680 2024-06-02T16:49:35.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.485+0000 7eff72000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7eff6c1641c0 con 0x7eff6c0b8780 2024-06-02T16:49:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.485+0000 7eff72000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7eff6c0d36d0 con 0x7eff6c0d23c0 2024-06-02T16:49:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.486+0000 7eff71600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff6c0b8780 0x7eff6c163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.486+0000 7eff71600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff6c0b8780 0x7eff6c163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48112/0 (socket says 172.21.15.52:48112) 2024-06-02T16:49:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.486+0000 7eff71600640 1 -- 172.21.15.52:0/20543832 learned_addr learned my addr 172.21.15.52:0/20543832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.486+0000 7eff71600640 1 -- 172.21.15.52:0/20543832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 msgr2=0x7eff6c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.486+0000 7eff6be00640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.487+0000 7eff71600640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.487+0000 7eff71600640 1 -- 172.21.15.52:0/20543832 >> v1:172.21.15.114:6789/0 conn(0x7eff6c15f680 legacy=0x7eff6c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.487+0000 7eff71600640 1 -- 172.21.15.52:0/20543832 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c0d0640 con 0x7eff6c0b8780 2024-06-02T16:49:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.487+0000 7eff6be00640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.488+0000 7eff71600640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c0b8780 0x7eff6c163c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7eff64009e50 tx=0x7eff6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c3da1bc33d2e53 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.488+0000 7eff6b400640 1 -- 172.21.15.52:0/20543832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64036070 con 0x7eff6c0b8780 2024-06-02T16:49:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.488+0000 7eff6b400640 1 -- 172.21.15.52:0/20543832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff64031600 con 0x7eff6c0b8780 2024-06-02T16:49:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.488+0000 7eff6b400640 1 -- 172.21.15.52:0/20543832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640319d0 con 0x7eff6c0b8780 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 -- 172.21.15.52:0/20543832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c0b8780 msgr2=0x7eff6c163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c0b8780 0x7eff6c163c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7eff64009e50 tx=0x7eff6402a680 comp rx=0 tx=0).stop 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 -- 172.21.15.52:0/20543832 shutdown_connections 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c0b8780 0x7eff6c163c80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 --2- 172.21.15.52:0/20543832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 -- 172.21.15.52:0/20543832 >> 172.21.15.52:0/20543832 conn(0x7eff6c0740e0 msgr2=0x7eff6c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 -- 172.21.15.52:0/20543832 shutdown_connections 2024-06-02T16:49:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.489+0000 7eff72000640 1 -- 172.21.15.52:0/20543832 wait complete. 2024-06-02T16:49:35.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.491+0000 7eff72000640 1 Processor -- start 2024-06-02T16:49:35.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.491+0000 7eff72000640 1 -- start start 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 0x7eff6c162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c15fa60 con 0x7eff6c15f680 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c0d0c00 con 0x7eff6c0b8780 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff72000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7eff6c0d3b60 con 0x7eff6c0d23c0 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff71600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff71600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48126/0 (socket says 172.21.15.52:48126) 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.492+0000 7eff71600640 1 -- 172.21.15.52:0/352042891 learned_addr learned my addr 172.21.15.52:0/352042891 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff70c00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 0x7eff6c162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 -- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 msgr2=0x7eff6c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff6be00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 -- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 msgr2=0x7eff6c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 0x7eff6c162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 -- 172.21.15.52:0/352042891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c0ceb30 con 0x7eff6c15f680 2024-06-02T16:49:35.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff70c00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 0x7eff6c162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff6be00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.493+0000 7eff71600640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff64009f70 tx=0x7eff64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.494+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64041020 con 0x7eff6c15f680 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.494+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff64008730 con 0x7eff6c15f680 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.494+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64036040 con 0x7eff6c15f680 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.494+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c0cee10 con 0x7eff6c15f680 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.494+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c154e40 con 0x7eff6c15f680 2024-06-02T16:49:35.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.495+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c0507e0 con 0x7eff6c15f680 2024-06-02T16:49:35.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.496+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff64044020 con 0x7eff6c15f680 2024-06-02T16:49:35.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.497+0000 7eff68c00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 0x7eff48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:35.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.497+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5357+0+0 (secure 0 0 0) 0x7eff640b8200 con 0x7eff6c15f680 2024-06-02T16:49:35.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.498+0000 7eff70c00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 0x7eff48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:35.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.499+0000 7eff70c00640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 0x7eff48078790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff5c006fd0 tx=0x7eff5c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:35.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.504+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff6404b030 con 0x7eff6c15f680 2024-06-02T16:49:35.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:35.713+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff6c0d3250 con 0x7eff6c15f680 2024-06-02T16:49:36.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:49:36.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:49:36.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.245+0000 7eff68c00640 1 -- 172.21.15.52:0/352042891 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7eff64081cc0 con 0x7eff6c15f680 2024-06-02T16:49:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-06-02T16:49:36.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.251+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 msgr2=0x7eff48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.251+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 0x7eff48078790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7eff5c006fd0 tx=0x7eff5c008040 comp rx=0 tx=0).stop 2024-06-02T16:49:36.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.251+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 msgr2=0x7eff6c0ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.251+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff64009f70 tx=0x7eff64004a40 comp rx=0 tx=0).stop 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 shutdown_connections 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7eff480762d0 0x7eff48078790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff6c15f680 0x7eff6c0ccf40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff6c0d23c0 0x7eff6c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 --2- 172.21.15.52:0/352042891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff6c0b8780 0x7eff6c162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 >> 172.21.15.52:0/352042891 conn(0x7eff6c0740e0 msgr2=0x7eff6c0d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 shutdown_connections 2024-06-02T16:49:36.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.252+0000 7eff72000640 1 -- 172.21.15.52:0/352042891 wait complete. 2024-06-02T16:49:36.279 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-02T16:49:36.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.546+0000 7ff33aa00640 1 Processor -- start 2024-06-02T16:49:36.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.546+0000 7ff33aa00640 1 -- start start 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff33aa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33406daa0 0x7ff3340aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff33aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff33406f960 0x7ff3340b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff33aa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33415f930 con 0x7ff33415f550 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff33aa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff3340b5f40 con 0x7ff33406f960 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff33aa00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340af0d0 con 0x7ff33406daa0 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.548+0000 7ff338a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff33406f960 0x7ff3340b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff333e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff33415f550 0x7ff33406d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37160/0 (socket says 172.21.15.52:37160) 2024-06-02T16:49:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff333e00640 1 -- 172.21.15.52:0/2385697647 learned_addr learned my addr 172.21.15.52:0/2385697647 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff333400640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33406daa0 0x7ff3340aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff338a00640 1 -- 172.21.15.52:0/2385697647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33406daa0 msgr2=0x7ff3340aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff338a00640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33406daa0 0x7ff3340aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff338a00640 1 -- 172.21.15.52:0/2385697647 >> v1:172.21.15.52:6789/0 conn(0x7ff33415f550 legacy=0x7ff33406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff332a00640 1 -- 172.21.15.52:0/2385697647 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715317420 0 0) 0x7ff32c001110 con 0x7ff33415f550 2024-06-02T16:49:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.549+0000 7ff338a00640 1 -- 172.21.15.52:0/2385697647 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340af3b0 con 0x7ff33406f960 2024-06-02T16:49:36.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.550+0000 7ff338a00640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406f960 0x7ff3340b6420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff324009d90 tx=0x7ff32402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6913faaa190d272b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:36.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff332a00640 1 -- 172.21.15.52:0/2385697647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324007740 con 0x7ff33406f960 2024-06-02T16:49:36.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff332a00640 1 -- 172.21.15.52:0/2385697647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3240078e0 con 0x7ff33406f960 2024-06-02T16:49:36.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff332a00640 1 -- 172.21.15.52:0/2385697647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324007cb0 con 0x7ff33406f960 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 -- 172.21.15.52:0/2385697647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406f960 msgr2=0x7ff3340b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406f960 0x7ff3340b6420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff324009d90 tx=0x7ff32402a660 comp rx=0 tx=0).stop 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 -- 172.21.15.52:0/2385697647 shutdown_connections 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406f960 0x7ff3340b6420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 --2- 172.21.15.52:0/2385697647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33406daa0 0x7ff3340aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.551+0000 7ff33aa00640 1 -- 172.21.15.52:0/2385697647 >> 172.21.15.52:0/2385697647 conn(0x7ff334072ce0 msgr2=0x7ff3340730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:36.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.552+0000 7ff33aa00640 1 -- 172.21.15.52:0/2385697647 shutdown_connections 2024-06-02T16:49:36.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.552+0000 7ff33aa00640 1 -- 172.21.15.52:0/2385697647 wait complete. 2024-06-02T16:49:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.553+0000 7ff33aa00640 1 Processor -- start 2024-06-02T16:49:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.553+0000 7ff33aa00640 1 -- start start 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff33406f960 0x7ff3340cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33415f550 0x7ff3340b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff33406fdb0 con 0x7ff33406daa0 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340af970 con 0x7ff33406f960 2024-06-02T16:49:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.554+0000 7ff33aa00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340b6960 con 0x7ff33415f550 2024-06-02T16:49:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.555+0000 7ff333e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.555+0000 7ff333e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48148/0 (socket says 172.21.15.52:48148) 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.555+0000 7ff333e00640 1 -- 172.21.15.52:0/1428751847 learned_addr learned my addr 172.21.15.52:0/1428751847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.555+0000 7ff338a00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33415f550 0x7ff3340b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.555+0000 7ff333400640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff33406f960 0x7ff3340cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 -- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33415f550 msgr2=0x7ff3340b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33415f550 0x7ff3340b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 -- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff33406f960 msgr2=0x7ff3340cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff33406f960 0x7ff3340cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 -- 172.21.15.52:0/1428751847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3341619f0 con 0x7ff33406daa0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff333e00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c3e0 tx=0x7ff32c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0074e0 con 0x7ff33406daa0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c0047e0 con 0x7ff33406daa0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c004bd0 con 0x7ff33406daa0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff334161cd0 con 0x7ff33406daa0 2024-06-02T16:49:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.556+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff334162290 con 0x7ff33406daa0 2024-06-02T16:49:36.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.557+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff334069c30 con 0x7ff33406daa0 2024-06-02T16:49:36.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.559+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff32c011070 con 0x7ff33406daa0 2024-06-02T16:49:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.560+0000 7ff32be00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 0x7ff310078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.560+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7ff32c096f40 con 0x7ff33406daa0 2024-06-02T16:49:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.560+0000 7ff333400640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 0x7ff310078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:36.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.562+0000 7ff333400640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 0x7ff310078790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3340ce2a0 tx=0x7ff31c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:36.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.569+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff33415f930 con 0x7ff33406daa0 2024-06-02T16:49:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.779+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff3340b6740 con 0x7ff33406daa0 2024-06-02T16:49:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.786+0000 7ff32be00640 1 -- 172.21.15.52:0/1428751847 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7ff32c060b90 con 0x7ff33406daa0 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 msgr2=0x7ff310078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 0x7ff310078790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3340ce2a0 tx=0x7ff31c008040 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 msgr2=0x7ff33414c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c3e0 tx=0x7ff32c00c8a0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 shutdown_connections 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff3100762d0 0x7ff310078790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff33415f550 0x7ff3340b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff33406f960 0x7ff3340cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 --2- 172.21.15.52:0/1428751847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33406daa0 0x7ff33414c660 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 >> 172.21.15.52:0/1428751847 conn(0x7ff334072ce0 msgr2=0x7ff33406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:36.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.789+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 shutdown_connections 2024-06-02T16:49:36.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:36.790+0000 7ff33aa00640 1 -- 172.21.15.52:0/1428751847 wait complete. 2024-06-02T16:49:36.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-06-02T16:49:37.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.012+0000 7f8f02000640 1 Processor -- start 2024-06-02T16:49:37.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.012+0000 7f8f02000640 1 -- start start 2024-06-02T16:49:37.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8efc15d2d0 0x7f8efc0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc06fed0 0x7f8efc06f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8efc0d1450 0x7f8efc0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc15d6b0 con 0x7f8efc15d2d0 2024-06-02T16:49:37.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc06ed90 con 0x7f8efc0d1450 2024-06-02T16:49:37.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.013+0000 7f8f02000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0ae8e0 con 0x7f8efc06fed0 2024-06-02T16:49:37.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8efc15d2d0 0x7f8efc0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8efc15d2d0 0x7f8efc0ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48152/0 (socket says 172.21.15.52:48152) 2024-06-02T16:49:37.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 -- 172.21.15.52:0/1284916258 learned_addr learned my addr 172.21.15.52:0/1284916258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efbe00640 1 --2- 172.21.15.52:0/1284916258 >> v2:172.21.15.114:3300/0 conn(0x7f8efc0d1450 0x7f8efc0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8ef2a00640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc06fed0 0x7f8efc06f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 -- 172.21.15.52:0/1284916258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc06fed0 msgr2=0x7f8efc06f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc06fed0 0x7f8efc06f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 -- 172.21.15.52:0/1284916258 >> v2:172.21.15.114:3300/0 conn(0x7f8efc0d1450 msgr2=0x7f8efc0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 --2- 172.21.15.52:0/1284916258 >> v2:172.21.15.114:3300/0 conn(0x7f8efc0d1450 0x7f8efc0d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.014+0000 7f8efb400640 1 -- 172.21.15.52:0/1284916258 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc0ae600 con 0x7f8efc15d2d0 2024-06-02T16:49:37.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.015+0000 7f8efb400640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc0ae020 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0cd990 tx=0x7f8eec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a9ff4a40c742e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:37.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.016+0000 7f8efaa00640 1 -- 172.21.15.52:0/1284916258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec037070 con 0x7f8efc15d2d0 2024-06-02T16:49:37.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.016+0000 7f8efaa00640 1 -- 172.21.15.52:0/1284916258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec032440 con 0x7f8efc15d2d0 2024-06-02T16:49:37.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.016+0000 7f8efaa00640 1 -- 172.21.15.52:0/1284916258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec032810 con 0x7f8efc15d2d0 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.016+0000 7f8f02000640 1 -- 172.21.15.52:0/1284916258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 msgr2=0x7f8efc0ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.016+0000 7f8f02000640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc0ae020 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0cd990 tx=0x7f8eec02a1e0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 -- 172.21.15.52:0/1284916258 shutdown_connections 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc06fed0 0x7f8efc06f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 --2- 172.21.15.52:0/1284916258 >> v2:172.21.15.114:3300/0 conn(0x7f8efc0d1450 0x7f8efc0d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 --2- 172.21.15.52:0/1284916258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc0ae020 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 -- 172.21.15.52:0/1284916258 >> 172.21.15.52:0/1284916258 conn(0x7f8efc06c7a0 msgr2=0x7f8efc06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 -- 172.21.15.52:0/1284916258 shutdown_connections 2024-06-02T16:49:37.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.017+0000 7f8f02000640 1 -- 172.21.15.52:0/1284916258 wait complete. 2024-06-02T16:49:37.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.019+0000 7f8f02000640 1 Processor -- start 2024-06-02T16:49:37.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.019+0000 7f8f02000640 1 -- start start 2024-06-02T16:49:37.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 0x7f8efc151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 0x7f8efc0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0741b0 con 0x7f8efc15d2d0 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc06ea20 con 0x7f8efc06fed0 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8f02000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc1f3570 con 0x7f8efc0d1450 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48156/0 (socket says 172.21.15.52:48156) 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 -- 172.21.15.52:0/1616990138 learned_addr learned my addr 172.21.15.52:0/1616990138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efb400640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 0x7f8efc151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8ef2a00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 0x7f8efc0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 -- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 msgr2=0x7f8efc0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 0x7f8efc0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 -- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 msgr2=0x7f8efc151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 0x7f8efc151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.020+0000 7f8efbe00640 1 -- 172.21.15.52:0/1616990138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc1f3850 con 0x7f8efc15d2d0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8ef2a00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 0x7f8efc0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8efb400640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 0x7f8efc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8efbe00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4007e40 tx=0x7f8ef400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014620 con 0x7f8efc15d2d0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4019070 con 0x7f8efc15d2d0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014a20 con 0x7f8efc15d2d0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc1f3b30 con 0x7f8efc15d2d0 2024-06-02T16:49:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.021+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc0d08c0 con 0x7f8efc15d2d0 2024-06-02T16:49:37.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.022+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc069520 con 0x7f8efc15d2d0 2024-06-02T16:49:37.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.024+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ef4014bc0 con 0x7f8efc15d2d0 2024-06-02T16:49:37.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.025+0000 7f8ef3e00640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 0x7f8ed8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:37.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.025+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f8ef4097cc0 con 0x7f8efc15d2d0 2024-06-02T16:49:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.026+0000 7f8efb400640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 0x7f8ed8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.027+0000 7f8efb400640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 0x7f8ed8078790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eec034000 tx=0x7f8eec02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:37.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.030+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ef409e080 con 0x7f8efc15d2d0 2024-06-02T16:49:37.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:37.321+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f8efc0d0160 con 0x7f8efc15d2d0 2024-06-02T16:49:38.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.257+0000 7f8ef3e00640 1 -- 172.21.15.52:0/1616990138 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v203) ==== 143+0+0 (secure 0 0 0) 0x7f8ef4061880 con 0x7f8efc15d2d0 2024-06-02T16:49:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 msgr2=0x7f8ed8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 0x7f8ed8078790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eec034000 tx=0x7f8eec02e000 comp rx=0 tx=0).stop 2024-06-02T16:49:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 msgr2=0x7f8efc15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4007e40 tx=0x7f8ef400e4b0 comp rx=0 tx=0).stop 2024-06-02T16:49:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 shutdown_connections 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f8ed80762d0 0x7f8ed8078790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8efc15d2d0 0x7f8efc15f650 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8efc0d1450 0x7f8efc0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 --2- 172.21.15.52:0/1616990138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8efc06fed0 0x7f8efc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 >> 172.21.15.52:0/1616990138 conn(0x7f8efc06c7a0 msgr2=0x7f8efc0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 shutdown_connections 2024-06-02T16:49:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:38.261+0000 7f8f02000640 1 -- 172.21.15.52:0/1616990138 wait complete. 2024-06-02T16:49:38.295 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ERROR 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner: 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 206, in test_scrub_checks 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner: self._checks(0) 2024-06-02T16:49:38.296 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 230, in _checks 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: self.asok_command(mds_rank, "flush_path {nep}".format(nep=nep), 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 498, in asok_command 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: jout = json.loads(sout) 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/__init__.py", line 346, in loads 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: return _default_decoder.decode(s) 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/decoder.py", line 337, in decode 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: raise JSONDecodeError("Expecting value", s, err.value) from None 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner:json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner:Ran 2 tests in 236.706s 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-06-02T16:49:38.297 INFO:tasks.cephfs_test_runner: 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 206, in test_scrub_checks 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: self._checks(0) 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 230, in _checks 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: self.asok_command(mds_rank, "flush_path {nep}".format(nep=nep), 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs/test_scrub_checks.py", line 498, in asok_command 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: jout = json.loads(sout) 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/__init__.py", line 346, in loads 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: return _default_decoder.decode(s) 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/decoder.py", line 337, in decode 2024-06-02T16:49:38.298 INFO:tasks.cephfs_test_runner: obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 2024-06-02T16:49:38.299 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode 2024-06-02T16:49:38.299 INFO:tasks.cephfs_test_runner: raise JSONDecodeError("Expecting value", s, err.value) from None 2024-06-02T16:49:38.299 INFO:tasks.cephfs_test_runner:json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2024-06-02T16:49:38.299 INFO:tasks.cephfs_test_runner: 2024-06-02T16:49:38.299 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:49:38.512 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5527bf1ea5c74397a76be8aadf00de59 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_7aec00165b4b073a25396fd0279151d2b2fa23fe/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-06-02T16:49:38.513 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-06-02T16:49:38.523 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-02T16:49:38.568 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-02T16:49:38.568 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:38.568 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:38.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:49:38.630 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-06-02T16:49:38.631 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:38.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T16:49:38.686 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:38.686 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:38.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:38.745 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-06-02T16:49:38.745 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T16:49:38.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T16:49:38.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:38.799 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:49:38.860 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T16:49:38.860 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T16:49:38.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:38.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T16:49:38.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:38.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T16:49:39.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-06-02T16:49:39.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.156 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-06-02T16:49:39.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-06-02T16:49:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-06-02T16:49:39.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:49:39.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.334 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:49:39.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-02T16:49:39.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-06-02T16:49:39.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T16:49:39.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T16:49:39.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-06-02T16:49:39.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.664 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-06-02T16:49:39.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T16:49:39.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-06-02T16:49:39.828 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-06-02T16:49:39.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:49:39.832 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-02T16:49:39.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T16:49:39.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:40.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.063+0000 7feec2200640 1 Processor -- start 2024-06-02T16:49:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.063+0000 7feec2200640 1 -- start start 2024-06-02T16:49:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.064+0000 7feec2200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feebc0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feec2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc0ae8e0 con 0x7feebc06fed0 2024-06-02T16:49:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feec2200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc0ae600 con 0x7feebc0d1b60 2024-06-02T16:49:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feec2200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feebc15d6b0 con 0x7feebc15d2d0 2024-06-02T16:49:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feebaa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feebc06fed0 0x7feebc0d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37170/0 (socket says 172.21.15.52:37170) 2024-06-02T16:49:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feebaa00640 1 -- 172.21.15.52:0/829703811 learned_addr learned my addr 172.21.15.52:0/829703811 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.065+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503602057 0 0) 0x7feea8001110 con 0x7feebc06fed0 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feebb400640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feebc0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea0003520 con 0x7feebc06fed0 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4193043195 0 0) 0x7feea0003520 con 0x7feebc06fed0 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 msgr2=0x7feebc0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feebc0ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 >> v1:172.21.15.114:6789/0 conn(0x7feebc0d1b60 legacy=0x7feebc0727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc06e740 con 0x7feebc06fed0 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7feea80018c0 con 0x7feebc06fed0 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 >> v1:172.21.15.52:6789/0 conn(0x7feebc06fed0 legacy=0x7feebc0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feea0003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004100 0x7feea0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0004e60 0x7feea000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feebc15d6b0 con 0x7feea0004e60 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feea0005590 con 0x7feea0004100 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feea000bf00 con 0x7feebc15d2d0 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.066+0000 7feebbe00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0004e60 0x7feea000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebb400640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feea0003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebaa00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004100 0x7feea0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebbe00640 1 -- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 msgr2=0x7feea0003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:40.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebbe00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feea0003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebbe00640 1 -- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004100 msgr2=0x7feea0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebbe00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004100 0x7feea0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebbe00640 1 -- 172.21.15.52:0/829703811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea0003520 con 0x7feea0004e60 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebb400640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc15d2d0 0x7feea0003a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.067+0000 7feebaa00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004100 0x7feea0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.068+0000 7feebbe00640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0004e60 0x7feea000b9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feeb4001790 tx=0x7feea0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f623dc6583fd91 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.068+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40013b0 con 0x7feea0004e60 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.068+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb40052d0 con 0x7feea0004e60 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.068+0000 7feeba000640 1 -- 172.21.15.52:0/829703811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb402aae0 con 0x7feea0004e60 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 -- 172.21.15.52:0/829703811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0004e60 msgr2=0x7feea000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 --2- 172.21.15.52:0/829703811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0004e60 0x7feea000b9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feeb4001790 tx=0x7feea0005830 comp rx=0 tx=0).stop 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feebbe00640 1 -- 172.21.15.52:0/829703811 reap_dead start 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 -- 172.21.15.52:0/829703811 shutdown_connections 2024-06-02T16:49:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 -- 172.21.15.52:0/829703811 >> 172.21.15.52:0/829703811 conn(0x7feebc06c7a0 msgr2=0x7feebc06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 -- 172.21.15.52:0/829703811 shutdown_connections 2024-06-02T16:49:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.069+0000 7feec2200640 1 -- 172.21.15.52:0/829703811 wait complete. 2024-06-02T16:49:40.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.071+0000 7feec2200640 1 Processor -- start 2024-06-02T16:49:40.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.072+0000 7feec2200640 1 -- start start 2024-06-02T16:49:40.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004e60 0x7feebc0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0b0cb0 0x7feebc14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feebc0741b0 con 0x7feebc0b14c0 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feebc06ed90 con 0x7feea0004e60 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feec2200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feebc0b1130 con 0x7feebc0b0cb0 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48174/0 (socket says 172.21.15.52:48174) 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 -- 172.21.15.52:0/2513170022 learned_addr learned my addr 172.21.15.52:0/2513170022 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebaa00640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0b0cb0 0x7feebc14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebb400640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004e60 0x7feebc0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 -- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0b0cb0 msgr2=0x7feebc14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0b0cb0 0x7feebc14b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.073+0000 7feebbe00640 1 -- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004e60 msgr2=0x7feebc0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feebbe00640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004e60 0x7feebc0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feebbe00640 1 -- 172.21.15.52:0/2513170022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc0ced50 con 0x7feebc0b14c0 2024-06-02T16:49:40.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feebbe00640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feeb40018b0 tx=0x7feeb4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4037040 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4040070 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4007a70 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc0d0380 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.074+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc14b940 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.076+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feebc069520 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.077+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeb40052d0 con 0x7feebc0b14c0 2024-06-02T16:49:40.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.078+0000 7feeb3400640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.078+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7feeb40b6ae0 con 0x7feebc0b14c0 2024-06-02T16:49:40.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.078+0000 7feebb400640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.080+0000 7feebb400640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 0x7fee9c078790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feeac009980 tx=0x7feeac00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.082+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeb4080740 con 0x7feebc0b14c0 2024-06-02T16:49:40.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.291+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feebc15ec80 con 0x7fee9c0762d0 2024-06-02T16:49:40.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.293+0000 7feeb3400640 1 -- 172.21.15.52:0/2513170022 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13493 (secure 0 0 0) 0x7feebc15ec80 con 0x7fee9c0762d0 2024-06-02T16:49:40.293 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:40.294 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:40.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.296+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 msgr2=0x7fee9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.296+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 0x7fee9c078790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feeac009980 tx=0x7feeac00b040 comp rx=0 tx=0).stop 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 msgr2=0x7feebc0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feeb40018b0 tx=0x7feeb4001120 comp rx=0 tx=0).stop 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 shutdown_connections 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feebc0b14c0 0x7feebc0b1940 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0b0cb0 0x7feebc14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 --2- 172.21.15.52:0/2513170022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea0004e60 0x7feebc0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 >> 172.21.15.52:0/2513170022 conn(0x7feebc06c7a0 msgr2=0x7feebc0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:40.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 shutdown_connections 2024-06-02T16:49:40.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.297+0000 7feec2200640 1 -- 172.21.15.52:0/2513170022 wait complete. 2024-06-02T16:49:40.317 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-06-02T16:49:40.094835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":305224,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669496,"statfs":{"total":773094113280,"available":772781563904,"internally_reserved":0,"allocated":5971968,"data_stored":3124008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":306433598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19569113,"num_objects":-1165,"num_object_clones":0,"num_object_copies":-2330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1165,"num_whiteouts":0,"num_read":-3,"num_read_kb":-1313,"num_write":-1421,"num_write_kb":-20391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.247686"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":161,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-06-02T16:49:36.897985+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:36.897985+0000","last_peered":"2024-06-02T16:49:36.897985+0000","last_clean":"2024-06-02T16:49:36.897985+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:36.897985+0000","last_undegraded":"2024-06-02T16:49:36.897985+0000","last_fullsized":"2024-06-02T16:49:36.897985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44248,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327592,"statfs":{"total":96636764160,"available":96591454208,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:40.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:40.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.535+0000 7fe2c7e00640 1 Processor -- start 2024-06-02T16:49:40.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.535+0000 7fe2c7e00640 1 -- start start 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 0x7fe2c8163b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2c80b4170 0x7fe2c80d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe2c80d21e0 0x7fe2c80b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c815fa80 con 0x7fe2c80d21e0 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c80cfaf0 con 0x7fe2c80b4170 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.536+0000 7fe2c7e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c8164050 con 0x7fe2c815f6a0 2024-06-02T16:49:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe2c80d21e0 0x7fe2c80b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe2c80d21e0 0x7fe2c80b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48184/0 (socket says 172.21.15.52:48184) 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 -- 172.21.15.52:0/1262452680 learned_addr learned my addr 172.21.15.52:0/1262452680 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c6a00640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 0x7fe2c8163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c6000640 1 --2- 172.21.15.52:0/1262452680 >> v2:172.21.15.114:3300/0 conn(0x7fe2c80b4170 0x7fe2c80d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 -- 172.21.15.52:0/1262452680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 msgr2=0x7fe2c8163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 0x7fe2c8163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 -- 172.21.15.52:0/1262452680 >> v2:172.21.15.114:3300/0 conn(0x7fe2c80b4170 msgr2=0x7fe2c80d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1262452680 >> v2:172.21.15.114:3300/0 conn(0x7fe2c80b4170 0x7fe2c80d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c7400640 1 -- 172.21.15.52:0/1262452680 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c80cfd40 con 0x7fe2c80d21e0 2024-06-02T16:49:40.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.537+0000 7fe2c6a00640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 0x7fe2c8163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:40.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.539+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80b7e50 tx=0x7fe2c002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31033ee5d420960f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.539+0000 7fe2c5600640 1 -- 172.21.15.52:0/1262452680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0036070 con 0x7fe2c80d21e0 2024-06-02T16:49:40.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.539+0000 7fe2c5600640 1 -- 172.21.15.52:0/1262452680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c0031600 con 0x7fe2c80d21e0 2024-06-02T16:49:40.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.539+0000 7fe2c5600640 1 -- 172.21.15.52:0/1262452680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00319d0 con 0x7fe2c80d21e0 2024-06-02T16:49:40.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1262452680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c80d21e0 msgr2=0x7fe2c80b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80b7e50 tx=0x7fe2c002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1262452680 shutdown_connections 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6d10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1262452680 >> v2:172.21.15.114:3300/0 conn(0x7fe2c80b4170 0x7fe2c80d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1262452680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c815f6a0 0x7fe2c8163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1262452680 >> 172.21.15.52:0/1262452680 conn(0x7fe2c80740e0 msgr2=0x7fe2c806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:40.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1262452680 shutdown_connections 2024-06-02T16:49:40.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.540+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1262452680 wait complete. 2024-06-02T16:49:40.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.542+0000 7fe2c7e00640 1 Processor -- start 2024-06-02T16:49:40.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.542+0000 7fe2c7e00640 1 -- start start 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c80b4170 0x7fe2c81568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80d05e0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80d0300 con 0x7fe2c80d21e0 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c80d08c0 con 0x7fe2c80b4170 2024-06-02T16:49:40.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48188/0 (socket says 172.21.15.52:48188) 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c7400640 1 -- 172.21.15.52:0/1334993579 learned_addr learned my addr 172.21.15.52:0/1334993579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.543+0000 7fe2c6a00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c80b4170 0x7fe2c81568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c6000640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 -- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c80b4170 msgr2=0x7fe2c81568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c80b4170 0x7fe2c81568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 -- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 msgr2=0x7fe2c80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 -- 172.21.15.52:0/1334993579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c80b6cc0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c6000640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:40.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7400640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0034040 tx=0x7fe2c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0036050 con 0x7fe2c815f6a0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c0042070 con 0x7fe2c815f6a0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0009510 con 0x7fe2c815f6a0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.544+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c80b6fa0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.545+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c80b7560 con 0x7fe2c815f6a0 2024-06-02T16:49:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.546+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c80507e0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.547+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2c0007bd0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.548+0000 7fe2bea00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:40.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.548+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fe2c00b8190 con 0x7fe2c815f6a0 2024-06-02T16:49:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.549+0000 7fe2c6a00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.550+0000 7fe2c6a00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 0x7fe2a4078790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006fd0 tx=0x7fe2b8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:40.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.553+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2c0081de0 con 0x7fe2c815f6a0 2024-06-02T16:49:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.765+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2c8163580 con 0x7fe2a40762d0 2024-06-02T16:49:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.767+0000 7fe2bea00640 1 -- 172.21.15.52:0/1334993579 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13493 (secure 0 0 0) 0x7fe2c8163580 con 0x7fe2a40762d0 2024-06-02T16:49:40.767 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.769+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 msgr2=0x7fe2a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.769+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 0x7fe2a4078790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006fd0 tx=0x7fe2b8008040 comp rx=0 tx=0).stop 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.769+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 msgr2=0x7fe2c815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.769+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0034040 tx=0x7fe2c0004a40 comp rx=0 tx=0).stop 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 shutdown_connections 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2c815f6a0 0x7fe2c815b810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2c80d21e0 0x7fe2c80b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 --2- 172.21.15.52:0/1334993579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2c80b4170 0x7fe2c81568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 >> 172.21.15.52:0/1334993579 conn(0x7fe2c80740e0 msgr2=0x7fe2c815e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 shutdown_connections 2024-06-02T16:49:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:40.770+0000 7fe2c7e00640 1 -- 172.21.15.52:0/1334993579 wait complete. 2024-06-02T16:49:40.789 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-06-02T16:49:40.094835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":305224,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669496,"statfs":{"total":773094113280,"available":772781563904,"internally_reserved":0,"allocated":5971968,"data_stored":3124008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":306433598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19569113,"num_objects":-1165,"num_object_clones":0,"num_object_copies":-2330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1165,"num_whiteouts":0,"num_read":-3,"num_read_kb":-1313,"num_write":-1421,"num_write_kb":-20391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.247686"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":161,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-06-02T16:49:36.897985+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:36.897985+0000","last_peered":"2024-06-02T16:49:36.897985+0000","last_clean":"2024-06-02T16:49:36.897985+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:36.897985+0000","last_undegraded":"2024-06-02T16:49:36.897985+0000","last_fullsized":"2024-06-02T16:49:36.897985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44248,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327592,"statfs":{"total":96636764160,"available":96591454208,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:40.790 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T16:49:40.790 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:41.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.005+0000 7f97f2600640 1 Processor -- start 2024-06-02T16:49:41.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.006+0000 7f97f2600640 1 -- start start 2024-06-02T16:49:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.007+0000 7f97f2600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97ec15ce40 0x7f97ec160a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.007+0000 7f97f2600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.007+0000 7f97f2600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ec1607e0 con 0x7f97ec06e830 2024-06-02T16:49:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.007+0000 7f97f2600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f97ec06d530 con 0x7f97ec15ce40 2024-06-02T16:49:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.007+0000 7f97f2600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec06d810 con 0x7f97ec160f60 2024-06-02T16:49:41.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.008+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.008+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:55392/0 (socket says 172.21.15.52:55392) 2024-06-02T16:49:41.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.008+0000 7f97ebe00640 1 -- 172.21.15.52:0/4150260148 learned_addr learned my addr 172.21.15.52:0/4150260148 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:41.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.008+0000 7f97f1200640 1 --2- 172.21.15.52:0/4150260148 >> v2:172.21.15.114:3300/0 conn(0x7f97ec15ce40 0x7f97ec160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.009+0000 7f97ebe00640 1 -- 172.21.15.52:0/4150260148 >> v2:172.21.15.114:3300/0 conn(0x7f97ec15ce40 msgr2=0x7f97ec160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:41.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.009+0000 7f97ebe00640 1 --2- 172.21.15.52:0/4150260148 >> v2:172.21.15.114:3300/0 conn(0x7f97ec15ce40 0x7f97ec160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.009+0000 7f97ebe00640 1 -- 172.21.15.52:0/4150260148 >> v1:172.21.15.114:6789/0 conn(0x7f97ec06e830 legacy=0x7f97ec070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.009+0000 7f97ebe00640 1 -- 172.21.15.52:0/4150260148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec06daf0 con 0x7f97ec160f60 2024-06-02T16:49:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.010+0000 7f97ebe00640 1 --2- 172.21.15.52:0/4150260148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009870 tx=0x7f97d402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65b44c86a984a4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.011+0000 7f97eb400640 1 -- 172.21.15.52:0/4150260148 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4037070 con 0x7f97ec160f60 2024-06-02T16:49:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.011+0000 7f97eb400640 1 -- 172.21.15.52:0/4150260148 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4032440 con 0x7f97ec160f60 2024-06-02T16:49:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.011+0000 7f97eb400640 1 -- 172.21.15.52:0/4150260148 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4032810 con 0x7f97ec160f60 2024-06-02T16:49:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.011+0000 7f97f2600640 1 -- 172.21.15.52:0/4150260148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 msgr2=0x7f97ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.011+0000 7f97f2600640 1 --2- 172.21.15.52:0/4150260148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009870 tx=0x7f97d402a250 comp rx=0 tx=0).stop 2024-06-02T16:49:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 -- 172.21.15.52:0/4150260148 shutdown_connections 2024-06-02T16:49:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 --2- 172.21.15.52:0/4150260148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec160f60 0x7f97ec06e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 --2- 172.21.15.52:0/4150260148 >> v2:172.21.15.114:3300/0 conn(0x7f97ec15ce40 0x7f97ec160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 -- 172.21.15.52:0/4150260148 >> 172.21.15.52:0/4150260148 conn(0x7f97ec06c7a0 msgr2=0x7f97ec0b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 -- 172.21.15.52:0/4150260148 shutdown_connections 2024-06-02T16:49:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.012+0000 7f97f2600640 1 -- 172.21.15.52:0/4150260148 wait complete. 2024-06-02T16:49:41.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.013+0000 7f97f2600640 1 Processor -- start 2024-06-02T16:49:41.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.014+0000 7f97f2600640 1 -- start start 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 0x7f97ec0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 0x7f97ec1ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec070e10 con 0x7f97ec15ce40 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec15d220 con 0x7f97ec160f60 2024-06-02T16:49:41.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f2600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec070f90 con 0x7f97ec06e830 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48192/0 (socket says 172.21.15.52:48192) 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97ebe00640 1 -- 172.21.15.52:0/2267593105 learned_addr learned my addr 172.21.15.52:0/2267593105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f1200640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 0x7f97ec0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.015+0000 7f97f1c00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 0x7f97ec1ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 -- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 msgr2=0x7f97ec0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 0x7f97ec0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 -- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 msgr2=0x7f97ec1ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 0x7f97ec1ea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 -- 172.21.15.52:0/2267593105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec1581d0 con 0x7f97ec15ce40 2024-06-02T16:49:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97f1200640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 0x7f97ec0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97f1c00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 0x7f97ec1ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97ebe00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4037040 con 0x7f97ec15ce40 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4042070 con 0x7f97ec15ce40 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4030880 con 0x7f97ec15ce40 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.016+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ec1584b0 con 0x7f97ec15ce40 2024-06-02T16:49:41.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.017+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ec158a70 con 0x7f97ec15ce40 2024-06-02T16:49:41.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.018+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ec0507e0 con 0x7f97ec15ce40 2024-06-02T16:49:41.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.019+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97d4030a20 con 0x7f97ec15ce40 2024-06-02T16:49:41.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.021+0000 7f97e8c00640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 0x7f97c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.021+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f97d40b7bf0 con 0x7f97ec15ce40 2024-06-02T16:49:41.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.021+0000 7f97f1200640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 0x7f97c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.022+0000 7f97f1200640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 0x7f97c8078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009b90 tx=0x7f97dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.025+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97d40817b0 con 0x7f97ec15ce40 2024-06-02T16:49:41.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.231+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97ec1f5490 con 0x7f97c80762d0 2024-06-02T16:49:41.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.234+0000 7f97e8c00640 1 -- 172.21.15.52:0/2267593105 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13493 (secure 0 0 0) 0x7f97dc011a60 con 0x7f97c80762d0 2024-06-02T16:49:41.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:41.234 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 msgr2=0x7f97c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 0x7f97c8078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009b90 tx=0x7f97dc008040 comp rx=0 tx=0).stop 2024-06-02T16:49:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 msgr2=0x7f97ec1ea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d40046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 shutdown_connections 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f97c80762d0 0x7f97c8078790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec160f60 0x7f97ec1ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ec15ce40 0x7f97ec1ea420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 --2- 172.21.15.52:0/2267593105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97ec06e830 0x7f97ec0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.236+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 >> 172.21.15.52:0/2267593105 conn(0x7f97ec06c7a0 msgr2=0x7f97ec162410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.237+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 shutdown_connections 2024-06-02T16:49:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.237+0000 7f97f2600640 1 -- 172.21.15.52:0/2267593105 wait complete. 2024-06-02T16:49:41.255 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-06-02T16:49:40.094835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":305224,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669496,"statfs":{"total":773094113280,"available":772781563904,"internally_reserved":0,"allocated":5971968,"data_stored":3124008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":306433598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19569113,"num_objects":-1165,"num_object_clones":0,"num_object_copies":-2330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1165,"num_whiteouts":0,"num_read":-3,"num_read_kb":-1313,"num_write":-1421,"num_write_kb":-20391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.247686"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":161,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-06-02T16:49:36.897985+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:36.897985+0000","last_peered":"2024-06-02T16:49:36.897985+0000","last_clean":"2024-06-02T16:49:36.897985+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:36.897985+0000","last_undegraded":"2024-06-02T16:49:36.897985+0000","last_fullsized":"2024-06-02T16:49:36.897985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44248,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327592,"statfs":{"total":96636764160,"available":96591454208,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:41.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T16:49:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.463+0000 7fe2f2e00640 1 Processor -- start 2024-06-02T16:49:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.463+0000 7fe2f2e00640 1 -- start start 2024-06-02T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.464+0000 7fe2f2e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2ec06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f2e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ec160c80 con 0x7fe2ec1577f0 2024-06-02T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f2e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ec160f60 con 0x7fe2ec072340 2024-06-02T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f2e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec161240 con 0x7fe2ec06e130 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f1a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe2ec1577f0 0x7fe2ec073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37182/0 (socket says 172.21.15.52:37182) 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f1a00640 1 -- 172.21.15.52:0/2644971557 learned_addr learned my addr 172.21.15.52:0/2644971557 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.465+0000 7fe2f1000640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2ec06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945486921 0 0) 0x7fe2ec160c80 con 0x7fe2ec1577f0 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d4003520 con 0x7fe2ec1577f0 2024-06-02T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1025327881 0 0) 0x7fe2d4003520 con 0x7fe2ec1577f0 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 msgr2=0x7fe2ec06e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2ec06e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 >> v1:172.21.15.114:6789/0 conn(0x7fe2ec072340 legacy=0x7fe2ec0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec161520 con 0x7fe2ec1577f0 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7fe2e00016f0 con 0x7fe2ec1577f0 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 >> v1:172.21.15.52:6789/0 conn(0x7fe2ec1577f0 legacy=0x7fe2ec073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d4003f70 0x7fe2d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2d4004d40 0x7fe2d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec161240 con 0x7fe2d4004d40 2024-06-02T16:49:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d400bad0 con 0x7fe2d4003f70 2024-06-02T16:49:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.466+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d400bcd0 con 0x7fe2ec06e130 2024-06-02T16:49:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2d4004d40 0x7fe2d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f1a00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f1000640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d4003f70 0x7fe2d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 -- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 msgr2=0x7fe2d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2ec06e130 0x7fe2d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 -- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d4003f70 msgr2=0x7fe2d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d4003f70 0x7fe2d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.467+0000 7fe2f2400640 1 -- 172.21.15.52:0/2644971557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4003520 con 0x7fe2d4004d40 2024-06-02T16:49:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.468+0000 7fe2f2400640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2d4004d40 0x7fe2d40051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4001ee0 tx=0x7fe2d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e1194c3b047e24 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4037070 con 0x7fe2d4004d40 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e4032440 con 0x7fe2d4004d40 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2ebe00640 1 -- 172.21.15.52:0/2644971557 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4001b30 con 0x7fe2d4004d40 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2e00640 1 -- 172.21.15.52:0/2644971557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2d4004d40 msgr2=0x7fe2d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/2644971557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2d4004d40 0x7fe2d40051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4001ee0 tx=0x7fe2d4005830 comp rx=0 tx=0).stop 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2400640 1 -- 172.21.15.52:0/2644971557 reap_dead start 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2e00640 1 -- 172.21.15.52:0/2644971557 shutdown_connections 2024-06-02T16:49:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2e00640 1 -- 172.21.15.52:0/2644971557 >> 172.21.15.52:0/2644971557 conn(0x7fe2ec06c380 msgr2=0x7fe2ec06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:41.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.469+0000 7fe2f2e00640 1 -- 172.21.15.52:0/2644971557 shutdown_connections 2024-06-02T16:49:41.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.470+0000 7fe2f2e00640 1 -- 172.21.15.52:0/2644971557 wait complete. 2024-06-02T16:49:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.471+0000 7fe2f2e00640 1 Processor -- start 2024-06-02T16:49:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.471+0000 7fe2f2e00640 1 -- start start 2024-06-02T16:49:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.472+0000 7fe2f2e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2d4004d40 0x7fe2ec152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.472+0000 7fe2f2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.472+0000 7fe2f2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 0x7fe2ec157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec074580 con 0x7fe2ec13dc50 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec161a40 con 0x7fe2ec15ca80 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f2e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec074180 con 0x7fe2d4004d40 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48210/0 (socket says 172.21.15.52:48210) 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 -- 172.21.15.52:0/503469904 learned_addr learned my addr 172.21.15.52:0/503469904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1a00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2d4004d40 0x7fe2ec152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f2400640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 0x7fe2ec157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 -- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2d4004d40 msgr2=0x7fe2ec152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2d4004d40 0x7fe2ec152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 -- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 msgr2=0x7fe2ec157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 0x7fe2ec157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f1000640 1 -- 172.21.15.52:0/503469904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec158b50 con 0x7fe2ec13dc50 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.473+0000 7fe2f2400640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 0x7fe2ec157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2f1000640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8011630 tx=0x7fe2d8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800f8c0 con 0x7fe2ec13dc50 2024-06-02T16:49:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d800fa60 con 0x7fe2ec13dc50 2024-06-02T16:49:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec13b160 con 0x7fe2ec13dc50 2024-06-02T16:49:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800fe30 con 0x7fe2ec13dc50 2024-06-02T16:49:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.474+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec13b720 con 0x7fe2ec13dc50 2024-06-02T16:49:41.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.475+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ec075ea0 con 0x7fe2ec13dc50 2024-06-02T16:49:41.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.477+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2d8015460 con 0x7fe2ec13dc50 2024-06-02T16:49:41.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.478+0000 7fe2e9600640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 0x7fe2cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:41.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.478+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fe2d8097bf0 con 0x7fe2ec13dc50 2024-06-02T16:49:41.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.479+0000 7fe2f1a00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 0x7fe2cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:41.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.480+0000 7fe2f1a00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 0x7fe2cc0787c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0005a50 tx=0x7fe2e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:41.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.483+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2d8019030 con 0x7fe2ec13dc50 2024-06-02T16:49:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.696+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2ec06f070 con 0x7fe2ec13dc50 2024-06-02T16:49:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.698+0000 7fe2e9600640 1 -- 172.21.15.52:0/503469904 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13022 (secure 0 0 0) 0x7fe2d8061840 con 0x7fe2ec13dc50 2024-06-02T16:49:41.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:41.698 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":51,"fsid":"39df44fa-6b94-46ae-87c4-569eff4461cc","created":"2024-06-02T16:44:46.551766+0000","modified":"2024-06-02T16:49:36.236338+0000","last_up_change":"2024-06-02T16:44:59.129497+0000","last_in_change":"2024-06-02T16:44:49.872971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T16:45:00.031102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96fa31bd-dccc-4411-8b0c-cc23aa6d8571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6820","nonce":3406856297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6826","nonce":3406856297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6831","nonce":3406856297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3406856297},{"type":"v1","addr":"172.21.15.52:6829","nonce":3406856297}]},"public_addr":"172.21.15.52:6820/3406856297","cluster_addr":"172.21.15.52:6826/3406856297","heartbeat_back_addr":"172.21.15.52:6831/3406856297","heartbeat_front_addr":"172.21.15.52:6829/3406856297","state":["exists","up"]},{"osd":1,"uuid":"23cc19f6-c092-4eff-8f8a-3685fde25ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6811","nonce":2484681760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6814","nonce":2484681760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6823","nonce":2484681760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2484681760},{"type":"v1","addr":"172.21.15.52:6818","nonce":2484681760}]},"public_addr":"172.21.15.52:6811/2484681760","cluster_addr":"172.21.15.52:6814/2484681760","heartbeat_back_addr":"172.21.15.52:6823/2484681760","heartbeat_front_addr":"172.21.15.52:6818/2484681760","state":["exists","up"]},{"osd":2,"uuid":"8e498c04-0cdc-4a4d-ae96-69bb461818a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6801","nonce":1994685313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6803","nonce":1994685313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6807","nonce":1994685313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1994685313},{"type":"v1","addr":"172.21.15.52:6805","nonce":1994685313}]},"public_addr":"172.21.15.52:6801/1994685313","cluster_addr":"172.21.15.52:6803/1994685313","heartbeat_back_addr":"172.21.15.52:6807/1994685313","heartbeat_front_addr":"172.21.15.52:6805/1994685313","state":["exists","up"]},{"osd":3,"uuid":"bbc4d9ec-d916-4055-9013-bbc9e229f5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6810","nonce":3679883112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6815","nonce":3679883112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6827","nonce":3679883112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6819","nonce":3679883112},{"type":"v1","addr":"172.21.15.52:6822","nonce":3679883112}]},"public_addr":"172.21.15.52:6810/3679883112","cluster_addr":"172.21.15.52:6815/3679883112","heartbeat_back_addr":"172.21.15.52:6827/3679883112","heartbeat_front_addr":"172.21.15.52:6822/3679883112","state":["exists","up"]},{"osd":4,"uuid":"ee74c34b-3243-4d0d-a9e4-493e8ab9252c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6801","nonce":4257704278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6803","nonce":4257704278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6807","nonce":4257704278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":4257704278},{"type":"v1","addr":"172.21.15.114:6805","nonce":4257704278}]},"public_addr":"172.21.15.114:6801/4257704278","cluster_addr":"172.21.15.114:6803/4257704278","heartbeat_back_addr":"172.21.15.114:6807/4257704278","heartbeat_front_addr":"172.21.15.114:6805/4257704278","state":["exists","up"]},{"osd":5,"uuid":"d5f17596-59e9-4922-93e2-6a4d563055a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6809","nonce":1412776483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6811","nonce":1412776483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6815","nonce":1412776483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1412776483},{"type":"v1","addr":"172.21.15.114:6813","nonce":1412776483}]},"public_addr":"172.21.15.114:6809/1412776483","cluster_addr":"172.21.15.114:6811/1412776483","heartbeat_back_addr":"172.21.15.114:6815/1412776483","heartbeat_front_addr":"172.21.15.114:6813/1412776483","state":["exists","up"]},{"osd":6,"uuid":"08595a16-fa09-4df3-8868-189aabb6bbe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6825","nonce":2173533746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6827","nonce":2173533746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6831","nonce":2173533746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":2173533746},{"type":"v1","addr":"172.21.15.114:6829","nonce":2173533746}]},"public_addr":"172.21.15.114:6825/2173533746","cluster_addr":"172.21.15.114:6827/2173533746","heartbeat_back_addr":"172.21.15.114:6831/2173533746","heartbeat_front_addr":"172.21.15.114:6829/2173533746","state":["exists","up"]},{"osd":7,"uuid":"4daf185b-aa66-49c7-9671-f24480d1d244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6817","nonce":181579839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6819","nonce":181579839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6823","nonce":181579839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":181579839},{"type":"v1","addr":"172.21.15.114:6821","nonce":181579839}]},"public_addr":"172.21.15.114:6817/181579839","cluster_addr":"172.21.15.114:6819/181579839","heartbeat_back_addr":"172.21.15.114:6823/181579839","heartbeat_front_addr":"172.21.15.114:6821/181579839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.235698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:54.275644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.223684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.196304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.243823+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.274466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.258414+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T16:44:55.134258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/2393791862":"2024-06-03T16:49:32.840171+0000","172.21.15.114:6835/2393791862":"2024-06-03T16:49:32.840171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 msgr2=0x7fe2cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 0x7fe2cc0787c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0005a50 tx=0x7fe2e0009040 comp rx=0 tx=0).stop 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 msgr2=0x7fe2ec15c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8011630 tx=0x7fe2d8011af0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 shutdown_connections 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fe2cc076300 0x7fe2cc0787c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2ec15ca80 0x7fe2ec157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec13dc50 0x7fe2ec15c540 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 --2- 172.21.15.52:0/503469904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2d4004d40 0x7fe2ec152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 >> 172.21.15.52:0/503469904 conn(0x7fe2ec06c380 msgr2=0x7fe2ec15e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 shutdown_connections 2024-06-02T16:49:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:41.701+0000 7fe2f2e00640 1 -- 172.21.15.52:0/503469904 wait complete. 2024-06-02T16:49:42.719 INFO:tasks.ceph:Scrubbing osd.0 2024-06-02T16:49:42.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.957+0000 7fae5b200640 1 Processor -- start 2024-06-02T16:49:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.958+0000 7fae5b200640 1 -- start start 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae5b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5415f3b0 0x7fae5406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae5b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae540d14c0 0x7fae540cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae5b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5406ef80 con 0x7fae5415f790 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae5b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fae5406f260 con 0x7fae540d14c0 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae5b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fae5406f540 con 0x7fae5415f3b0 2024-06-02T16:49:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae59200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae540d14c0 0x7fae540cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae59200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae540d14c0 0x7fae540cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49256/0 (socket says 172.21.15.52:49256) 2024-06-02T16:49:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae59200640 1 -- 172.21.15.52:0/2731032941 learned_addr learned my addr 172.21.15.52:0/2731032941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.960+0000 7fae53e00640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5415f3b0 0x7fae5406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.961+0000 7fae59200640 1 -- 172.21.15.52:0/2731032941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5415f3b0 msgr2=0x7fae5406fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.961+0000 7fae59200640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5415f3b0 0x7fae5406fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.961+0000 7fae59200640 1 -- 172.21.15.52:0/2731032941 >> v1:172.21.15.114:6789/0 conn(0x7fae5415f790 legacy=0x7fae540d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.961+0000 7fae59200640 1 -- 172.21.15.52:0/2731032941 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5406f820 con 0x7fae540d14c0 2024-06-02T16:49:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.962+0000 7fae59200640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae540d14c0 0x7fae540cfcc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009e50 tx=0x7fae4c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cc09dd44078569 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.962+0000 7fae53400640 1 -- 172.21.15.52:0/2731032941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c036070 con 0x7fae540d14c0 2024-06-02T16:49:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.962+0000 7fae53400640 1 -- 172.21.15.52:0/2731032941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c031600 con 0x7fae540d14c0 2024-06-02T16:49:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.962+0000 7fae53400640 1 -- 172.21.15.52:0/2731032941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0319d0 con 0x7fae540d14c0 2024-06-02T16:49:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 -- 172.21.15.52:0/2731032941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae540d14c0 msgr2=0x7fae540cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae540d14c0 0x7fae540cfcc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009e50 tx=0x7fae4c02a680 comp rx=0 tx=0).stop 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 -- 172.21.15.52:0/2731032941 shutdown_connections 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae540d14c0 0x7fae540cfcc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 --2- 172.21.15.52:0/2731032941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5415f3b0 0x7fae5406fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 -- 172.21.15.52:0/2731032941 >> 172.21.15.52:0/2731032941 conn(0x7fae5406c380 msgr2=0x7fae5406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 -- 172.21.15.52:0/2731032941 shutdown_connections 2024-06-02T16:49:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.963+0000 7fae5b200640 1 -- 172.21.15.52:0/2731032941 wait complete. 2024-06-02T16:49:42.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.965+0000 7fae5b200640 1 Processor -- start 2024-06-02T16:49:42.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.965+0000 7fae5b200640 1 -- start start 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae540d14c0 0x7fae5414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 0x7fae5415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5415f790 0x7fae5415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fae540d0590 con 0x7fae5415f3b0 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fae540d0410 con 0x7fae5415f790 2024-06-02T16:49:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.966+0000 7fae5b200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fae540d0710 con 0x7fae540d14c0 2024-06-02T16:49:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 0x7fae5415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 0x7fae5415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49262/0 (socket says 172.21.15.52:49262) 2024-06-02T16:49:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 -- 172.21.15.52:0/43630255 learned_addr learned my addr 172.21.15.52:0/43630255 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae53e00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae540d14c0 0x7fae5414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae59200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5415f790 0x7fae5415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 -- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae540d14c0 msgr2=0x7fae5414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae540d14c0 0x7fae5414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 -- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5415f790 msgr2=0x7fae5415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5415f790 0x7fae5415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae4be00640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5415fe20 con 0x7fae5415f3b0 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.967+0000 7fae53e00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae540d14c0 0x7fae5414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae4be00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 0x7fae5415a710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c3a0 tx=0x7fae3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c017070 con 0x7fae5415f3b0 2024-06-02T16:49:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c0052d0 con 0x7fae5415f3b0 2024-06-02T16:49:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c003830 con 0x7fae5415f3b0 2024-06-02T16:49:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae54160100 con 0x7fae5415f3b0 2024-06-02T16:49:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.968+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae541562c0 con 0x7fae5415f3b0 2024-06-02T16:49:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.969+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae541607c0 con 0x7fae5415f3b0 2024-06-02T16:49:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.971+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae3c01a070 con 0x7fae5415f3b0 2024-06-02T16:49:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae50c00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fae300762d0 0x7fae30078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fae3c096700 con 0x7fae5415f3b0 2024-06-02T16:49:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae50c00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fae3007c190 0x7fae3007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae3007ec60 con 0x7fae3007c190 2024-06-02T16:49:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fae3c09d050 con 0x7fae5415f3b0 2024-06-02T16:49:42.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae53e00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fae300762d0 0x7fae30078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.972+0000 7fae59200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fae3007c190 0x7fae3007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:42.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.973+0000 7fae59200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fae3007c190 0x7fae3007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:42.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.973+0000 7fae53e00640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fae300762d0 0x7fae30078790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae44006fd0 tx=0x7fae44008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:42.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.974+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== osd.0 v2:172.21.15.52:6817/3406856297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae3007ec60 con 0x7fae3007c190 2024-06-02T16:49:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.988+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 --> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae54069520 con 0x7fae3007c190 2024-06-02T16:49:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.989+0000 7fae50c00640 1 -- 172.21.15.52:0/43630255 <== osd.0 v2:172.21.15.52:6817/3406856297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae54069520 con 0x7fae3007c190 2024-06-02T16:49:42.989 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:42.989 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:42.989 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:42.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.989+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fae3007c190 msgr2=0x7fae3007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.989+0000 7fae5b200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:6817/3406856297,v1:172.21.15.52:6820/3406856297] conn(0x7fae3007c190 0x7fae3007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:42.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fae300762d0 msgr2=0x7fae30078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fae300762d0 0x7fae30078790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae44006fd0 tx=0x7fae44008040 comp rx=0 tx=0).stop 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 msgr2=0x7fae5415a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 --2- 172.21.15.52:0/43630255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae5415f3b0 0x7fae5415a710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c3a0 tx=0x7fae3c00c860 comp rx=0 tx=0).stop 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae59200640 1 -- 172.21.15.52:0/43630255 reap_dead start 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 shutdown_connections 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 >> 172.21.15.52:0/43630255 conn(0x7fae5406c380 msgr2=0x7fae54072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 shutdown_connections 2024-06-02T16:49:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:42.990+0000 7fae5b200640 1 -- 172.21.15.52:0/43630255 wait complete. 2024-06-02T16:49:43.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-02T16:49:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.226+0000 7f69f4a00640 1 Processor -- start 2024-06-02T16:49:43.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.226+0000 7f69f4a00640 1 -- start start 2024-06-02T16:49:43.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69f00b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69f4a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f006e710 con 0x7f69f01636d0 2024-06-02T16:49:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69f4a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f00ade40 con 0x7f69f00723b0 2024-06-02T16:49:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69f4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f69f00b4360 con 0x7f69f0072860 2024-06-02T16:49:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69ef400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f69f01636d0 0x7f69f006f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48600/0 (socket says 172.21.15.52:48600) 2024-06-02T16:49:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.228+0000 7f69ef400640 1 -- 172.21.15.52:0/4061171134 learned_addr learned my addr 172.21.15.52:0/4061171134 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69efe00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69f00b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702157919 0 0) 0x7f69f006e710 con 0x7f69f01636d0 2024-06-02T16:49:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d4003520 con 0x7f69f01636d0 2024-06-02T16:49:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2044799370 0 0) 0x7f69d4003520 con 0x7f69f01636d0 2024-06-02T16:49:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 msgr2=0x7f69f00b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69f00b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 >> v1:172.21.15.114:6789/0 conn(0x7f69f00723b0 legacy=0x7f69f00b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f006fea0 con 0x7f69f01636d0 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f69e00016f0 con 0x7f69f01636d0 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 >> v1:172.21.15.52:6789/0 conn(0x7f69f01636d0 legacy=0x7f69f006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69d4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d4004000 0x7f69d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69d4004d40 0x7f69d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00b4360 con 0x7f69d4004000 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f69d400bb50 con 0x7f69d4004d40 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.229+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f69d400bd50 con 0x7f69f0072860 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d4004000 0x7f69d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69ef400640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69d4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 -- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 msgr2=0x7f69d4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69f0072860 0x7f69d4003a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 -- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69d4004d40 msgr2=0x7f69d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69d4004d40 0x7f69d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.230+0000 7f69eea00640 1 -- 172.21.15.52:0/4061171134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d4003520 con 0x7f69d4004000 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.231+0000 7f69eea00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d4004000 0x7f69d4004800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f69d8001790 tx=0x7f69d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eba3f1430352f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.231+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d80013b0 con 0x7f69d4004000 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.231+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d80052d0 con 0x7f69d4004000 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.231+0000 7f69ee000640 1 -- 172.21.15.52:0/4061171134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d802aae0 con 0x7f69d4004000 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 -- 172.21.15.52:0/4061171134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d4004000 msgr2=0x7f69d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 --2- 172.21.15.52:0/4061171134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d4004000 0x7f69d4004800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f69d8001790 tx=0x7f69d4005830 comp rx=0 tx=0).stop 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69efe00640 1 -- 172.21.15.52:0/4061171134 reap_dead start 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 -- 172.21.15.52:0/4061171134 shutdown_connections 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 -- 172.21.15.52:0/4061171134 >> 172.21.15.52:0/4061171134 conn(0x7f69f00b2b60 msgr2=0x7f69f00b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 -- 172.21.15.52:0/4061171134 shutdown_connections 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.232+0000 7f69f4a00640 1 -- 172.21.15.52:0/4061171134 wait complete. 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.234+0000 7f69f4a00640 1 Processor -- start 2024-06-02T16:49:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.234+0000 7f69f4a00640 1 -- start start 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69d4004000 0x7f69f01fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f015c480 0x7f69f015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00b4b70 con 0x7f69f0147cf0 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00b4890 con 0x7f69f015c480 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69f4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f69f0072c70 con 0x7f69d4004000 2024-06-02T16:49:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69eea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69eea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49282/0 (socket says 172.21.15.52:49282) 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.235+0000 7f69eea00640 1 -- 172.21.15.52:0/322972713 learned_addr learned my addr 172.21.15.52:0/322972713 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69ef400640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69d4004000 0x7f69f01fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 -- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69d4004000 msgr2=0x7f69f01fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69d4004000 0x7f69f01fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 -- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f015c480 msgr2=0x7f69f015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f015c480 0x7f69f015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 -- 172.21.15.52:0/322972713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f015ce40 con 0x7f69f0147cf0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69eea00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69d80018b0 tx=0x7f69d8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d803f020 con 0x7f69f0147cf0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8005480 con 0x7f69f0147cf0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f015d0d0 con 0x7f69f0147cf0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.236+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8037040 con 0x7f69f0147cf0 2024-06-02T16:49:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.237+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f0163b50 con 0x7f69f0147cf0 2024-06-02T16:49:43.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.238+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f00507e0 con 0x7f69f0147cf0 2024-06-02T16:49:43.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.239+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69d8042020 con 0x7f69f0147cf0 2024-06-02T16:49:43.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.240+0000 7f69e7400640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 0x7f69cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.240+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f69d80b6de0 con 0x7f69f0147cf0 2024-06-02T16:49:43.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.241+0000 7f69ef400640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 0x7f69cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.242+0000 7f69ef400640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 0x7f69cc0787c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f69e0001050 tx=0x7f69e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.245+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69d8049030 con 0x7f69f0147cf0 2024-06-02T16:49:43.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.461+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f69f009ef60 con 0x7f69cc076300 2024-06-02T16:49:43.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.463+0000 7f69e7400640 1 -- 172.21.15.52:0/322972713 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f69f009ef60 con 0x7f69cc076300 2024-06-02T16:49:43.462 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-06-02T16:49:43.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 msgr2=0x7f69cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 0x7f69cc0787c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f69e0001050 tx=0x7f69e0009040 comp rx=0 tx=0).stop 2024-06-02T16:49:43.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 msgr2=0x7f69f0148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69d80018b0 tx=0x7f69d8001120 comp rx=0 tx=0).stop 2024-06-02T16:49:43.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 shutdown_connections 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f69cc076300 0x7f69cc0787c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f015c480 0x7f69f015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f0147cf0 0x7f69f0148170 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 --2- 172.21.15.52:0/322972713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69d4004000 0x7f69f01fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 >> 172.21.15.52:0/322972713 conn(0x7f69f00b2b60 msgr2=0x7f69f00b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 shutdown_connections 2024-06-02T16:49:43.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.465+0000 7f69f4a00640 1 -- 172.21.15.52:0/322972713 wait complete. 2024-06-02T16:49:43.484 INFO:tasks.ceph:Scrubbing osd.1 2024-06-02T16:49:43.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:43.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.695+0000 7fd90e000640 1 Processor -- start 2024-06-02T16:49:43.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.695+0000 7fd90e000640 1 -- start start 2024-06-02T16:49:43.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.697+0000 7fd90e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9080adeb0 0x7fd908073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.697+0000 7fd90e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd90815e150 0x7fd90806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.697+0000 7fd90e000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd908074650 con 0x7fd9080afce0 2024-06-02T16:49:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.697+0000 7fd90e000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd9080ae400 con 0x7fd9080adeb0 2024-06-02T16:49:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.697+0000 7fd90e000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd908072990 con 0x7fd90815e150 2024-06-02T16:49:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9080adeb0 0x7fd908073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9080adeb0 0x7fd908073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49288/0 (socket says 172.21.15.52:49288) 2024-06-02T16:49:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 -- 172.21.15.52:0/1953996050 learned_addr learned my addr 172.21.15.52:0/1953996050 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd90d600640 1 --2- 172.21.15.52:0/1953996050 >> v2:172.21.15.114:3300/0 conn(0x7fd90815e150 0x7fd90806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 -- 172.21.15.52:0/1953996050 >> v2:172.21.15.114:3300/0 conn(0x7fd90815e150 msgr2=0x7fd90806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 --2- 172.21.15.52:0/1953996050 >> v2:172.21.15.114:3300/0 conn(0x7fd90815e150 0x7fd90806e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 -- 172.21.15.52:0/1953996050 >> v1:172.21.15.114:6789/0 conn(0x7fd9080afce0 legacy=0x7fd9080b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.698+0000 7fd907e00640 1 -- 172.21.15.52:0/1953996050 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908072c70 con 0x7fd9080adeb0 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.699+0000 7fd907e00640 1 --2- 172.21.15.52:0/1953996050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080adeb0 0x7fd908073470 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b6320 tx=0x7fd8f802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dee75f5ad4b5b77 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.700+0000 7fd907400640 1 -- 172.21.15.52:0/1953996050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8037070 con 0x7fd9080adeb0 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.700+0000 7fd907400640 1 -- 172.21.15.52:0/1953996050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8032440 con 0x7fd9080adeb0 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.700+0000 7fd907400640 1 -- 172.21.15.52:0/1953996050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8032810 con 0x7fd9080adeb0 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.700+0000 7fd90e000640 1 -- 172.21.15.52:0/1953996050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080adeb0 msgr2=0x7fd908073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.700+0000 7fd90e000640 1 --2- 172.21.15.52:0/1953996050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080adeb0 0x7fd908073470 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b6320 tx=0x7fd8f802a140 comp rx=0 tx=0).stop 2024-06-02T16:49:43.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 -- 172.21.15.52:0/1953996050 shutdown_connections 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 --2- 172.21.15.52:0/1953996050 >> v2:172.21.15.114:3300/0 conn(0x7fd90815e150 0x7fd90806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 --2- 172.21.15.52:0/1953996050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080adeb0 0x7fd908073470 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 -- 172.21.15.52:0/1953996050 >> 172.21.15.52:0/1953996050 conn(0x7fd9080b2bd0 msgr2=0x7fd9080b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 -- 172.21.15.52:0/1953996050 shutdown_connections 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.701+0000 7fd90e000640 1 -- 172.21.15.52:0/1953996050 wait complete. 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.702+0000 7fd90e000640 1 Processor -- start 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.703+0000 7fd90e000640 1 -- start start 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9080adeb0 0x7fd9080b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 0x7fd90809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd90815e150 0x7fd90809d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd90815e580 con 0x7fd9080afce0 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080ae6e0 con 0x7fd9080adeb0 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90e000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd90815d3c0 con 0x7fd90815e150 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 0x7fd90809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 0x7fd90809b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49290/0 (socket says 172.21.15.52:49290) 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 -- 172.21.15.52:0/1323738371 learned_addr learned my addr 172.21.15.52:0/1323738371 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd90cc00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9080adeb0 0x7fd9080b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 -- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd90815e150 msgr2=0x7fd90809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd90815e150 0x7fd90809d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 -- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9080adeb0 msgr2=0x7fd9080b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9080adeb0 0x7fd9080b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.704+0000 7fd907e00640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908148fb0 con 0x7fd9080afce0 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd907e00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 0x7fd90809b9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009960 tx=0x7fd8f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8041020 con 0x7fd9080afce0 2024-06-02T16:49:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f80307a0 con 0x7fd9080afce0 2024-06-02T16:49:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd908148430 con 0x7fd9080afce0 2024-06-02T16:49:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8037040 con 0x7fd9080afce0 2024-06-02T16:49:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.705+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9081489f0 con 0x7fd9080afce0 2024-06-02T16:49:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.706+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9080507e0 con 0x7fd9080afce0 2024-06-02T16:49:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.708+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd8f8044020 con 0x7fd9080afce0 2024-06-02T16:49:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.709+0000 7fd904c00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8ec076300 0x7fd8ec0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.709+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fd8f80b7fa0 con 0x7fd9080afce0 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.709+0000 7fd904c00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7fd8ec07c1c0 0x7fd8ec07e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.709+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8f8032440 con 0x7fd8ec07c1c0 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.709+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd8f80b8430 con 0x7fd9080afce0 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.710+0000 7fd90d600640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7fd8ec07c1c0 0x7fd8ec07e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.710+0000 7fd90cc00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8ec076300 0x7fd8ec0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.710+0000 7fd90d600640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7fd8ec07c1c0 0x7fd8ec07e5e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.711+0000 7fd90cc00640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8ec076300 0x7fd8ec0787c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc003d90 tx=0x7fd8fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.711+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== osd.1 v2:172.21.15.52:6809/2484681760 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8f8032440 con 0x7fd8ec07c1c0 2024-06-02T16:49:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.727+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 --> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd908148bf0 con 0x7fd8ec07c1c0 2024-06-02T16:49:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.727+0000 7fd904c00640 1 -- 172.21.15.52:0/1323738371 <== osd.1 v2:172.21.15.52:6809/2484681760 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd908148bf0 con 0x7fd8ec07c1c0 2024-06-02T16:49:43.727 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:43.727 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:43.727 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7fd8ec07c1c0 msgr2=0x7fd8ec07e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:6809/2484681760,v1:172.21.15.52:6811/2484681760] conn(0x7fd8ec07c1c0 0x7fd8ec07e5e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8ec076300 msgr2=0x7fd8ec0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd8ec076300 0x7fd8ec0787c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc003d90 tx=0x7fd8fc009040 comp rx=0 tx=0).stop 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 msgr2=0x7fd90809b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 --2- 172.21.15.52:0/1323738371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9080afce0 0x7fd90809b9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009960 tx=0x7fd8f80046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90d600640 1 -- 172.21.15.52:0/1323738371 reap_dead start 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 shutdown_connections 2024-06-02T16:49:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.728+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 >> 172.21.15.52:0/1323738371 conn(0x7fd9080b2bd0 msgr2=0x7fd9080d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.729+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 shutdown_connections 2024-06-02T16:49:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.729+0000 7fd90e000640 1 -- 172.21.15.52:0/1323738371 wait complete. 2024-06-02T16:49:43.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-02T16:49:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.955+0000 7fbac5200640 1 Processor -- start 2024-06-02T16:49:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.955+0000 7fbac5200640 1 -- start start 2024-06-02T16:49:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.956+0000 7fbac5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbac00b0610 0x7fbac00adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbac5200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbac5200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac009eec0 con 0x7fbac015ec80 2024-06-02T16:49:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbac5200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbac006ebd0 con 0x7fbac00b0610 2024-06-02T16:49:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbac5200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbac015e490 con 0x7fbac015dfc0 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbac00b0610 0x7fbac00adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbac00b0610 0x7fbac00adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49296/0 (socket says 172.21.15.52:49296) 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 -- 172.21.15.52:0/1922105276 learned_addr learned my addr 172.21.15.52:0/1922105276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabe800640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 -- 172.21.15.52:0/1922105276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 msgr2=0x7fbac00ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 -- 172.21.15.52:0/1922105276 >> v1:172.21.15.114:6789/0 conn(0x7fbac015ec80 legacy=0x7fbac015d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.957+0000 7fbabde00640 1 -- 172.21.15.52:0/1922105276 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac015e770 con 0x7fbac00b0610 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbabde00640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac00b0610 0x7fbac00adeb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbac00b3c20 tx=0x7fbab002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4998d0b978fc9436 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbabca00640 1 -- 172.21.15.52:0/1922105276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0037070 con 0x7fbac00b0610 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbabca00640 1 -- 172.21.15.52:0/1922105276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab002ae50 con 0x7fbac00b0610 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbabca00640 1 -- 172.21.15.52:0/1922105276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0032660 con 0x7fbac00b0610 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbac5200640 1 -- 172.21.15.52:0/1922105276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac00b0610 msgr2=0x7fbac00adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.959+0000 7fbac5200640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac00b0610 0x7fbac00adeb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbac00b3c20 tx=0x7fbab002a100 comp rx=0 tx=0).stop 2024-06-02T16:49:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 -- 172.21.15.52:0/1922105276 shutdown_connections 2024-06-02T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 --2- 172.21.15.52:0/1922105276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac00b0610 0x7fbac00adeb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 -- 172.21.15.52:0/1922105276 >> 172.21.15.52:0/1922105276 conn(0x7fbac00b3200 msgr2=0x7fbac00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 -- 172.21.15.52:0/1922105276 shutdown_connections 2024-06-02T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.960+0000 7fbac5200640 1 -- 172.21.15.52:0/1922105276 wait complete. 2024-06-02T16:49:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.961+0000 7fbac5200640 1 Processor -- start 2024-06-02T16:49:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.962+0000 7fbac5200640 1 -- start start 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 0x7fbac0158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01600e0 con 0x7fbac015ec80 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbac006e860 con 0x7fbac00b0610 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbac5200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fbac0160260 con 0x7fbac015dfc0 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49300/0 (socket says 172.21.15.52:49300) 2024-06-02T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 -- 172.21.15.52:0/3932303132 learned_addr learned my addr 172.21.15.52:0/3932303132 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabde00640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 0x7fbac0158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabd400640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 -- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 msgr2=0x7fbac00cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 -- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 msgr2=0x7fbac0158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 0x7fbac0158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabe800640 1 -- 172.21.15.52:0/3932303132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac015a130 con 0x7fbac015ec80 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabd400640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.963+0000 7fbabde00640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 0x7fbac0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbabe800640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbab800cd70 tx=0x7fbab800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8003b90 con 0x7fbac015ec80 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab8003d30 con 0x7fbac015ec80 2024-06-02T16:49:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac0158260 con 0x7fbac015ec80 2024-06-02T16:49:43.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8004240 con 0x7fbac015ec80 2024-06-02T16:49:43.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.964+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac0158820 con 0x7fbac015ec80 2024-06-02T16:49:43.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.965+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac0158a20 con 0x7fbac015ec80 2024-06-02T16:49:43.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.966+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbab80043e0 con 0x7fbac015ec80 2024-06-02T16:49:43.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.967+0000 7fbab6000640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 0x7fbaa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:43.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.968+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fbab8097e20 con 0x7fbac015ec80 2024-06-02T16:49:43.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.968+0000 7fbabde00640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 0x7fbaa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:43.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.969+0000 7fbabde00640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 0x7fbaa0078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbab0034000 tx=0x7fbab002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:43.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:43.973+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbac0158a20 con 0x7fbac015ec80 2024-06-02T16:49:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.184+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbac0069520 con 0x7fbaa00762d0 2024-06-02T16:49:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.185+0000 7fbab6000640 1 -- 172.21.15.52:0/3932303132 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbac0069520 con 0x7fbaa00762d0 2024-06-02T16:49:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-06-02T16:49:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.188+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 msgr2=0x7fbaa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.188+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 0x7fbaa0078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbab0034000 tx=0x7fbab002e000 comp rx=0 tx=0).stop 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.188+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 msgr2=0x7fbac014d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.188+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbab800cd70 tx=0x7fbab800a660 comp rx=0 tx=0).stop 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 shutdown_connections 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fbaa00762d0 0x7fbaa0078790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac015ec80 0x7fbac014d670 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbac015dfc0 0x7fbac00cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 --2- 172.21.15.52:0/3932303132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00b0610 0x7fbac0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 >> 172.21.15.52:0/3932303132 conn(0x7fbac00b3200 msgr2=0x7fbac00ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 shutdown_connections 2024-06-02T16:49:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.189+0000 7fbac5200640 1 -- 172.21.15.52:0/3932303132 wait complete. 2024-06-02T16:49:44.210 INFO:tasks.ceph:Scrubbing osd.2 2024-06-02T16:49:44.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.426+0000 7faf78600640 1 Processor -- start 2024-06-02T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.426+0000 7faf78600640 1 -- start start 2024-06-02T16:49:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf78600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf700b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf78600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf700d0cd0 0x7faf700d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf78600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7015e9b0 con 0x7faf70161040 2024-06-02T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf78600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7faf700703c0 con 0x7faf700d0cd0 2024-06-02T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf78600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf7015de30 con 0x7faf701579b0 2024-06-02T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf76600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faf70161040 0x7faf701614d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48612/0 (socket says 172.21.15.52:48612) 2024-06-02T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.428+0000 7faf76600640 1 -- 172.21.15.52:0/1997972144 learned_addr learned my addr 172.21.15.52:0/1997972144 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf75c00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf700b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf75200640 1 --2- 172.21.15.52:0/1997972144 >> v2:172.21.15.114:3300/0 conn(0x7faf700d0cd0 0x7faf700d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274609512 0 0) 0x7faf7015e9b0 con 0x7faf70161040 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf58003520 con 0x7faf70161040 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3985425745 0 0) 0x7faf58003520 con 0x7faf70161040 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 msgr2=0x7faf700b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf700b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 >> v2:172.21.15.114:3300/0 conn(0x7faf700d0cd0 msgr2=0x7faf700d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 --2- 172.21.15.52:0/1997972144 >> v2:172.21.15.114:3300/0 conn(0x7faf700d0cd0 0x7faf700d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7015e110 con 0x7faf70161040 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7faf68001a70 con 0x7faf70161040 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 >> v1:172.21.15.52:6789/0 conn(0x7faf70161040 legacy=0x7faf701614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf58003a00 0x7faf58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.429+0000 7faf6fe00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf6fe00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf58004d40 0x7faf580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf700703c0 con 0x7faf58003a00 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf7015de30 con 0x7faf58004d40 2024-06-02T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf5800ba40 con 0x7faf701579b0 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf58003a00 0x7faf58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75200640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf76600640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf58004d40 0x7faf580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 -- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 msgr2=0x7faf58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf701579b0 0x7faf58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 -- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf58004d40 msgr2=0x7faf580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf58004d40 0x7faf580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf75c00640 1 -- 172.21.15.52:0/1997972144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf58003520 con 0x7faf58003a00 2024-06-02T16:49:44.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.430+0000 7faf76600640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf58004d40 0x7faf580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf75c00640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf58003a00 0x7faf58003e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ac0 tx=0x7faf58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5f21f217e15284 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64036070 con 0x7faf58003a00 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf64031400 con 0x7faf58003a00 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf6fe00640 1 -- 172.21.15.52:0/1997972144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64009690 con 0x7faf58003a00 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf78600640 1 -- 172.21.15.52:0/1997972144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf58003a00 msgr2=0x7faf58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf78600640 1 --2- 172.21.15.52:0/1997972144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf58003a00 0x7faf58003e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ac0 tx=0x7faf58005830 comp rx=0 tx=0).stop 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf76600640 1 -- 172.21.15.52:0/1997972144 reap_dead start 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf78600640 1 -- 172.21.15.52:0/1997972144 shutdown_connections 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.432+0000 7faf78600640 1 -- 172.21.15.52:0/1997972144 >> 172.21.15.52:0/1997972144 conn(0x7faf7006c380 msgr2=0x7faf7006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.433+0000 7faf78600640 1 -- 172.21.15.52:0/1997972144 shutdown_connections 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.433+0000 7faf78600640 1 -- 172.21.15.52:0/1997972144 wait complete. 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.434+0000 7faf78600640 1 Processor -- start 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 -- start start 2024-06-02T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf58003a00 0x7faf7015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf70148490 0x7faf700b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 0x7faf700b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf700d1690 con 0x7faf700b0cb0 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf7015e6d0 con 0x7faf70148490 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.435+0000 7faf78600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7faf70157d90 con 0x7faf58003a00 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 0x7faf700b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 0x7faf700b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49330/0 (socket says 172.21.15.52:49330) 2024-06-02T16:49:44.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 -- 172.21.15.52:0/1116292659 learned_addr learned my addr 172.21.15.52:0/1116292659 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf75c00640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf58003a00 0x7faf7015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 -- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf58003a00 msgr2=0x7faf7015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf58003a00 0x7faf7015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 -- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf70148490 msgr2=0x7faf700b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf70148490 0x7faf700b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.436+0000 7faf76600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf700b36a0 con 0x7faf700b0cb0 2024-06-02T16:49:44.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf76600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 0x7faf700b1130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf700b4160 tx=0x7faf6800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6800bdb0 con 0x7faf700b0cb0 2024-06-02T16:49:44.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf68004b60 con 0x7faf700b0cb0 2024-06-02T16:49:44.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68007110 con 0x7faf700b0cb0 2024-06-02T16:49:44.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf700b3980 con 0x7faf700b0cb0 2024-06-02T16:49:44.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.437+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf700b3300 con 0x7faf700b0cb0 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.438+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf70150030 con 0x7faf700b0cb0 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.439+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf680072b0 con 0x7faf700b0cb0 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.440+0000 7faf6d600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7faf500762d0 0x7faf50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.440+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7faf68097190 con 0x7faf700b0cb0 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.441+0000 7faf6d600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7faf5007c190 0x7faf5007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.441+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf5007ec60 con 0x7faf5007c190 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.441+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7faf6809e050 con 0x7faf700b0cb0 2024-06-02T16:49:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.441+0000 7faf75200640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7faf5007c190 0x7faf5007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.441+0000 7faf75c00640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7faf500762d0 0x7faf50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.442+0000 7faf75200640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7faf5007c190 0x7faf5007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.442+0000 7faf75c00640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7faf500762d0 0x7faf50078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf64033000 tx=0x7faf64008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.442+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== osd.2 v2:172.21.15.52:6800/1994685313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf5007ec60 con 0x7faf5007c190 2024-06-02T16:49:44.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.457+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 --> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf70069520 con 0x7faf5007c190 2024-06-02T16:49:44.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf6d600640 1 -- 172.21.15.52:0/1116292659 <== osd.2 v2:172.21.15.52:6800/1994685313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf70069520 con 0x7faf5007c190 2024-06-02T16:49:44.457 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:44.458 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:44.458 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7faf5007c190 msgr2=0x7faf5007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:6800/1994685313,v1:172.21.15.52:6801/1994685313] conn(0x7faf5007c190 0x7faf5007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7faf500762d0 msgr2=0x7faf50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7faf500762d0 0x7faf50078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf64033000 tx=0x7faf64008030 comp rx=0 tx=0).stop 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 msgr2=0x7faf700b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 --2- 172.21.15.52:0/1116292659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf700b0cb0 0x7faf700b1130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf700b4160 tx=0x7faf6800b4a0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf76600640 1 -- 172.21.15.52:0/1116292659 reap_dead start 2024-06-02T16:49:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 shutdown_connections 2024-06-02T16:49:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.458+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 >> 172.21.15.52:0/1116292659 conn(0x7faf7006c380 msgr2=0x7faf700ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.459+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 shutdown_connections 2024-06-02T16:49:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.459+0000 7faf78600640 1 -- 172.21.15.52:0/1116292659 wait complete. 2024-06-02T16:49:44.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-02T16:49:44.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.682+0000 7f4fd7200640 1 Processor -- start 2024-06-02T16:49:44.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.682+0000 7f4fd7200640 1 -- start start 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd7200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4fd8162960 0x7f4fd8163160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd80d38b0 0x7f4fd80d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd7200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd8164020 con 0x7f4fd80d2f30 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd7200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd8163a60 con 0x7f4fd8162960 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd7200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd8163d40 con 0x7f4fd80d38b0 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd5400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4fd80d2f30 0x7f4fd80cfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48622/0 (socket says 172.21.15.52:48622) 2024-06-02T16:49:44.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.684+0000 7f4fd5400640 1 -- 172.21.15.52:0/1106303224 learned_addr learned my addr 172.21.15.52:0/1106303224 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:44.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/1106303224 >> v2:172.21.15.52:3300/0 conn(0x7f4fd8162960 0x7f4fd8163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd6800640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd80d38b0 0x7f4fd80d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd4a00640 1 -- 172.21.15.52:0/1106303224 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581407965 0 0) 0x7f4fd8164020 con 0x7f4fd80d2f30 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd4a00640 1 -- 172.21.15.52:0/1106303224 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fbc003520 con 0x7f4fd80d2f30 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd5e00640 1 -- 172.21.15.52:0/1106303224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd80d38b0 msgr2=0x7f4fd80d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd80d38b0 0x7f4fd80d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd5e00640 1 -- 172.21.15.52:0/1106303224 >> v1:172.21.15.52:6789/0 conn(0x7f4fd80d2f30 legacy=0x7f4fd80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.685+0000 7f4fd5e00640 1 -- 172.21.15.52:0/1106303224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd806d900 con 0x7f4fd8162960 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.686+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd8162960 0x7f4fd8163160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86cd7d281e9e4b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd4a00640 1 -- 172.21.15.52:0/1106303224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037070 con 0x7f4fd8162960 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd4a00640 1 -- 172.21.15.52:0/1106303224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8032440 con 0x7f4fd8162960 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd4a00640 1 -- 172.21.15.52:0/1106303224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80327f0 con 0x7f4fd8162960 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 -- 172.21.15.52:0/1106303224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd8162960 msgr2=0x7f4fd8163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd8162960 0x7f4fd8163160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a180 comp rx=0 tx=0).stop 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 -- 172.21.15.52:0/1106303224 shutdown_connections 2024-06-02T16:49:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd80d38b0 0x7f4fd80d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 --2- 172.21.15.52:0/1106303224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd8162960 0x7f4fd8163160 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 -- 172.21.15.52:0/1106303224 >> 172.21.15.52:0/1106303224 conn(0x7f4fd808cf50 msgr2=0x7f4fd809e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:44.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 -- 172.21.15.52:0/1106303224 shutdown_connections 2024-06-02T16:49:44.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.687+0000 7f4fd7200640 1 -- 172.21.15.52:0/1106303224 wait complete. 2024-06-02T16:49:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.689+0000 7f4fd7200640 1 Processor -- start 2024-06-02T16:49:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.689+0000 7f4fd7200640 1 -- start start 2024-06-02T16:49:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd80d2f30 0x7f4fd80a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd8162960 0x7f4fd8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8163820 con 0x7f4fd80d38b0 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd81636a0 con 0x7f4fd80d2f30 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.690+0000 7f4fd7200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd8162d40 con 0x7f4fd8162960 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49344/0 (socket says 172.21.15.52:49344) 2024-06-02T16:49:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 -- 172.21.15.52:0/939415673 learned_addr learned my addr 172.21.15.52:0/939415673 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd6800640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd8162960 0x7f4fd8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 -- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd8162960 msgr2=0x7f4fd8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd8162960 0x7f4fd8151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd80d2f30 0x7f4fd80a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 -- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd80d2f30 msgr2=0x7f4fd80a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd80d2f30 0x7f4fd80a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 -- 172.21.15.52:0/939415673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd81f8de0 con 0x7f4fd80d38b0 2024-06-02T16:49:44.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.691+0000 7f4fd5400640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c730 tx=0x7f4fc400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.692+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4017070 con 0x7f4fd80d38b0 2024-06-02T16:49:44.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.692+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc4007270 con 0x7f4fd80d38b0 2024-06-02T16:49:44.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.692+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4007620 con 0x7f4fd80d38b0 2024-06-02T16:49:44.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.692+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd81f90c0 con 0x7f4fd80d38b0 2024-06-02T16:49:44.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.692+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd809f240 con 0x7f4fd80d38b0 2024-06-02T16:49:44.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.693+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd80507e0 con 0x7f4fd80d38b0 2024-06-02T16:49:44.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.694+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fc401a070 con 0x7f4fd80d38b0 2024-06-02T16:49:44.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.695+0000 7f4fce000640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 0x7f4fb8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:44.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.695+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f4fc4096610 con 0x7f4fd80d38b0 2024-06-02T16:49:44.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.696+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 0x7f4fb8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:44.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.697+0000 7f4fd5e00640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 0x7f4fb8078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:44.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.700+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fc405fc10 con 0x7f4fd80d38b0 2024-06-02T16:49:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.914+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4fd81f95e0 con 0x7f4fb80762d0 2024-06-02T16:49:44.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.916+0000 7f4fce000640 1 -- 172.21.15.52:0/939415673 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4fc8032540 con 0x7f4fb80762d0 2024-06-02T16:49:44.915 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-06-02T16:49:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.918+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 msgr2=0x7f4fb8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.918+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 0x7f4fb8078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).stop 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.918+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 msgr2=0x7f4fd81f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.918+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c730 tx=0x7f4fc400cbf0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 shutdown_connections 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f4fb80762d0 0x7f4fb8078790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4fd8162960 0x7f4fd8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fd80d38b0 0x7f4fd81f8670 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 --2- 172.21.15.52:0/939415673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd80d2f30 0x7f4fd80a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 >> 172.21.15.52:0/939415673 conn(0x7f4fd808cf50 msgr2=0x7f4fd80b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 shutdown_connections 2024-06-02T16:49:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:44.919+0000 7f4fd7200640 1 -- 172.21.15.52:0/939415673 wait complete. 2024-06-02T16:49:44.938 INFO:tasks.ceph:Scrubbing osd.3 2024-06-02T16:49:44.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.157+0000 7fdb42800640 1 Processor -- start 2024-06-02T16:49:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.157+0000 7fdb42800640 1 -- start start 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb42800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3c1579b0 0x7fdb3c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb42800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb42800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3c15e9b0 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb42800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb3c15de30 con 0x7fdb3c1579b0 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb42800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3c15e110 con 0x7fdb3c06f3b0 2024-06-02T16:49:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.159+0000 7fdb3b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3c1579b0 0x7fdb3c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3c1579b0 0x7fdb3c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49358/0 (socket says 172.21.15.52:49358) 2024-06-02T16:49:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 -- 172.21.15.52:0/1544561133 learned_addr learned my addr 172.21.15.52:0/1544561133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 -- 172.21.15.52:0/1544561133 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 msgr2=0x7fdb3c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 --2- 172.21.15.52:0/1544561133 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 -- 172.21.15.52:0/1544561133 >> v1:172.21.15.114:6789/0 conn(0x7fdb3c0d0cd0 legacy=0x7fdb3c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.160+0000 7fdb3b400640 1 -- 172.21.15.52:0/1544561133 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c15e3f0 con 0x7fdb3c1579b0 2024-06-02T16:49:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.162+0000 7fdb3b400640 1 --2- 172.21.15.52:0/1544561133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c0b0630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0cec00 tx=0x7fdb2c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e743b4568103f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.162+0000 7fdb3a000640 1 -- 172.21.15.52:0/1544561133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c037070 con 0x7fdb3c1579b0 2024-06-02T16:49:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.162+0000 7fdb3a000640 1 -- 172.21.15.52:0/1544561133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c02ae50 con 0x7fdb3c1579b0 2024-06-02T16:49:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.162+0000 7fdb3a000640 1 -- 172.21.15.52:0/1544561133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c032660 con 0x7fdb3c1579b0 2024-06-02T16:49:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 -- 172.21.15.52:0/1544561133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c1579b0 msgr2=0x7fdb3c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 --2- 172.21.15.52:0/1544561133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c0b0630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0cec00 tx=0x7fdb2c02a100 comp rx=0 tx=0).stop 2024-06-02T16:49:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 -- 172.21.15.52:0/1544561133 shutdown_connections 2024-06-02T16:49:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 --2- 172.21.15.52:0/1544561133 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 --2- 172.21.15.52:0/1544561133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c0b0630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 -- 172.21.15.52:0/1544561133 >> 172.21.15.52:0/1544561133 conn(0x7fdb3c06c380 msgr2=0x7fdb3c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.163+0000 7fdb42800640 1 -- 172.21.15.52:0/1544561133 shutdown_connections 2024-06-02T16:49:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.164+0000 7fdb42800640 1 -- 172.21.15.52:0/1544561133 wait complete. 2024-06-02T16:49:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.165+0000 7fdb42800640 1 Processor -- start 2024-06-02T16:49:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.165+0000 7fdb42800640 1 -- start start 2024-06-02T16:49:45.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 0x7fdb3c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c0b4c10 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c157d90 con 0x7fdb3c1579b0 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.166+0000 7fdb42800640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3c0b4d90 con 0x7fdb3c06f3b0 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 0x7fdb3c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 0x7fdb3c14b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49370/0 (socket says 172.21.15.52:49370) 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 -- 172.21.15.52:0/84138256 learned_addr learned my addr 172.21.15.52:0/84138256 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3be00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3b400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 -- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 msgr2=0x7fdb3c0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 -- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c1579b0 msgr2=0x7fdb3c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3aa00640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c0b3b80 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3be00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c1579b0 0x7fdb3c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.167+0000 7fdb3b400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c06f3b0 0x7fdb3c0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 0x7fdb3c14b3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c460 tx=0x7fdb2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28016020 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb28012870 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28012c60 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3c1f8ae0 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.168+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3c1f90a0 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.169+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb3c069520 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.171+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb28019020 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb33400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdb1c0762d0 0x7fdb1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fdb280970d0 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb33400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fdb1c07c190 0x7fdb1c07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb1c07ec60 con 0x7fdb1c07c190 2024-06-02T16:49:45.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fdb2809e050 con 0x7fdb3c0d0cd0 2024-06-02T16:49:45.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb3b400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdb1c0762d0 0x7fdb1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.172+0000 7fdb3be00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fdb1c07c190 0x7fdb1c07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.173+0000 7fdb3be00640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fdb1c07c190 0x7fdb1c07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.173+0000 7fdb3b400640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdb1c0762d0 0x7fdb1c078790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.174+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== osd.3 v2:172.21.15.52:6808/3679883112 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb1c07ec60 con 0x7fdb1c07c190 2024-06-02T16:49:45.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.189+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 --> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdb3c06cae0 con 0x7fdb1c07c190 2024-06-02T16:49:45.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb33400640 1 -- 172.21.15.52:0/84138256 <== osd.3 v2:172.21.15.52:6808/3679883112 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdb3c06cae0 con 0x7fdb1c07c190 2024-06-02T16:49:45.189 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:45.189 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:45.190 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fdb1c07c190 msgr2=0x7fdb1c07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:6808/3679883112,v1:172.21.15.52:6810/3679883112] conn(0x7fdb1c07c190 0x7fdb1c07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdb1c0762d0 msgr2=0x7fdb1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdb1c0762d0 0x7fdb1c078790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02e000 comp rx=0 tx=0).stop 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 msgr2=0x7fdb3c14b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb42800640 1 --2- 172.21.15.52:0/84138256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3c0d0cd0 0x7fdb3c14b3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c460 tx=0x7fdb2800c920 comp rx=0 tx=0).stop 2024-06-02T16:49:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.190+0000 7fdb3be00640 1 -- 172.21.15.52:0/84138256 reap_dead start 2024-06-02T16:49:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.191+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 shutdown_connections 2024-06-02T16:49:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.191+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 >> 172.21.15.52:0/84138256 conn(0x7fdb3c06c380 msgr2=0x7fdb3c06f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.191+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 shutdown_connections 2024-06-02T16:49:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.191+0000 7fdb42800640 1 -- 172.21.15.52:0/84138256 wait complete. 2024-06-02T16:49:45.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-02T16:49:45.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.424+0000 7fead1000640 1 Processor -- start 2024-06-02T16:49:45.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.424+0000 7fead1000640 1 -- start start 2024-06-02T16:49:45.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.425+0000 7fead1000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feacc0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7fead1000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feacc09eec0 con 0x7feacc15dfc0 2024-06-02T16:49:45.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7fead1000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feacc15e490 con 0x7feacc15ec80 2024-06-02T16:49:45.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7fead1000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feacc06ebd0 con 0x7feacc0b0610 2024-06-02T16:49:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7feaca800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feacc15dfc0 0x7feacc1600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48630/0 (socket says 172.21.15.52:48630) 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7feaca800640 1 -- 172.21.15.52:0/472976321 learned_addr learned my addr 172.21.15.52:0/472976321 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.426+0000 7feac9e00640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feacc0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968370248 0 0) 0x7feacc09eec0 con 0x7feacc15dfc0 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab0003520 con 0x7feacc15dfc0 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2520513112 0 0) 0x7feab0003520 con 0x7feacc15dfc0 2024-06-02T16:49:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 msgr2=0x7feacc0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feacc0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 >> v1:172.21.15.114:6789/0 conn(0x7feacc15ec80 legacy=0x7feacc15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feacc15e770 con 0x7feacc15dfc0 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7feac4001a70 con 0x7feacc15dfc0 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 >> v1:172.21.15.52:6789/0 conn(0x7feacc15dfc0 legacy=0x7feacc1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab0003a80 0x7feab0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feab00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feacc06ebd0 con 0x7feab0004d40 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feab000bbd0 con 0x7feab0003a80 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.427+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feab000bdd0 con 0x7feacc0b0610 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feab00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feac9e00640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab0003a80 0x7feab0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feac3e00640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 -- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 msgr2=0x7feab0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feab0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 -- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab0003a80 msgr2=0x7feab0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab0003a80 0x7feab0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feaca800640 1 -- 172.21.15.52:0/472976321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab0003520 con 0x7feab0004d40 2024-06-02T16:49:45.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.428+0000 7feac3e00640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b0610 0x7feab0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.429+0000 7feaca800640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feab00051a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feacc0b65c0 tx=0x7feab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb1388119276bc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.429+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac400a3f0 con 0x7feab0004d40 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac402f070 con 0x7feab0004d40 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7feac9400640 1 -- 172.21.15.52:0/472976321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac402bb40 con 0x7feab0004d40 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 -- 172.21.15.52:0/472976321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 msgr2=0x7feab00051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 --2- 172.21.15.52:0/472976321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feab00051a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feacc0b65c0 tx=0x7feab0005830 comp rx=0 tx=0).stop 2024-06-02T16:49:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7feaca800640 1 -- 172.21.15.52:0/472976321 reap_dead start 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 -- 172.21.15.52:0/472976321 shutdown_connections 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 -- 172.21.15.52:0/472976321 >> 172.21.15.52:0/472976321 conn(0x7feacc0b3200 msgr2=0x7feacc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 -- 172.21.15.52:0/472976321 shutdown_connections 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.430+0000 7fead1000640 1 -- 172.21.15.52:0/472976321 wait complete. 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.432+0000 7fead1000640 1 Processor -- start 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.432+0000 7fead1000640 1 -- start start 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 0x7feacc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feacc0b2030 0x7feacc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feacc1607f0 con 0x7feab0004d40 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feacc06e860 con 0x7feacc0b2030 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7fead1000640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7feacc160970 con 0x7feacc0b1670 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.433+0000 7feac9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49392/0 (socket says 172.21.15.52:49392) 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 -- 172.21.15.52:0/1281955989 learned_addr learned my addr 172.21.15.52:0/1281955989 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac3e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 0x7feacc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 -- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 msgr2=0x7feacc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 0x7feacc0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 -- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feacc0b2030 msgr2=0x7feacc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feacc0b2030 0x7feacc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 -- 172.21.15.52:0/1281955989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feacc09e560 con 0x7feab0004d40 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac3e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 0x7feacc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.434+0000 7feac9e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feabc011630 tx=0x7feabc011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.435+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc015870 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.435+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc015a10 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.435+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc015dc0 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.435+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feacc155c80 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.435+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feacc0b0e70 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.436+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feacc069520 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.437+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feabc013430 con 0x7feab0004d40 2024-06-02T16:49:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.438+0000 7feac2000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 0x7feaa8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.438+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7feabc097770 con 0x7feab0004d40 2024-06-02T16:49:45.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.439+0000 7feac3e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 0x7feaa8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.440+0000 7feac3e00640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 0x7feaa8078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feacc15b390 tx=0x7feab4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.443+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feabc019030 con 0x7feab0004d40 2024-06-02T16:49:45.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.656+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7feacc0b3fd0 con 0x7feaa80762d0 2024-06-02T16:49:45.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.657+0000 7feac2000640 1 -- 172.21.15.52:0/1281955989 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feacc0b3fd0 con 0x7feaa80762d0 2024-06-02T16:49:45.657 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-06-02T16:49:45.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.660+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 msgr2=0x7feaa8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.660+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 0x7feaa8078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feacc15b390 tx=0x7feab4009040 comp rx=0 tx=0).stop 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.660+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 msgr2=0x7feacc1619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.660+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feabc011630 tx=0x7feabc011af0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 shutdown_connections 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7feaa80762d0 0x7feaa8078790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feacc0b2030 0x7feacc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feacc0b1670 0x7feacc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 --2- 172.21.15.52:0/1281955989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feab0004d40 0x7feacc1619b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 >> 172.21.15.52:0/1281955989 conn(0x7feacc0b3200 msgr2=0x7feacc06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 shutdown_connections 2024-06-02T16:49:45.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.661+0000 7fead1000640 1 -- 172.21.15.52:0/1281955989 wait complete. 2024-06-02T16:49:45.680 INFO:tasks.ceph:Scrubbing osd.4 2024-06-02T16:49:45.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:45.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.886+0000 7fdc1a600640 1 Processor -- start 2024-06-02T16:49:45.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.886+0000 7fdc1a600640 1 -- start start 2024-06-02T16:49:45.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc1a600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc14073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc1a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc1415e150 0x7fdc1406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc1a600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc14074650 con 0x7fdc140adeb0 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc1a600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1415e600 con 0x7fdc1415e150 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc1a600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdc140ae400 con 0x7fdc140afce0 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc19c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc1415e150 0x7fdc1406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc19c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc1415e150 0x7fdc1406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49400/0 (socket says 172.21.15.52:49400) 2024-06-02T16:49:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc19c00640 1 -- 172.21.15.52:0/2803597237 learned_addr learned my addr 172.21.15.52:0/2803597237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:45.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.888+0000 7fdc19200640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc14073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.889+0000 7fdc19c00640 1 -- 172.21.15.52:0/2803597237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 msgr2=0x7fdc14073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.889+0000 7fdc19c00640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc14073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.889+0000 7fdc19c00640 1 -- 172.21.15.52:0/2803597237 >> v1:172.21.15.114:6789/0 conn(0x7fdc140adeb0 legacy=0x7fdc140b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:45.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.889+0000 7fdc19c00640 1 -- 172.21.15.52:0/2803597237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc14072990 con 0x7fdc1415e150 2024-06-02T16:49:45.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.890+0000 7fdc19c00640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1406e350 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009870 tx=0x7fdc0c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b51c152bb90bf43 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.890+0000 7fdc13400640 1 -- 172.21.15.52:0/2803597237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c037070 con 0x7fdc1415e150 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.890+0000 7fdc13400640 1 -- 172.21.15.52:0/2803597237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0c032440 con 0x7fdc1415e150 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.890+0000 7fdc13400640 1 -- 172.21.15.52:0/2803597237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c032810 con 0x7fdc1415e150 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 -- 172.21.15.52:0/2803597237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 msgr2=0x7fdc1406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1406e350 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009870 tx=0x7fdc0c02a130 comp rx=0 tx=0).stop 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 -- 172.21.15.52:0/2803597237 shutdown_connections 2024-06-02T16:49:45.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1406e350 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 --2- 172.21.15.52:0/2803597237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc14073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 -- 172.21.15.52:0/2803597237 >> 172.21.15.52:0/2803597237 conn(0x7fdc140b2bd0 msgr2=0x7fdc140b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 -- 172.21.15.52:0/2803597237 shutdown_connections 2024-06-02T16:49:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.891+0000 7fdc1a600640 1 -- 172.21.15.52:0/2803597237 wait complete. 2024-06-02T16:49:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.893+0000 7fdc1a600640 1 Processor -- start 2024-06-02T16:49:45.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.893+0000 7fdc1a600640 1 -- start start 2024-06-02T16:49:45.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc140adeb0 0x7fdc140b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc141517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1409d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc140ae6e0 con 0x7fdc1415e150 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14072f50 con 0x7fdc140adeb0 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.894+0000 7fdc1a600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1415d3c0 con 0x7fdc140afce0 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1409d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1409d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49412/0 (socket says 172.21.15.52:49412) 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 -- 172.21.15.52:0/3320157128 learned_addr learned my addr 172.21.15.52:0/3320157128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:45.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc13e00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc141517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 -- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 msgr2=0x7fdc141517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc141517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 -- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc140adeb0 msgr2=0x7fdc140b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc140adeb0 0x7fdc140b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc19c00640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc140b4bd0 con 0x7fdc1415e150 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.895+0000 7fdc13e00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc140afce0 0x7fdc141517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:45.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc19c00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1409d5c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c02a170 tx=0x7fdc0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c041070 con 0x7fdc1415e150 2024-06-02T16:49:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0c03c870 con 0x7fdc1415e150 2024-06-02T16:49:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c037040 con 0x7fdc1415e150 2024-06-02T16:49:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1409bb60 con 0x7fdc1415e150 2024-06-02T16:49:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.896+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1409c120 con 0x7fdc1415e150 2024-06-02T16:49:45.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.897+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc140700f0 con 0x7fdc1415e150 2024-06-02T16:49:45.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.899+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc0c044070 con 0x7fdc1415e150 2024-06-02T16:49:45.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.899+0000 7fdc10c00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdbf00762d0 0x7fdbf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fdc0c0b7c40 con 0x7fdc1415e150 2024-06-02T16:49:45.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc10c00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7fdbf007c190 0x7fdbf007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:45.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc0c048e50 con 0x7fdbf007c190 2024-06-02T16:49:45.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fdc0c0ba340 con 0x7fdc1415e150 2024-06-02T16:49:45.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc19200640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdbf00762d0 0x7fdbf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.900+0000 7fdc13e00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7fdbf007c190 0x7fdbf007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:45.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.901+0000 7fdc19200640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdbf00762d0 0x7fdbf0078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdc040070b0 tx=0x7fdc04007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.901+0000 7fdc13e00640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7fdbf007c190 0x7fdbf007e5b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:45.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.904+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== osd.4 v2:172.21.15.114:6800/4257704278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc0c048e50 con 0x7fdbf007c190 2024-06-02T16:49:45.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.918+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 --> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc140507e0 con 0x7fdbf007c190 2024-06-02T16:49:45.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.919+0000 7fdc10c00640 1 -- 172.21.15.52:0/3320157128 <== osd.4 v2:172.21.15.114:6800/4257704278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc140507e0 con 0x7fdbf007c190 2024-06-02T16:49:45.919 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:45.920 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:45.920 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7fdbf007c190 msgr2=0x7fdbf007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6800/4257704278,v1:172.21.15.114:6801/4257704278] conn(0x7fdbf007c190 0x7fdbf007e5b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdbf00762d0 msgr2=0x7fdbf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fdbf00762d0 0x7fdbf0078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdc040070b0 tx=0x7fdc04007040 comp rx=0 tx=0).stop 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 msgr2=0x7fdc1409d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc1a600640 1 --2- 172.21.15.52:0/3320157128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc1415e150 0x7fdc1409d5c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c02a170 tx=0x7fdc0c0046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.920+0000 7fdc19c00640 1 -- 172.21.15.52:0/3320157128 reap_dead start 2024-06-02T16:49:45.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.921+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 shutdown_connections 2024-06-02T16:49:45.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.921+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 >> 172.21.15.52:0/3320157128 conn(0x7fdc140b2bd0 msgr2=0x7fdc1415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:45.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.921+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 shutdown_connections 2024-06-02T16:49:45.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:45.921+0000 7fdc1a600640 1 -- 172.21.15.52:0/3320157128 wait complete. 2024-06-02T16:49:45.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-02T16:49:46.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.150+0000 7f7c3de00640 1 Processor -- start 2024-06-02T16:49:46.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.150+0000 7f7c3de00640 1 -- start start 2024-06-02T16:49:46.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c38074230 0x7f7c380ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3de00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c38070650 con 0x7f7c3815d330 2024-06-02T16:49:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3de00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7c38072450 con 0x7f7c38074230 2024-06-02T16:49:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3de00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7c38072730 con 0x7f7c380734f0 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.152+0000 7f7c3d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.52:33818/0 (socket says 172.21.15.52:33818) 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 -- 172.21.15.52:0/2911846916 learned_addr learned my addr 172.21.15.52:0/2911846916 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c37e00640 1 --2- 172.21.15.52:0/2911846916 >> v2:172.21.15.114:3300/0 conn(0x7f7c38074230 0x7f7c380ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c37400640 1 -- 172.21.15.52:0/2911846916 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879844036 0 0) 0x7f7c38070650 con 0x7f7c3815d330 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 -- 172.21.15.52:0/2911846916 >> v2:172.21.15.114:3300/0 conn(0x7f7c38074230 msgr2=0x7f7c380ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 --2- 172.21.15.52:0/2911846916 >> v2:172.21.15.114:3300/0 conn(0x7f7c38074230 0x7f7c380ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 -- 172.21.15.52:0/2911846916 >> v1:172.21.15.114:6789/0 conn(0x7f7c3815d330 legacy=0x7f7c38073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.153+0000 7f7c3d400640 1 -- 172.21.15.52:0/2911846916 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c38072a10 con 0x7f7c380734f0 2024-06-02T16:49:46.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.155+0000 7f7c3d400640 1 --2- 172.21.15.52:0/2911846916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009e50 tx=0x7f7c3002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97fa20b66d0d3fb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.155+0000 7f7c37400640 1 -- 172.21.15.52:0/2911846916 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30036070 con 0x7f7c380734f0 2024-06-02T16:49:46.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.155+0000 7f7c37400640 1 -- 172.21.15.52:0/2911846916 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c30031600 con 0x7f7c380734f0 2024-06-02T16:49:46.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.155+0000 7f7c37400640 1 -- 172.21.15.52:0/2911846916 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c300319d0 con 0x7f7c380734f0 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 -- 172.21.15.52:0/2911846916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 msgr2=0x7f7c380ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2911846916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009e50 tx=0x7f7c3002a710 comp rx=0 tx=0).stop 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 -- 172.21.15.52:0/2911846916 shutdown_connections 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2911846916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c380734f0 0x7f7c380ae380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2911846916 >> v2:172.21.15.114:3300/0 conn(0x7f7c38074230 0x7f7c380ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 -- 172.21.15.52:0/2911846916 >> 172.21.15.52:0/2911846916 conn(0x7f7c380b2b60 msgr2=0x7f7c380b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 -- 172.21.15.52:0/2911846916 shutdown_connections 2024-06-02T16:49:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.156+0000 7f7c3de00640 1 -- 172.21.15.52:0/2911846916 wait complete. 2024-06-02T16:49:46.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.159+0000 7f7c3de00640 1 Processor -- start 2024-06-02T16:49:46.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.159+0000 7f7c3de00640 1 -- start start 2024-06-02T16:49:46.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c380734f0 0x7f7c38158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c3815d330 0x7f7c381fa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3806e410 con 0x7f7c38074230 2024-06-02T16:49:46.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38072fd0 con 0x7f7c380734f0 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.160+0000 7f7c3de00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3806e590 con 0x7f7c3815d330 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49424/0 (socket says 172.21.15.52:49424) 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 -- 172.21.15.52:0/2604803617 learned_addr learned my addr 172.21.15.52:0/2604803617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c3ca00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c380734f0 0x7f7c38158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c3d400640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c3815d330 0x7f7c381fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 -- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c3815d330 msgr2=0x7f7c381fa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c3815d330 0x7f7c381fa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 -- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c380734f0 msgr2=0x7f7c38158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c380734f0 0x7f7c38158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.161+0000 7f7c37e00640 1 -- 172.21.15.52:0/2604803617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c381f94e0 con 0x7f7c38074230 2024-06-02T16:49:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c37e00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800e9e0 tx=0x7f7c2800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28017070 con 0x7f7c38074230 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2800c9d0 con 0x7f7c38074230 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800cdc0 con 0x7f7c38074230 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c381f97b0 con 0x7f7c38074230 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.162+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c381f9d70 con 0x7f7c38074230 2024-06-02T16:49:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.163+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c380507e0 con 0x7f7c38074230 2024-06-02T16:49:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.165+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c2801a070 con 0x7f7c38074230 2024-06-02T16:49:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.166+0000 7f7c34c00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 0x7f7c1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.166+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f7c280972e0 con 0x7f7c38074230 2024-06-02T16:49:46.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.166+0000 7f7c3ca00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 0x7f7c1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.167+0000 7f7c3ca00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 0x7f7c1c0787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000f60 tx=0x7f7c2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.170+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7c28060f30 con 0x7f7c38074230 2024-06-02T16:49:46.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.384+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7c381f9fb0 con 0x7f7c1c076300 2024-06-02T16:49:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.385+0000 7f7c34c00640 1 -- 172.21.15.52:0/2604803617 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7c2c001c30 con 0x7f7c1c076300 2024-06-02T16:49:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2024-06-02T16:49:46.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 msgr2=0x7f7c1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 0x7f7c1c0787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000f60 tx=0x7f7c2c009040 comp rx=0 tx=0).stop 2024-06-02T16:49:46.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 msgr2=0x7f7c381f8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800e9e0 tx=0x7f7c2800eea0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 shutdown_connections 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f7c1c076300 0x7f7c1c0787c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c3815d330 0x7f7c381fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c38074230 0x7f7c381f8fa0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 --2- 172.21.15.52:0/2604803617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c380734f0 0x7f7c38158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.388+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 >> 172.21.15.52:0/2604803617 conn(0x7f7c380b2b60 msgr2=0x7f7c380b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.389+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 shutdown_connections 2024-06-02T16:49:46.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.389+0000 7f7c3de00640 1 -- 172.21.15.52:0/2604803617 wait complete. 2024-06-02T16:49:46.407 INFO:tasks.ceph:Scrubbing osd.5 2024-06-02T16:49:46.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.617+0000 7f3419400640 1 Processor -- start 2024-06-02T16:49:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.617+0000 7f3419400640 1 -- start start 2024-06-02T16:49:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.619+0000 7f3419400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f341406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.619+0000 7f3419400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34140d1e80 0x7f34140d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.619+0000 7f3419400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34140d1910 con 0x7f341415f780 2024-06-02T16:49:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.619+0000 7f3419400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f341415fb60 con 0x7f34140d1e80 2024-06-02T16:49:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.619+0000 7f3419400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f34140d1350 con 0x7f34140d0d70 2024-06-02T16:49:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.620+0000 7f3411e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f341406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.620+0000 7f3413200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34140d1e80 0x7f34140d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.620+0000 7f3412800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f341415f780 0x7f34140d5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.52:58672/0 (socket says 172.21.15.52:58672) 2024-06-02T16:49:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.620+0000 7f3412800640 1 -- 172.21.15.52:0/1977537325 learned_addr learned my addr 172.21.15.52:0/1977537325 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.621+0000 7f3413200640 1 -- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 msgr2=0x7f341406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.621+0000 7f3413200640 1 --2- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f341406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.621+0000 7f3413200640 1 -- 172.21.15.52:0/1977537325 >> v1:172.21.15.114:6789/0 conn(0x7f341415f780 legacy=0x7f34140d5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.621+0000 7f3413200640 1 -- 172.21.15.52:0/1977537325 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34140d1630 con 0x7f34140d1e80 2024-06-02T16:49:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.622+0000 7f3413200640 1 --2- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34140d1e80 0x7f34140d2310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f340c009d90 tx=0x7f340c02a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca202863e1fa38ba server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.623+0000 7f3411400640 1 -- 172.21.15.52:0/1977537325 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007740 con 0x7f34140d1e80 2024-06-02T16:49:46.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.623+0000 7f3411400640 1 -- 172.21.15.52:0/1977537325 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340c0078e0 con 0x7f34140d1e80 2024-06-02T16:49:46.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.623+0000 7f3411400640 1 -- 172.21.15.52:0/1977537325 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007cb0 con 0x7f34140d1e80 2024-06-02T16:49:46.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.623+0000 7f3419400640 1 -- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34140d1e80 msgr2=0x7f34140d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.623+0000 7f3419400640 1 --2- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34140d1e80 0x7f34140d2310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f340c009d90 tx=0x7f340c02a530 comp rx=0 tx=0).stop 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 -- 172.21.15.52:0/1977537325 shutdown_connections 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 --2- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34140d1e80 0x7f34140d2310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 --2- 172.21.15.52:0/1977537325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f341406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 -- 172.21.15.52:0/1977537325 >> 172.21.15.52:0/1977537325 conn(0x7f341408cf50 msgr2=0x7f34140d5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 -- 172.21.15.52:0/1977537325 shutdown_connections 2024-06-02T16:49:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.624+0000 7f3419400640 1 -- 172.21.15.52:0/1977537325 wait complete. 2024-06-02T16:49:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.625+0000 7f3419400640 1 Processor -- start 2024-06-02T16:49:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.626+0000 7f3419400640 1 -- start start 2024-06-02T16:49:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f3414158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 0x7f34140b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f341415f780 0x7f34140b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34140d3970 con 0x7f34140d1e80 2024-06-02T16:49:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f34140d3450 con 0x7f341415f780 2024-06-02T16:49:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3419400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f34140d3af0 con 0x7f34140d0d70 2024-06-02T16:49:46.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3411e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 0x7f34140b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3411e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 0x7f34140b8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49430/0 (socket says 172.21.15.52:49430) 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3411e00640 1 -- 172.21.15.52:0/687392091 learned_addr learned my addr 172.21.15.52:0/687392091 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3412800640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f3414158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3413200640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f341415f780 0x7f34140b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.627+0000 7f3411e00640 1 -- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 msgr2=0x7f3414158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3411e00640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34140d0d70 0x7f3414158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3411e00640 1 -- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f341415f780 msgr2=0x7f34140b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3411e00640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f341415f780 0x7f34140b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3411e00640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3414159010 con 0x7f34140d1e80 2024-06-02T16:49:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3411e00640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 0x7f34140b8090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00e900 tx=0x7f33fc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc017070 con 0x7f34140d1e80 2024-06-02T16:49:46.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33fc00ca00 con 0x7f34140d1e80 2024-06-02T16:49:46.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00cdb0 con 0x7f34140d1e80 2024-06-02T16:49:46.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34140c8d40 con 0x7f34140d1e80 2024-06-02T16:49:46.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.628+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34140c9300 con 0x7f34140d1e80 2024-06-02T16:49:46.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.629+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3414069520 con 0x7f34140d1e80 2024-06-02T16:49:46.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.631+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33fc01a070 con 0x7f34140d1e80 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f340aa00640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33f00762d0 0x7f33f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f33fc097750 con 0x7f34140d1e80 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f340aa00640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f33f007c190 0x7f33f007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33f007ec60 con 0x7f33f007c190 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f33fc09e050 con 0x7f34140d1e80 2024-06-02T16:49:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.632+0000 7f3412800640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33f00762d0 0x7f33f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.633+0000 7f3413200640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f33f007c190 0x7f33f007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.634+0000 7f3412800640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33f00762d0 0x7f33f0078790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3404000f60 tx=0x7f3404009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.634+0000 7f3413200640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f33f007c190 0x7f33f007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.636+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== osd.5 v2:172.21.15.114:6808/1412776483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33f007ec60 con 0x7f33f007c190 2024-06-02T16:49:46.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.652+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 --> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34140c9790 con 0x7f33f007c190 2024-06-02T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.653+0000 7f340aa00640 1 -- 172.21.15.52:0/687392091 <== osd.5 v2:172.21.15.114:6808/1412776483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34140c9790 con 0x7f33f007c190 2024-06-02T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.653+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f33f007c190 msgr2=0x7f33f007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.653+0000 7f3419400640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6808/1412776483,v1:172.21.15.114:6809/1412776483] conn(0x7f33f007c190 0x7f33f007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33f00762d0 msgr2=0x7f33f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f33f00762d0 0x7f33f0078790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3404000f60 tx=0x7f3404009040 comp rx=0 tx=0).stop 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 msgr2=0x7f34140b8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 --2- 172.21.15.52:0/687392091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34140d1e80 0x7f34140b8090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00e900 tx=0x7f33fc00edc0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3413200640 1 -- 172.21.15.52:0/687392091 reap_dead start 2024-06-02T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 shutdown_connections 2024-06-02T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 >> 172.21.15.52:0/687392091 conn(0x7f341408cf50 msgr2=0x7f34140d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 shutdown_connections 2024-06-02T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.654+0000 7f3419400640 1 -- 172.21.15.52:0/687392091 wait complete. 2024-06-02T16:49:46.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-02T16:49:46.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.892+0000 7ff1ee400640 1 Processor -- start 2024-06-02T16:49:46.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.892+0000 7ff1ee400640 1 -- start start 2024-06-02T16:49:46.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1ee400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1e815d330 0x7ff1e8073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1ee400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1e8074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1ee400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e8070650 con 0x7ff1e80ade40 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1ee400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e8072450 con 0x7ff1e815d330 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1ee400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e8072730 con 0x7ff1e80734f0 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1eda00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff1e80ade40 0x7ff1e8160d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48638/0 (socket says 172.21.15.52:48638) 2024-06-02T16:49:46.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.894+0000 7ff1eda00640 1 -- 172.21.15.52:0/2144350006 learned_addr learned my addr 172.21.15.52:0/2144350006 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:49:46.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7e00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1e8074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1ed000640 1 --2- 172.21.15.52:0/2144350006 >> v2:172.21.15.114:3300/0 conn(0x7ff1e815d330 0x7ff1e8073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054841124 0 0) 0x7ff1e8070650 con 0x7ff1e80ade40 2024-06-02T16:49:46.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1cc003520 con 0x7ff1e80ade40 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2302583652 0 0) 0x7ff1cc003520 con 0x7ff1e80ade40 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 msgr2=0x7ff1e8074060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1e8074060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 >> v2:172.21.15.114:3300/0 conn(0x7ff1e815d330 msgr2=0x7ff1e8073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 --2- 172.21.15.52:0/2144350006 >> v2:172.21.15.114:3300/0 conn(0x7ff1e815d330 0x7ff1e8073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e8072a10 con 0x7ff1e80ade40 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7ff1e00016f0 con 0x7ff1e80ade40 2024-06-02T16:49:46.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 >> v1:172.21.15.52:6789/0 conn(0x7ff1e80ade40 legacy=0x7ff1e8160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1cc003a00 0x7ff1cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1cc004d40 0x7ff1cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8072450 con 0x7ff1cc004d40 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.895+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8072730 con 0x7ff1cc003a00 2024-06-02T16:49:46.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc00b9c0 con 0x7ff1e80734f0 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1cc004d40 0x7ff1cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1ed000640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1cc003a00 0x7ff1cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1e7e00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 -- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 msgr2=0x7ff1cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1e80734f0 0x7ff1cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 -- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1cc003a00 msgr2=0x7ff1cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1cc003a00 0x7ff1cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.896+0000 7ff1eda00640 1 -- 172.21.15.52:0/2144350006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc003520 con 0x7ff1cc004d40 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.897+0000 7ff1eda00640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1cc004d40 0x7ff1cc0051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c290 tx=0x7ff1cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d64a4009f056219 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007d50 con 0x7ff1cc004d40 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e0005af0 con 0x7ff1cc004d40 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1e7400640 1 -- 172.21.15.52:0/2144350006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007070 con 0x7ff1cc004d40 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1ee400640 1 -- 172.21.15.52:0/2144350006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1cc004d40 msgr2=0x7ff1cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1ee400640 1 --2- 172.21.15.52:0/2144350006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1cc004d40 0x7ff1cc0051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c290 tx=0x7ff1cc005830 comp rx=0 tx=0).stop 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1eda00640 1 -- 172.21.15.52:0/2144350006 reap_dead start 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1ee400640 1 -- 172.21.15.52:0/2144350006 shutdown_connections 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.898+0000 7ff1ee400640 1 -- 172.21.15.52:0/2144350006 >> 172.21.15.52:0/2144350006 conn(0x7ff1e80b2b60 msgr2=0x7ff1e80b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.899+0000 7ff1ee400640 1 -- 172.21.15.52:0/2144350006 shutdown_connections 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.899+0000 7ff1ee400640 1 -- 172.21.15.52:0/2144350006 wait complete. 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.900+0000 7ff1ee400640 1 Processor -- start 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.900+0000 7ff1ee400640 1 -- start start 2024-06-02T16:49:46.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1cc004d40 0x7ff1e815f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 0x7ff1e814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8074060 con 0x7ff1e809cec0 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8072fd0 con 0x7ff1e815dc50 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.901+0000 7ff1ee400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e80741e0 con 0x7ff1cc004d40 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49456/0 (socket says 172.21.15.52:49456) 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 -- 172.21.15.52:0/3969562550 learned_addr learned my addr 172.21.15.52:0/3969562550 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1eda00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 0x7ff1e814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 -- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1cc004d40 msgr2=0x7ff1e815f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1ed000640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1cc004d40 0x7ff1e815f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1cc004d40 0x7ff1e815f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 -- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 msgr2=0x7ff1e814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 0x7ff1e814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 -- 172.21.15.52:0/3969562550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e815e0f0 con 0x7ff1e809cec0 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1eda00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 0x7ff1e814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:46.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.902+0000 7ff1e7e00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8007f30 tx=0x7ff1d8011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.903+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d801a020 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.903+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8016470 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.903+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8016860 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.903+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e815e3d0 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.903+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e809ba60 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.904+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e815ceb0 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.906+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff1d8005d10 con 0x7ff1e809cec0 2024-06-02T16:49:46.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.907+0000 7ff1e4c00640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 0x7ff1c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:46.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.907+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7ff1d8098280 con 0x7ff1e809cec0 2024-06-02T16:49:46.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.908+0000 7ff1ed000640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 0x7ff1c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:46.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.909+0000 7ff1ed000640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 0x7ff1c4078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1e815f200 tx=0x7ff1d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:46.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:46.912+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff1e815ceb0 con 0x7ff1e809cec0 2024-06-02T16:49:47.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.121+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff1e815fde0 con 0x7ff1c40762d0 2024-06-02T16:49:47.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.123+0000 7ff1e4c00640 1 -- 172.21.15.52:0/3969562550 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff1e815fde0 con 0x7ff1c40762d0 2024-06-02T16:49:47.122 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2024-06-02T16:49:47.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 msgr2=0x7ff1c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 0x7ff1c4078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1e815f200 tx=0x7ff1d0008040 comp rx=0 tx=0).stop 2024-06-02T16:49:47.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 msgr2=0x7ff1e815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8007f30 tx=0x7ff1d8011660 comp rx=0 tx=0).stop 2024-06-02T16:49:47.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 shutdown_connections 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1c40762d0 0x7ff1c4078790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815dc50 0x7ff1e814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e809cec0 0x7ff1e815d710 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 --2- 172.21.15.52:0/3969562550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1cc004d40 0x7ff1e815f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 >> 172.21.15.52:0/3969562550 conn(0x7ff1e80b2b60 msgr2=0x7ff1e80b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 shutdown_connections 2024-06-02T16:49:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.125+0000 7ff1ee400640 1 -- 172.21.15.52:0/3969562550 wait complete. 2024-06-02T16:49:47.145 INFO:tasks.ceph:Scrubbing osd.6 2024-06-02T16:49:47.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.365+0000 7f6849c00640 1 Processor -- start 2024-06-02T16:49:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.365+0000 7f6849c00640 1 -- start start 2024-06-02T16:49:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.366+0000 7f6849c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68441579b0 0x7f68440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.366+0000 7f6849c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 0x7f684406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.366+0000 7f6849c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f684415e9b0 con 0x7f68440d0cd0 2024-06-02T16:49:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.366+0000 7f6849c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f684415de30 con 0x7f68441579b0 2024-06-02T16:49:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.366+0000 7f6849c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f684415e110 con 0x7f684406f3b0 2024-06-02T16:49:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68441579b0 0x7f68440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68441579b0 0x7f68440b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49468/0 (socket says 172.21.15.52:49468) 2024-06-02T16:49:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 -- 172.21.15.52:0/158306120 learned_addr learned my addr 172.21.15.52:0/158306120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 -- 172.21.15.52:0/158306120 >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 msgr2=0x7f684406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6843400640 1 --2- 172.21.15.52:0/158306120 >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 0x7f684406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 --2- 172.21.15.52:0/158306120 >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 0x7f684406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 -- 172.21.15.52:0/158306120 >> v1:172.21.15.52:6789/0 conn(0x7f68440d0cd0 legacy=0x7f68440d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842a00640 1 -- 172.21.15.52:0/158306120 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684415e3f0 con 0x7f68441579b0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6842000640 1 -- 172.21.15.52:0/158306120 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048953143 0 0) 0x7f684415e9b0 con 0x7f68440d0cd0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.367+0000 7f6843400640 1 --2- 172.21.15.52:0/158306120 >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 0x7f684406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6842a00640 1 --2- 172.21.15.52:0/158306120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68441579b0 0x7f68440b0630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f68440b6250 tx=0x7f683402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4e797b62dd12ad server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6842000640 1 -- 172.21.15.52:0/158306120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834037070 con 0x7f68441579b0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6842000640 1 -- 172.21.15.52:0/158306120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6834032440 con 0x7f68441579b0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6842000640 1 -- 172.21.15.52:0/158306120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834032810 con 0x7f68441579b0 2024-06-02T16:49:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 -- 172.21.15.52:0/158306120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68441579b0 msgr2=0x7f68440b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 --2- 172.21.15.52:0/158306120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68441579b0 0x7f68440b0630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f68440b6250 tx=0x7f683402a1e0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 -- 172.21.15.52:0/158306120 shutdown_connections 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 --2- 172.21.15.52:0/158306120 >> v2:172.21.15.114:3300/0 conn(0x7f684406f3b0 0x7f684406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 --2- 172.21.15.52:0/158306120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68441579b0 0x7f68440b0630 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.369+0000 7f6849c00640 1 -- 172.21.15.52:0/158306120 >> 172.21.15.52:0/158306120 conn(0x7f684406c380 msgr2=0x7f684406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.370+0000 7f6849c00640 1 -- 172.21.15.52:0/158306120 shutdown_connections 2024-06-02T16:49:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.370+0000 7f6849c00640 1 -- 172.21.15.52:0/158306120 wait complete. 2024-06-02T16:49:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.371+0000 7f6849c00640 1 Processor -- start 2024-06-02T16:49:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.371+0000 7f6849c00640 1 -- start start 2024-06-02T16:49:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 0x7f6844156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f68440d0cd0 0x7f68440b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68441579b0 0x7f6844147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68440b4c10 con 0x7f684406f3b0 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6844157d90 con 0x7f68441579b0 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.372+0000 7f6849c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f68440b4d90 con 0x7f68440d0cd0 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 0x7f6844156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 0x7f6844156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49470/0 (socket says 172.21.15.52:49470) 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 -- 172.21.15.52:0/2736782497 learned_addr learned my addr 172.21.15.52:0/2736782497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6843400640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68441579b0 0x7f6844147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 -- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f68440d0cd0 msgr2=0x7f68440b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f68440d0cd0 0x7f68440b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 -- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68441579b0 msgr2=0x7f6844147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68441579b0 0x7f6844147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6842a00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68440b27c0 con 0x7f684406f3b0 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.373+0000 7f6843400640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68441579b0 0x7f6844147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f6842a00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 0x7f6844156390 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f68340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834037040 con 0x7f684406f3b0 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6834042070 con 0x7f684406f3b0 2024-06-02T16:49:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834030bb0 con 0x7f684406f3b0 2024-06-02T16:49:47.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68440b2aa0 con 0x7f684406f3b0 2024-06-02T16:49:47.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.374+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68440b3060 con 0x7f684406f3b0 2024-06-02T16:49:47.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.375+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6844070680 con 0x7f684406f3b0 2024-06-02T16:49:47.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.377+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6834047460 con 0x7f684406f3b0 2024-06-02T16:49:47.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683aa00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6820076300 0x7f68200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f68340b7fe0 con 0x7f684406f3b0 2024-06-02T16:49:47.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683aa00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7f682007c1c0 0x7f682007e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f683403ee50 con 0x7f682007c1c0 2024-06-02T16:49:47.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f68340ba5c0 con 0x7f684406f3b0 2024-06-02T16:49:47.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.378+0000 7f683be00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6820076300 0x7f68200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.379+0000 7f6843400640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7f682007c1c0 0x7f682007e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.379+0000 7f683be00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6820076300 0x7f68200787c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68441534c0 tx=0x7f682c0078d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.380+0000 7f6843400640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7f682007c1c0 0x7f682007e5e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.382+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== osd.6 v2:172.21.15.114:6824/2173533746 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f683403ee50 con 0x7f682007c1c0 2024-06-02T16:49:47.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.397+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 --> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6844069520 con 0x7f682007c1c0 2024-06-02T16:49:47.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f683aa00640 1 -- 172.21.15.52:0/2736782497 <== osd.6 v2:172.21.15.114:6824/2173533746 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6844069520 con 0x7f682007c1c0 2024-06-02T16:49:47.397 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:47.398 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:47.398 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7f682007c1c0 msgr2=0x7f682007e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6824/2173533746,v1:172.21.15.114:6825/2173533746] conn(0x7f682007c1c0 0x7f682007e5e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6820076300 msgr2=0x7f68200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f6820076300 0x7f68200787c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68441534c0 tx=0x7f682c0078d0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 msgr2=0x7f6844156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.398+0000 7f6849c00640 1 --2- 172.21.15.52:0/2736782497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f684406f3b0 0x7f6844156390 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6834000c00 tx=0x7f68340046c0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.399+0000 7f6843400640 1 -- 172.21.15.52:0/2736782497 reap_dead start 2024-06-02T16:49:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.399+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 shutdown_connections 2024-06-02T16:49:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.399+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 >> 172.21.15.52:0/2736782497 conn(0x7f684406c380 msgr2=0x7f684415fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.399+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 shutdown_connections 2024-06-02T16:49:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.399+0000 7f6849c00640 1 -- 172.21.15.52:0/2736782497 wait complete. 2024-06-02T16:49:47.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-02T16:49:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.629+0000 7fc22f200640 1 Processor -- start 2024-06-02T16:49:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.630+0000 7fc22f200640 1 -- start start 2024-06-02T16:49:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc22815d700 0x7fc22815e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc2280b4a70 0x7fc22806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2280b3070 0x7fc2280b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc22806cd20 con 0x7fc2280b3070 2024-06-02T16:49:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc22806d000 con 0x7fc22815d700 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.631+0000 7fc22f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc22815de80 con 0x7fc2280b4a70 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2280b3070 0x7fc2280b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2280b3070 0x7fc2280b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49484/0 (socket says 172.21.15.52:49484) 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 -- 172.21.15.52:0/148224279 learned_addr learned my addr 172.21.15.52:0/148224279 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc227e00640 1 --2- 172.21.15.52:0/148224279 >> v2:172.21.15.114:3300/0 conn(0x7fc22815d700 0x7fc22815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc227400640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc2280b4a70 0x7fc22806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 -- 172.21.15.52:0/148224279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc2280b4a70 msgr2=0x7fc22806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc2280b4a70 0x7fc22806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 -- 172.21.15.52:0/148224279 >> v2:172.21.15.114:3300/0 conn(0x7fc22815d700 msgr2=0x7fc22815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 --2- 172.21.15.52:0/148224279 >> v2:172.21.15.114:3300/0 conn(0x7fc22815d700 0x7fc22815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.632+0000 7fc22d200640 1 -- 172.21.15.52:0/148224279 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22815e160 con 0x7fc2280b3070 2024-06-02T16:49:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.633+0000 7fc22d200640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b3070 0x7fc2280b3520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc2280748e0 tx=0x7fc22002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13813526c1c96ea server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc226a00640 1 -- 172.21.15.52:0/148224279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220036070 con 0x7fc2280b3070 2024-06-02T16:49:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc226a00640 1 -- 172.21.15.52:0/148224279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc220031600 con 0x7fc2280b3070 2024-06-02T16:49:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc226a00640 1 -- 172.21.15.52:0/148224279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2200319d0 con 0x7fc2280b3070 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 -- 172.21.15.52:0/148224279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b3070 msgr2=0x7fc2280b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b3070 0x7fc2280b3520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc2280748e0 tx=0x7fc22002a6a0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 -- 172.21.15.52:0/148224279 shutdown_connections 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc2280b4a70 0x7fc22806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 --2- 172.21.15.52:0/148224279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b3070 0x7fc2280b3520 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 --2- 172.21.15.52:0/148224279 >> v2:172.21.15.114:3300/0 conn(0x7fc22815d700 0x7fc22815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.634+0000 7fc22f200640 1 -- 172.21.15.52:0/148224279 >> 172.21.15.52:0/148224279 conn(0x7fc22809b9c0 msgr2=0x7fc2280b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.635+0000 7fc22f200640 1 -- 172.21.15.52:0/148224279 shutdown_connections 2024-06-02T16:49:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.635+0000 7fc22f200640 1 -- 172.21.15.52:0/148224279 wait complete. 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.636+0000 7fc22f200640 1 Processor -- start 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.636+0000 7fc22f200640 1 -- start start 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2280b3070 0x7fc2280c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc22815d700 0x7fc2280707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc22806ca40 con 0x7fc2280b4a70 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc22806c8c0 con 0x7fc2280b3070 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.637+0000 7fc22f200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fc22815ecd0 con 0x7fc22815d700 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49492/0 (socket says 172.21.15.52:49492) 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 -- 172.21.15.52:0/671936653 learned_addr learned my addr 172.21.15.52:0/671936653 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227e00640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2280b3070 0x7fc2280c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc22d200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc22815d700 0x7fc2280707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 -- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc22815d700 msgr2=0x7fc2280707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc22815d700 0x7fc2280707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 -- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2280b3070 msgr2=0x7fc2280c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2280b3070 0x7fc2280c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.638+0000 7fc227400640 1 -- 172.21.15.52:0/671936653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2281f8b50 con 0x7fc2280b4a70 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc227400640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc21400d830 tx=0x7fc21400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214018020 con 0x7fc2280b4a70 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2140096a0 con 0x7fc2280b4a70 2024-06-02T16:49:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214009a70 con 0x7fc2280b4a70 2024-06-02T16:49:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2281f8e30 con 0x7fc2280b4a70 2024-06-02T16:49:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.639+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2281f93f0 con 0x7fc2280b4a70 2024-06-02T16:49:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.640+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc228069c30 con 0x7fc2280b4a70 2024-06-02T16:49:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.641+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc21401b020 con 0x7fc2280b4a70 2024-06-02T16:49:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.642+0000 7fc21fe00640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 0x7fc208078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.642+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fc214097810 con 0x7fc2280b4a70 2024-06-02T16:49:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.643+0000 7fc227e00640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 0x7fc208078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:47.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.644+0000 7fc227e00640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 0x7fc208078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc218006fd0 tx=0x7fc218008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:47.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.649+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc214022030 con 0x7fc2280b4a70 2024-06-02T16:49:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.861+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc2280b3fa0 con 0x7fc2080762d0 2024-06-02T16:49:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.863+0000 7fc21fe00640 1 -- 172.21.15.52:0/671936653 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc2280b3fa0 con 0x7fc2080762d0 2024-06-02T16:49:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 msgr2=0x7fc208078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 0x7fc208078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc218006fd0 tx=0x7fc218008040 comp rx=0 tx=0).stop 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 msgr2=0x7fc228155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc21400d830 tx=0x7fc21400dcf0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 shutdown_connections 2024-06-02T16:49:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fc2080762d0 0x7fc208078790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc22815d700 0x7fc2280707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2280b4a70 0x7fc228155550 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 --2- 172.21.15.52:0/671936653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2280b3070 0x7fc2280c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 >> 172.21.15.52:0/671936653 conn(0x7fc22809b9c0 msgr2=0x7fc2280d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 shutdown_connections 2024-06-02T16:49:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:47.865+0000 7fc22f200640 1 -- 172.21.15.52:0/671936653 wait complete. 2024-06-02T16:49:47.885 INFO:tasks.ceph:Scrubbing osd.7 2024-06-02T16:49:47.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-02T16:49:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.101+0000 7ff1a3e00640 1 Processor -- start 2024-06-02T16:49:48.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.101+0000 7ff1a3e00640 1 -- start start 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40afce0 0x7ff1a4073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a415e150 0x7ff1a406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4074650 con 0x7ff1a40adeb0 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a415e600 con 0x7ff1a415e150 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a40ae400 con 0x7ff1a40afce0 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a415e150 0x7ff1a406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a415e150 0x7ff1a406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49508/0 (socket says 172.21.15.52:49508) 2024-06-02T16:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 -- 172.21.15.52:0/3883237395 learned_addr learned my addr 172.21.15.52:0/3883237395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a2a00640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40afce0 0x7ff1a4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 -- 172.21.15.52:0/3883237395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40afce0 msgr2=0x7ff1a4073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:48.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40afce0 0x7ff1a4073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 -- 172.21.15.52:0/3883237395 >> v1:172.21.15.114:6789/0 conn(0x7ff1a40adeb0 legacy=0x7ff1a40b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.104+0000 7ff1a3400640 1 -- 172.21.15.52:0/3883237395 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4072990 con 0x7ff1a415e150 2024-06-02T16:49:48.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.105+0000 7ff1a3400640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a415e150 0x7ff1a406e350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009e50 tx=0x7ff19c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deafe928632c941e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a2000640 1 -- 172.21.15.52:0/3883237395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c036070 con 0x7ff1a415e150 2024-06-02T16:49:48.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a2000640 1 -- 172.21.15.52:0/3883237395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19c031600 con 0x7ff1a415e150 2024-06-02T16:49:48.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a2000640 1 -- 172.21.15.52:0/3883237395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0319d0 con 0x7ff1a415e150 2024-06-02T16:49:48.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 -- 172.21.15.52:0/3883237395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a415e150 msgr2=0x7ff1a406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a415e150 0x7ff1a406e350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009e50 tx=0x7ff19c02a680 comp rx=0 tx=0).stop 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 -- 172.21.15.52:0/3883237395 shutdown_connections 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a415e150 0x7ff1a406e350 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/3883237395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40afce0 0x7ff1a4073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.106+0000 7ff1a3e00640 1 -- 172.21.15.52:0/3883237395 >> 172.21.15.52:0/3883237395 conn(0x7ff1a40b2bd0 msgr2=0x7ff1a40b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.107+0000 7ff1a3e00640 1 -- 172.21.15.52:0/3883237395 shutdown_connections 2024-06-02T16:49:48.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.107+0000 7ff1a3e00640 1 -- 172.21.15.52:0/3883237395 wait complete. 2024-06-02T16:49:48.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.108+0000 7ff1a3e00640 1 Processor -- start 2024-06-02T16:49:48.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.109+0000 7ff1a3e00640 1 -- start start 2024-06-02T16:49:48.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.109+0000 7ff1a3e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40adeb0 0x7ff1a415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.109+0000 7ff1a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 0x7ff1a4156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1a415e150 0x7ff1a40b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40ae6e0 con 0x7ff1a40afce0 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4072f50 con 0x7ff1a415e150 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a3e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a415d3c0 con 0x7ff1a40adeb0 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 0x7ff1a4156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 0x7ff1a4156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49510/0 (socket says 172.21.15.52:49510) 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 -- 172.21.15.52:0/2070032362 learned_addr learned my addr 172.21.15.52:0/2070032362 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a2a00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40adeb0 0x7ff1a415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff1a3400640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1a415e150 0x7ff1a40b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 -- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40adeb0 msgr2=0x7ff1a415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1a40adeb0 0x7ff1a415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 -- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1a415e150 msgr2=0x7ff1a40b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1a415e150 0x7ff1a40b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.110+0000 7ff19be00640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4154fb0 con 0x7ff1a40afce0 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff19be00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 0x7ff1a4156010 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c370 tx=0x7ff18c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c017070 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c0052d0 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c003830 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4155250 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.111+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a4155810 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.112+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1a40507e0 con 0x7ff1a40afce0 2024-06-02T16:49:48.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.114+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff18c01a070 con 0x7ff1a40afce0 2024-06-02T16:49:48.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff19b400640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1800762d0 0x7ff180078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7ff18c096610 con 0x7ff1a40afce0 2024-06-02T16:49:48.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff19b400640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7ff18007c190 0x7ff18007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff18c01ee50 con 0x7ff18007c190 2024-06-02T16:49:48.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff18c09d050 con 0x7ff1a40afce0 2024-06-02T16:49:48.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff1a2a00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1800762d0 0x7ff180078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.116+0000 7ff1a3400640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7ff18007c190 0x7ff18007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.117+0000 7ff1a2a00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1800762d0 0x7ff180078790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff194006fd0 tx=0x7ff194008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.117+0000 7ff1a3400640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7ff18007c190 0x7ff18007e5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.120+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== osd.7 v2:172.21.15.114:6816/181579839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff18c01ee50 con 0x7ff18007c190 2024-06-02T16:49:48.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.135+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 --> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1a41601b0 con 0x7ff18007c190 2024-06-02T16:49:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.136+0000 7ff19b400640 1 -- 172.21.15.52:0/2070032362 <== osd.7 v2:172.21.15.114:6816/181579839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1a41601b0 con 0x7ff18007c190 2024-06-02T16:49:48.135 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-06-02T16:49:48.136 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T16:49:48.136 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.136+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7ff18007c190 msgr2=0x7ff18007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.136+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6816/181579839,v1:172.21.15.114:6817/181579839] conn(0x7ff18007c190 0x7ff18007e5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1800762d0 msgr2=0x7ff180078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7ff1800762d0 0x7ff180078790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff194006fd0 tx=0x7ff194008040 comp rx=0 tx=0).stop 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 msgr2=0x7ff1a4156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 --2- 172.21.15.52:0/2070032362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40afce0 0x7ff1a4156010 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c370 tx=0x7ff18c00c830 comp rx=0 tx=0).stop 2024-06-02T16:49:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3400640 1 -- 172.21.15.52:0/2070032362 reap_dead start 2024-06-02T16:49:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 shutdown_connections 2024-06-02T16:49:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 >> 172.21.15.52:0/2070032362 conn(0x7ff1a40b2bd0 msgr2=0x7ff1a415c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 shutdown_connections 2024-06-02T16:49:48.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.137+0000 7ff1a3e00640 1 -- 172.21.15.52:0/2070032362 wait complete. 2024-06-02T16:49:48.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-02T16:49:48.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.372+0000 7f9066200640 1 Processor -- start 2024-06-02T16:49:48.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.372+0000 7f9066200640 1 -- start start 2024-06-02T16:49:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9066200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f906015d330 0x7f9060073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9066200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 0x7f9060074060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9066200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9060070650 con 0x7f90600734f0 2024-06-02T16:49:48.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9066200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9060072450 con 0x7f906015d330 2024-06-02T16:49:48.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9066200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9060072730 con 0x7f90600ae550 2024-06-02T16:49:48.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f906015d330 0x7f9060073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f906015d330 0x7f9060073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49518/0 (socket says 172.21.15.52:49518) 2024-06-02T16:49:48.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 -- 172.21.15.52:0/3064133914 learned_addr learned my addr 172.21.15.52:0/3064133914 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9065800640 1 --2- 172.21.15.52:0/3064133914 >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 0x7f9060074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 -- 172.21.15.52:0/3064133914 >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 msgr2=0x7f9060074060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:48.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 --2- 172.21.15.52:0/3064133914 >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 0x7f9060074060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 -- 172.21.15.52:0/3064133914 >> v1:172.21.15.114:6789/0 conn(0x7f90600734f0 legacy=0x7f90600ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:48.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9064e00640 1 -- 172.21.15.52:0/3064133914 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9060072a10 con 0x7f906015d330 2024-06-02T16:49:48.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.374+0000 7f9065800640 1 --2- 172.21.15.52:0/3064133914 >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 0x7f9060074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:48.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.375+0000 7f9064e00640 1 --2- 172.21.15.52:0/3064133914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060073b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f90600b3f10 tx=0x7f905402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd9e9d4f7a8688d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.376+0000 7f905f400640 1 -- 172.21.15.52:0/3064133914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054037070 con 0x7f906015d330 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.376+0000 7f905f400640 1 -- 172.21.15.52:0/3064133914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9054032440 con 0x7f906015d330 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.376+0000 7f905f400640 1 -- 172.21.15.52:0/3064133914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054032810 con 0x7f906015d330 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.376+0000 7f9066200640 1 -- 172.21.15.52:0/3064133914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 msgr2=0x7f9060073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.376+0000 7f9066200640 1 --2- 172.21.15.52:0/3064133914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060073b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f90600b3f10 tx=0x7f905402a1e0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 -- 172.21.15.52:0/3064133914 shutdown_connections 2024-06-02T16:49:48.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 --2- 172.21.15.52:0/3064133914 >> v2:172.21.15.114:3300/0 conn(0x7f90600ae550 0x7f9060074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 --2- 172.21.15.52:0/3064133914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060073b20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 -- 172.21.15.52:0/3064133914 >> 172.21.15.52:0/3064133914 conn(0x7f90600b2b60 msgr2=0x7f90600b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 -- 172.21.15.52:0/3064133914 shutdown_connections 2024-06-02T16:49:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.377+0000 7f9066200640 1 -- 172.21.15.52:0/3064133914 wait complete. 2024-06-02T16:49:48.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.379+0000 7f9066200640 1 Processor -- start 2024-06-02T16:49:48.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.379+0000 7f9066200640 1 -- start start 2024-06-02T16:49:48.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90600734f0 0x7f90601f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90600ae550 0x7f90601f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f906006e410 con 0x7f906015d330 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9060072fd0 con 0x7f90600734f0 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.380+0000 7f9066200640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f906006e590 con 0x7f90600ae550 2024-06-02T16:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9064e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90600734f0 0x7f90601f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49534/0 (socket says 172.21.15.52:49534) 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 -- 172.21.15.52:0/2249405328 learned_addr learned my addr 172.21.15.52:0/2249405328 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f905fe00640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90600ae550 0x7f90601f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 -- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90600ae550 msgr2=0x7f90601f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90600ae550 0x7f90601f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 -- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90600734f0 msgr2=0x7f90601f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90600734f0 0x7f90601f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.381+0000 7f9065800640 1 -- 172.21.15.52:0/2249405328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90601f63f0 con 0x7f906015d330 2024-06-02T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f9065800640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f905800ce40 tx=0x7f905800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905801a070 con 0x7f906015d330 2024-06-02T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f905800d840 con 0x7f906015d330 2024-06-02T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90601f66d0 con 0x7f906015d330 2024-06-02T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905800dc30 con 0x7f906015d330 2024-06-02T16:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.382+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90601f6c90 con 0x7f906015d330 2024-06-02T16:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.383+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90600507e0 con 0x7f906015d330 2024-06-02T16:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.386+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f905801d070 con 0x7f906015d330 2024-06-02T16:49:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.386+0000 7f905cc00640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 0x7f9040078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.386+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f9058097aa0 con 0x7f906015d330 2024-06-02T16:49:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.387+0000 7f9064e00640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 0x7f9040078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.388+0000 7f9064e00640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 0x7f9040078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9054034000 tx=0x7f905402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.391+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f90580610a0 con 0x7f906015d330 2024-06-02T16:49:48.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.600+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f90600739b0 con 0x7f90400762d0 2024-06-02T16:49:48.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.602+0000 7f905cc00640 1 -- 172.21.15.52:0/2249405328 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f90600739b0 con 0x7f90400762d0 2024-06-02T16:49:48.602 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2024-06-02T16:49:48.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.603+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 msgr2=0x7f9040078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.603+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 0x7f9040078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9054034000 tx=0x7f905402e000 comp rx=0 tx=0).stop 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 msgr2=0x7f9060153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f905800ce40 tx=0x7f905800a710 comp rx=0 tx=0).stop 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 shutdown_connections 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f90400762d0 0x7f9040078790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f906015d330 0x7f9060153a00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90600ae550 0x7f90601f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 --2- 172.21.15.52:0/2249405328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90600734f0 0x7f90601f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 >> 172.21.15.52:0/2249405328 conn(0x7f90600b2b60 msgr2=0x7f9060160cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:48.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 shutdown_connections 2024-06-02T16:49:48.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.604+0000 7f9066200640 1 -- 172.21.15.52:0/2249405328 wait complete. 2024-06-02T16:49:48.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.829+0000 7fb2dfe00640 1 Processor -- start 2024-06-02T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.829+0000 7fb2dfe00640 1 -- start start 2024-06-02T16:49:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dfe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e0073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2e006e840 0x7fb2e0072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dfe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e0160c80 con 0x7fb2e0073fb0 2024-06-02T16:49:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e0160f60 con 0x7fb2e006e840 2024-06-02T16:49:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dfe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e0161240 con 0x7fb2e01577f0 2024-06-02T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2e006e840 0x7fb2e0072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2e006e840 0x7fb2e0072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49538/0 (socket says 172.21.15.52:49538) 2024-06-02T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 -- 172.21.15.52:0/3951119192 learned_addr learned my addr 172.21.15.52:0/3951119192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2dea00640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e0073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 -- 172.21.15.52:0/3951119192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 msgr2=0x7fb2e0073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e0073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 -- 172.21.15.52:0/3951119192 >> v1:172.21.15.114:6789/0 conn(0x7fb2e0073fb0 legacy=0x7fb2e006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.831+0000 7fb2df400640 1 -- 172.21.15.52:0/3951119192 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e0161520 con 0x7fb2e006e840 2024-06-02T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.832+0000 7fb2df400640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e0072340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e50 tx=0x7fb2d802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a6f7cd29155558 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2de000640 1 -- 172.21.15.52:0/3951119192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8036070 con 0x7fb2e006e840 2024-06-02T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2de000640 1 -- 172.21.15.52:0/3951119192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d8031600 con 0x7fb2e006e840 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2de000640 1 -- 172.21.15.52:0/3951119192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80319d0 con 0x7fb2e006e840 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 -- 172.21.15.52:0/3951119192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 msgr2=0x7fb2e0072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e0072340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e50 tx=0x7fb2d802a710 comp rx=0 tx=0).stop 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 -- 172.21.15.52:0/3951119192 shutdown_connections 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e0072340 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/3951119192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e0073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 -- 172.21.15.52:0/3951119192 >> 172.21.15.52:0/3951119192 conn(0x7fb2e006c380 msgr2=0x7fb2e006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.833+0000 7fb2dfe00640 1 -- 172.21.15.52:0/3951119192 shutdown_connections 2024-06-02T16:49:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.834+0000 7fb2dfe00640 1 -- 172.21.15.52:0/3951119192 wait complete. 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.835+0000 7fb2dfe00640 1 Processor -- start 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.835+0000 7fb2dfe00640 1 -- start start 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 0x7fb2e01f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e01f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0074580 con 0x7fb2e006e840 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0161a40 con 0x7fb2e0073fb0 2024-06-02T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.836+0000 7fb2dfe00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e0072880 con 0x7fb2e01577f0 2024-06-02T16:49:48.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49540/0 (socket says 172.21.15.52:49540) 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 -- 172.21.15.52:0/1697544620 learned_addr learned my addr 172.21.15.52:0/1697544620 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2df400640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e01f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2d6000640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 0x7fb2e01f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 -- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 msgr2=0x7fb2e01f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e01f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 -- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 msgr2=0x7fb2e01f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 0x7fb2e01f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 -- 172.21.15.52:0/1697544620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e00af280 con 0x7fb2e006e840 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2df400640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2d6000640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 0x7fb2e01f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.837+0000 7fb2dea00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d5d0 tx=0x7fb2d000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.838+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00125f0 con 0x7fb2e006e840 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.838+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d0019070 con 0x7fb2e006e840 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.838+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00129f0 con 0x7fb2e006e840 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.838+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e00af560 con 0x7fb2e006e840 2024-06-02T16:49:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.838+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e00afb20 con 0x7fb2e006e840 2024-06-02T16:49:48.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.839+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e0075ea0 con 0x7fb2e006e840 2024-06-02T16:49:48.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.840+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2d0012b90 con 0x7fb2e006e840 2024-06-02T16:49:48.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.842+0000 7fb2d7400640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 0x7fb2bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:49:48.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.842+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fb2d0097830 con 0x7fb2e006e840 2024-06-02T16:49:48.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.842+0000 7fb2d6000640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 0x7fb2bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:49:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.843+0000 7fb2d6000640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 0x7fb2bc078790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2e01f66b0 tx=0x7fb2c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:49:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:48.846+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2d00613f0 con 0x7fb2e006e840 2024-06-02T16:49:49.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.053+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2e00507e0 con 0x7fb2bc0762d0 2024-06-02T16:49:49.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.055+0000 7fb2d7400640 1 -- 172.21.15.52:0/1697544620 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7fb2e00507e0 con 0x7fb2bc0762d0 2024-06-02T16:49:49.055 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:49:49.055 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 msgr2=0x7fb2bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 0x7fb2bc078790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2e01f66b0 tx=0x7fb2c8009040 comp rx=0 tx=0).stop 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 msgr2=0x7fb2e00ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d5d0 tx=0x7fb2d000da90 comp rx=0 tx=0).stop 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 shutdown_connections 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fb2bc0762d0 0x7fb2bc078790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:49.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2e01577f0 0x7fb2e01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:49.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e0073fb0 0x7fb2e01f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:49.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 --2- 172.21.15.52:0/1697544620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e006e840 0x7fb2e00ae830 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:49:49.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 >> 172.21.15.52:0/1697544620 conn(0x7fb2e006c380 msgr2=0x7fb2e00cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:49:49.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 shutdown_connections 2024-06-02T16:49:49.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:49:49.058+0000 7fb2dfe00640 1 -- 172.21.15.52:0/1697544620 wait complete. 2024-06-02T16:49:49.078 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-06-02T16:49:48.097509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":305224,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669496,"statfs":{"total":773094113280,"available":772781563904,"internally_reserved":0,"allocated":5971968,"data_stored":3124008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":306433598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.847924"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":161,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-06-02T16:49:36.897985+0000","last_change":"2024-06-02T16:45:01.236635+0000","last_active":"2024-06-02T16:49:36.897985+0000","last_peered":"2024-06-02T16:49:36.897985+0000","last_clean":"2024-06-02T16:49:36.897985+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:36.897985+0000","last_undegraded":"2024-06-02T16:49:36.897985+0000","last_fullsized":"2024-06-02T16:49:36.897985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T16:45:00.146952+0000","last_clean_scrub_stamp":"2024-06-02T16:45:00.146952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:23.394734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476798,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476795,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476797,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476797,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44248,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327592,"statfs":{"total":96636764160,"available":96591454208,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:49:49.081 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-02T16:45:00.146952+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=16, tm_min=45, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=16, tm_min=49, tm_sec=41, tm_wday=6, tm_yday=154, tm_isdst=0) 2024-06-02T16:49:49.081 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-02T16:50:06.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:06.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:09.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T16:50:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.312+0000 7f925ec00640 1 Processor -- start 2024-06-02T16:50:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.312+0000 7f925ec00640 1 -- start start 2024-06-02T16:50:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.313+0000 7f925ec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f925815d2d0 0x7f92580ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.313+0000 7f925ec00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92580d1b60 0x7f925806f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.313+0000 7f925ec00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92580ae8e0 con 0x7f925806fed0 2024-06-02T16:50:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.313+0000 7f925ec00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f925815d6b0 con 0x7f92580d1b60 2024-06-02T16:50:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.313+0000 7f925ec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f925806ed90 con 0x7f925815d2d0 2024-06-02T16:50:09.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f925cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92580d1b60 0x7f925806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f924fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f925806fed0 0x7f92580d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38656/0 (socket says 172.21.15.52:38656) 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f924fe00640 1 -- 172.21.15.52:0/4083158898 learned_addr learned my addr 172.21.15.52:0/4083158898 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f9257e00640 1 --2- 172.21.15.52:0/4083158898 >> v2:172.21.15.114:3300/0 conn(0x7f925815d2d0 0x7f92580ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f925cc00640 1 -- 172.21.15.52:0/4083158898 >> v2:172.21.15.114:3300/0 conn(0x7f925815d2d0 msgr2=0x7f92580ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f925cc00640 1 --2- 172.21.15.52:0/4083158898 >> v2:172.21.15.114:3300/0 conn(0x7f925815d2d0 0x7f92580ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.314+0000 7f925cc00640 1 -- 172.21.15.52:0/4083158898 >> v1:172.21.15.52:6789/0 conn(0x7f925806fed0 legacy=0x7f92580d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.315+0000 7f925cc00640 1 -- 172.21.15.52:0/4083158898 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92580ae600 con 0x7f92580d1b60 2024-06-02T16:50:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.315+0000 7f9257400640 1 -- 172.21.15.52:0/4083158898 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942598737 0 0) 0x7f9240001110 con 0x7f925806fed0 2024-06-02T16:50:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f925cc00640 1 --2- 172.21.15.52:0/4083158898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92580d1b60 0x7f925806f220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f92580b6440 tx=0x7f925002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd789327f82bd7b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f9257400640 1 -- 172.21.15.52:0/4083158898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250007740 con 0x7f92580d1b60 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f9257400640 1 -- 172.21.15.52:0/4083158898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92500078e0 con 0x7f92580d1b60 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f9257400640 1 -- 172.21.15.52:0/4083158898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250007cb0 con 0x7f92580d1b60 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f925ec00640 1 -- 172.21.15.52:0/4083158898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92580d1b60 msgr2=0x7f925806f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.316+0000 7f925ec00640 1 --2- 172.21.15.52:0/4083158898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92580d1b60 0x7f925806f220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f92580b6440 tx=0x7f925002a680 comp rx=0 tx=0).stop 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 -- 172.21.15.52:0/4083158898 shutdown_connections 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 --2- 172.21.15.52:0/4083158898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92580d1b60 0x7f925806f220 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 --2- 172.21.15.52:0/4083158898 >> v2:172.21.15.114:3300/0 conn(0x7f925815d2d0 0x7f92580ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 -- 172.21.15.52:0/4083158898 >> 172.21.15.52:0/4083158898 conn(0x7f925806c7a0 msgr2=0x7f925806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 -- 172.21.15.52:0/4083158898 shutdown_connections 2024-06-02T16:50:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.317+0000 7f925ec00640 1 -- 172.21.15.52:0/4083158898 wait complete. 2024-06-02T16:50:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.318+0000 7f925ec00640 1 Processor -- start 2024-06-02T16:50:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.319+0000 7f925ec00640 1 -- start start 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.319+0000 7f925ec00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f925806fed0 0x7f925815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.319+0000 7f925ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92580d1b60 0x7f925815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f92580741b0 con 0x7f925815d2d0 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f925806ea20 con 0x7f92580d1b60 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925ec00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f925809edc0 con 0x7f925806fed0 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49904/0 (socket says 172.21.15.52:49904) 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 -- 172.21.15.52:0/1589651903 learned_addr learned my addr 172.21.15.52:0/1589651903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f9257e00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f925806fed0 0x7f925815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 -- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f925806fed0 msgr2=0x7f925815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f924fe00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92580d1b60 0x7f925815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f925806fed0 0x7f925815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 -- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92580d1b60 msgr2=0x7f925815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92580d1b60 0x7f925815a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.320+0000 7f925cc00640 1 -- 172.21.15.52:0/1589651903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9258159480 con 0x7f925815d2d0 2024-06-02T16:50:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f925cc00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f925002ac70 tx=0x7f9250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250040070 con 0x7f925815d2d0 2024-06-02T16:50:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9250031bc0 con 0x7f925815d2d0 2024-06-02T16:50:09.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250045460 con 0x7f925815d2d0 2024-06-02T16:50:09.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9258159760 con 0x7f925815d2d0 2024-06-02T16:50:09.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.321+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9258159d20 con 0x7f925815d2d0 2024-06-02T16:50:09.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.322+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9258069520 con 0x7f925815d2d0 2024-06-02T16:50:09.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.324+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9250039040 con 0x7f925815d2d0 2024-06-02T16:50:09.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.325+0000 7f9254c00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 0x7f92340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.325+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f92500b8bc0 con 0x7f925815d2d0 2024-06-02T16:50:09.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.325+0000 7f9257e00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 0x7f92340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.326+0000 7f9257e00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 0x7f92340787c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9248006fd0 tx=0x7f9248008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.330+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9250082810 con 0x7f925815d2d0 2024-06-02T16:50:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.540+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 --> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92580d17a0 con 0x7f9234076300 2024-06-02T16:50:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.542+0000 7f9254c00640 1 -- 172.21.15.52:0/1589651903 <== mgr.4109 v2:172.21.15.114:6832/3580739334 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7f92580d17a0 con 0x7f9234076300 2024-06-02T16:50:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:50:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-06-02T16:50:09.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 msgr2=0x7f92340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 0x7f92340787c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9248006fd0 tx=0x7f9248008040 comp rx=0 tx=0).stop 2024-06-02T16:50:09.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 msgr2=0x7f92580cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f925002ac70 tx=0x7f9250004a40 comp rx=0 tx=0).stop 2024-06-02T16:50:09.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 shutdown_connections 2024-06-02T16:50:09.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f9234076300 0x7f92340787c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f925815d2d0 0x7f92580cc760 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92580d1b60 0x7f925815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 --2- 172.21.15.52:0/1589651903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f925806fed0 0x7f925815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.545+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 >> 172.21.15.52:0/1589651903 conn(0x7f925806c7a0 msgr2=0x7f925815e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.546+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 shutdown_connections 2024-06-02T16:50:09.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.546+0000 7f925ec00640 1 -- 172.21.15.52:0/1589651903 wait complete. 2024-06-02T16:50:09.563 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-06-02T16:50:08.103383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":305208,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669512,"statfs":{"total":773094113280,"available":772781580288,"internally_reserved":0,"allocated":5971968,"data_stored":3124008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12738,"internal_metadata":306433598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003685"},"pg_stats":[{"pgid":"1.0","version":"51'74","reported_seq":172,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-06-02T16:49:49.513823+0000","last_change":"2024-06-02T16:49:49.513899+0000","last_active":"2024-06-02T16:49:49.513823+0000","last_peered":"2024-06-02T16:49:49.513823+0000","last_clean":"2024-06-02T16:49:49.513823+0000","last_became_active":"2024-06-02T16:45:01.230385+0000","last_became_peered":"2024-06-02T16:45:01.230385+0000","last_unstale":"2024-06-02T16:49:49.513823+0000","last_undegraded":"2024-06-02T16:49:49.513823+0000","last_fullsized":"2024-06-02T16:49:49.513823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'74","last_scrub_stamp":"2024-06-02T16:49:49.513613+0000","last_deep_scrub":"51'74","last_deep_scrub_stamp":"2024-06-02T16:49:49.513613+0000","last_clean_scrub_stamp":"2024-06-02T16:49:49.513613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:49.709319+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476802,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":36174284},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476801,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476801,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40088,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331752,"statfs":{"total":96636764160,"available":96595714048,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509503,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1191936,"data_stored":833277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44248,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327592,"statfs":{"total":96636764160,"available":96591454208,"internally_reserved":0,"allocated":598016,"data_stored":242909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T16:50:09.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-02T16:50:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.770+0000 7fd5e0c00640 1 Processor -- start 2024-06-02T16:50:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.770+0000 7fd5e0c00640 1 -- start start 2024-06-02T16:50:09.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5e0c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd5dc15f7f0 0x7fd5dc09b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5e0c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0d2470 0x7fd5dc09bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5e0c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0b23a0 con 0x7fd5dc0b57a0 2024-06-02T16:50:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5e0c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc15fbd0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5e0c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc06d840 con 0x7fd5dc0d2470 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5d9400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd5dc0b57a0 0x7fd5dc0cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38672/0 (socket says 172.21.15.52:38672) 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5d9400640 1 -- 172.21.15.52:0/2009162994 learned_addr learned my addr 172.21.15.52:0/2009162994 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.772+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/2009162994 >> v2:172.21.15.52:3300/0 conn(0x7fd5dc15f7f0 0x7fd5dc09b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5da800640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0d2470 0x7fd5dc09bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d8a00640 1 -- 172.21.15.52:0/2009162994 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023662232 0 0) 0x7fd5dc0b23a0 con 0x7fd5dc0b57a0 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d8a00640 1 -- 172.21.15.52:0/2009162994 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c0003520 con 0x7fd5dc0b57a0 2024-06-02T16:50:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d9e00640 1 -- 172.21.15.52:0/2009162994 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0d2470 msgr2=0x7fd5dc09bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:50:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0d2470 0x7fd5dc09bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d9e00640 1 -- 172.21.15.52:0/2009162994 >> v1:172.21.15.52:6789/0 conn(0x7fd5dc0b57a0 legacy=0x7fd5dc0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.773+0000 7fd5d9e00640 1 -- 172.21.15.52:0/2009162994 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc06db20 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.774+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc09b9c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009d90 tx=0x7fd5c802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd382288ef9857 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.774+0000 7fd5d8a00640 1 -- 172.21.15.52:0/2009162994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031600 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.774+0000 7fd5d8a00640 1 -- 172.21.15.52:0/2009162994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c80317a0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.774+0000 7fd5d8a00640 1 -- 172.21.15.52:0/2009162994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031b70 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 -- 172.21.15.52:0/2009162994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 msgr2=0x7fd5dc09b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc09b9c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009d90 tx=0x7fd5c802a5d0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 -- 172.21.15.52:0/2009162994 shutdown_connections 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0d2470 0x7fd5dc09bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/2009162994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc09b9c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 -- 172.21.15.52:0/2009162994 >> 172.21.15.52:0/2009162994 conn(0x7fd5dc0b4c80 msgr2=0x7fd5dc0b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 -- 172.21.15.52:0/2009162994 shutdown_connections 2024-06-02T16:50:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.775+0000 7fd5e0c00640 1 -- 172.21.15.52:0/2009162994 wait complete. 2024-06-02T16:50:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.777+0000 7fd5e0c00640 1 Processor -- start 2024-06-02T16:50:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.777+0000 7fd5e0c00640 1 -- start start 2024-06-02T16:50:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0b57a0 0x7fd5dc0b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5dc0d2470 0x7fd5dc15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc0ce5f0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc0ce470 con 0x7fd5dc0d2470 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5e0c00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc0ce770 con 0x7fd5dc0b57a0 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5da800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5da800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49914/0 (socket says 172.21.15.52:49914) 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5da800640 1 -- 172.21.15.52:0/336922241 learned_addr learned my addr 172.21.15.52:0/336922241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.778+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0b57a0 0x7fd5dc0b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5d9400640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5dc0d2470 0x7fd5dc15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 -- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0b57a0 msgr2=0x7fd5dc0b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0b57a0 0x7fd5dc0b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 -- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5dc0d2470 msgr2=0x7fd5dc15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5dc0d2470 0x7fd5dc15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 -- 172.21.15.52:0/336922241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc15dce0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5da800640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d800 tx=0x7fd5d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400b6c0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d4019070 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400bac0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.779+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc15dfc0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.780+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc0b6930 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.781+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc0b23a0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.782+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5d400bc60 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.783+0000 7fd5d2000640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 0x7fd5bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.783+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fd5d4097830 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.784+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 0x7fd5bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.785+0000 7fd5d9e00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 0x7fd5bc078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8034000 tx=0x7fd5c8033040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.787+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5dc0b23a0 con 0x7fd5dc15f7f0 2024-06-02T16:50:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:09.995+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd5dc069c30 con 0x7fd5dc15f7f0 2024-06-02T16:50:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.002+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fd5d40613f0 con 0x7fd5dc15f7f0 2024-06-02T16:50:10.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.004+0000 7fd5d2000640 1 -- 172.21.15.52:0/336922241 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd5d4060800 con 0x7fd5dc15f7f0 2024-06-02T16:50:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.006+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 msgr2=0x7fd5bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.006+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 0x7fd5bc078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8034000 tx=0x7fd5c8033040 comp rx=0 tx=0).stop 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.006+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 msgr2=0x7fd5dc156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.006+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d800 tx=0x7fd5d400dcc0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 shutdown_connections 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7fd5bc0762d0 0x7fd5bc078790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5dc15f7f0 0x7fd5dc156310 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5dc0d2470 0x7fd5dc15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 --2- 172.21.15.52:0/336922241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5dc0b57a0 0x7fd5dc0b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 >> 172.21.15.52:0/336922241 conn(0x7fd5dc0b4c80 msgr2=0x7fd5dc0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 shutdown_connections 2024-06-02T16:50:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.007+0000 7fd5e0c00640 1 -- 172.21.15.52:0/336922241 wait complete. 2024-06-02T16:50:10.024 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T16:50:10.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T16:50:10.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.232+0000 7f2755400640 1 Processor -- start 2024-06-02T16:50:10.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.233+0000 7f2755400640 1 -- start start 2024-06-02T16:50:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.234+0000 7f2755400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f275006e2b0 0x7f27500ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.234+0000 7f2755400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275015fc90 con 0x7f275015f8b0 2024-06-02T16:50:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.234+0000 7f2755400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275009c460 con 0x7f275006de20 2024-06-02T16:50:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.234+0000 7f2755400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f27500cd990 con 0x7f275006e2b0 2024-06-02T16:50:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274e800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f275015f8b0 0x7f275009b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38688/0 (socket says 172.21.15.52:38688) 2024-06-02T16:50:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274e800640 1 -- 172.21.15.52:0/123297699 learned_addr learned my addr 172.21.15.52:0/123297699 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763423354 0 0) 0x7f275015fc90 con 0x7f275015f8b0 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2734003520 con 0x7f275015f8b0 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274f200640 1 --2- 172.21.15.52:0/123297699 >> v2:172.21.15.114:3300/0 conn(0x7f275006e2b0 0x7f27500ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 659755107 0 0) 0x7f2734003520 con 0x7f275015f8b0 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 >> v2:172.21.15.114:3300/0 conn(0x7f275006e2b0 msgr2=0x7f27500ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 --2- 172.21.15.52:0/123297699 >> v2:172.21.15.114:3300/0 conn(0x7f275006e2b0 0x7f27500ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 >> v1:172.21.15.114:6789/0 conn(0x7f275006de20 legacy=0x7f27500ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500cdc70 con 0x7f275015f8b0 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.235+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437513808 0 0) 0x7f27400016f0 con 0x7f275015f8b0 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 >> v1:172.21.15.52:6789/0 conn(0x7f275015f8b0 legacy=0x7f275009b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 0x7f2734003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2734004800 0x7f2734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27340052e0 0x7f273400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f27500cd990 con 0x7f2734003a50 2024-06-02T16:50:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f273400c1b0 con 0x7f2734004800 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f273400c3b0 con 0x7f27340052e0 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274e800640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 0x7f2734003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f2745e00640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2734004800 0x7f2734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274f200640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27340052e0 0x7f273400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274e800640 1 -- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27340052e0 msgr2=0x7f273400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274e800640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27340052e0 0x7f273400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274e800640 1 -- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2734004800 msgr2=0x7f2734004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T16:50:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.236+0000 7f274e800640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2734004800 0x7f2734004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.237+0000 7f274e800640 1 -- 172.21.15.52:0/123297699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2734003520 con 0x7f2734003a50 2024-06-02T16:50:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.237+0000 7f2745e00640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2734004800 0x7f2734004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T16:50:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.237+0000 7f274f200640 1 -- 172.21.15.52:0/123297699 reap_dead start 2024-06-02T16:50:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f274e800640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 0x7f2734003e70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2740001eb0 tx=0x7f2734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea91bd84e21f9a31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740007d90 con 0x7f2734003a50 2024-06-02T16:50:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2740005af0 con 0x7f2734003a50 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f274de00640 1 -- 172.21.15.52:0/123297699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740007070 con 0x7f2734003a50 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f2755400640 1 -- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 msgr2=0x7f2734003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.238+0000 7f2755400640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 0x7f2734003e70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2740001eb0 tx=0x7f2734005830 comp rx=0 tx=0).stop 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.239+0000 7f2755400640 1 -- 172.21.15.52:0/123297699 shutdown_connections 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.239+0000 7f2755400640 1 --2- 172.21.15.52:0/123297699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2734003a50 0x7f2734003e70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.239+0000 7f2755400640 1 -- 172.21.15.52:0/123297699 >> 172.21.15.52:0/123297699 conn(0x7f27500b4cb0 msgr2=0x7f27500b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.239+0000 7f2755400640 1 -- 172.21.15.52:0/123297699 shutdown_connections 2024-06-02T16:50:10.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.239+0000 7f2755400640 1 -- 172.21.15.52:0/123297699 wait complete. 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.240+0000 7f2755400640 1 Processor -- start 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.241+0000 7f2755400640 1 -- start start 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 0x7f27501525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2750070a60 0x7f2750070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f275006e6c0 con 0x7f27500c6cf0 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f27500b5a40 con 0x7f2750070a60 2024-06-02T16:50:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2755400640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 -- 0x7f275009b9c0 con 0x7f2734003a50 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49942/0 (socket says 172.21.15.52:49942) 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 -- 172.21.15.52:0/2196334629 learned_addr learned my addr 172.21.15.52:0/2196334629 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f274e800640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 0x7f27501525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 -- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 msgr2=0x7f27501525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f274f200640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2750070a60 0x7f2750070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 0x7f27501525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 -- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2750070a60 msgr2=0x7f2750070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2750070a60 0x7f2750070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f2745e00640 1 -- 172.21.15.52:0/2196334629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500c82d0 con 0x7f27500c6cf0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.242+0000 7f274e800640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 0x7f27501525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2745e00640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f273800e480 tx=0x7f273800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27380053a0 con 0x7f27500c6cf0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2738007020 con 0x7f27500c6cf0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27380071f0 con 0x7f27500c6cf0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27500c7750 con 0x7f27500c6cf0 2024-06-02T16:50:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.243+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27500c7d10 con 0x7f27500c6cf0 2024-06-02T16:50:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.244+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2750071420 con 0x7f27500c6cf0 2024-06-02T16:50:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.245+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f273801a020 con 0x7f27500c6cf0 2024-06-02T16:50:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.246+0000 7f2747400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 0x7f272c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T16:50:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.247+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f27380969e0 con 0x7f27500c6cf0 2024-06-02T16:50:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.247+0000 7f274e800640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 0x7f272c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T16:50:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.248+0000 7f274e800640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 0x7f272c0787c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2740032000 tx=0x7f2740009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T16:50:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.251+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f27380605a0 con 0x7f27500c6cf0 2024-06-02T16:50:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.502+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2750069520 con 0x7f27500c6cf0 2024-06-02T16:50:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.502+0000 7f2747400640 1 -- 172.21.15.52:0/2196334629 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3872 (secure 0 0 0) 0x7f273805fea0 con 0x7f27500c6cf0 2024-06-02T16:50:10.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-06-02T16:50:10.501 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2744861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2744861668},{"type":"v1","addr":"172.21.15.114:6836","nonce":2744861668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/924033327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":924033327},{"type":"v1","addr":"172.21.15.114:6837","nonce":924033327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1669936231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1669936231},{"type":"v1","addr":"172.21.15.52:6833","nonce":1669936231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1883693523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1883693523},{"type":"v1","addr":"172.21.15.52:6835","nonce":1883693523}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[]} 2024-06-02T16:50:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 28 2024-06-02T16:50:10.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.505+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 msgr2=0x7f272c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.505+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 0x7f272c0787c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2740032000 tx=0x7f2740009030 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.505+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 msgr2=0x7f27500c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.505+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f273800e480 tx=0x7f273800e940 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 shutdown_connections 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:6832/3580739334,v1:172.21.15.114:6833/3580739334] conn(0x7f272c076300 0x7f272c0787c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2750070a60 0x7f2750070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27500c6cf0 0x7f27500c7170 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 --2- 172.21.15.52:0/2196334629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2734003a50 0x7f27501525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T16:50:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 >> 172.21.15.52:0/2196334629 conn(0x7f27500b4cb0 msgr2=0x7f275006d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T16:50:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 shutdown_connections 2024-06-02T16:50:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-06-02T16:50:10.506+0000 7f2755400640 1 -- 172.21.15.52:0/2196334629 wait complete. 2024-06-02T16:50:10.523 DEBUG:tasks.cephfs.filesystem:already dead... 2024-06-02T16:50:10.524 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-02T16:50:10.524 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T16:50:10.524 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.548 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T16:50:10.548 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T16:50:10.549 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.607 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T16:50:10.608 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T16:50:10.608 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.629 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T16:50:10.629 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T16:50:10.629 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.693 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T16:50:10.694 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-02T16:50:10.694 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-02T16:50:10.694 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.747 INFO:tasks.ceph.osd.0:Stopped 2024-06-02T16:50:10.747 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-02T16:50:10.747 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.812 INFO:tasks.ceph.osd.1:Stopped 2024-06-02T16:50:10.812 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-02T16:50:10.812 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.873 INFO:tasks.ceph.osd.2:Stopped 2024-06-02T16:50:10.873 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-02T16:50:10.873 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:10.935 INFO:tasks.ceph.osd.3:Stopped 2024-06-02T16:50:10.936 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-02T16:50:10.936 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:11.003 INFO:tasks.ceph.osd.4:Stopped 2024-06-02T16:50:11.003 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-02T16:50:11.003 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:11.065 INFO:tasks.ceph.osd.5:Stopped 2024-06-02T16:50:11.065 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-02T16:50:11.065 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:11.118 INFO:tasks.ceph.osd.6:Stopped 2024-06-02T16:50:11.118 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-02T16:50:11.118 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:11.185 INFO:tasks.ceph.osd.7:Stopped 2024-06-02T16:50:11.185 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-02T16:50:11.186 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-02T16:50:11.186 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:13.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-06-02T16:50:17.288 INFO:tasks.ceph.mgr.y:Stopped 2024-06-02T16:50:17.288 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-02T16:50:17.289 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:17.363 INFO:tasks.ceph.mgr.x:Stopped 2024-06-02T16:50:17.364 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-02T16:50:17.364 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-02T16:50:17.364 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:17.404 INFO:tasks.ceph.mon.a:Stopped 2024-06-02T16:50:17.405 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-02T16:50:17.405 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:17.427 INFO:tasks.ceph.mon.b:Stopped 2024-06-02T16:50:17.427 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-02T16:50:17.427 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T16:50:17.515 INFO:tasks.ceph.mon.c:Stopped 2024-06-02T16:50:17.515 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-02T16:50:17.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-06-02T16:50:17.628 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:50:17.628 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-02T16:50:17.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:50:17.879 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-02T16:50:18.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:50:18.034 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-02T16:50:18.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-06-02T16:50:18.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:50:18.213 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-02T16:50:18.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:50:18.338 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-02T16:50:18.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:50:18.583 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-02T16:50:18.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:50:18.719 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-02T16:50:18.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:50:18.843 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-02T16:50:18.978 INFO:tasks.ceph:Archiving mon data... 2024-06-02T16:50:18.979 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/data/mon.a.tgz 2024-06-02T16:50:18.979 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-06-02T16:50:19.039 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.mVsPw9ijgY 2024-06-02T16:50:19.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.mVsPw9ijgY 2024-06-02T16:50:19.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.mVsPw9ijgY 2024-06-02T16:50:19.367 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.mVsPw9ijgY is 371KB 2024-06-02T16:50:19.476 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.mVsPw9ijgY 2024-06-02T16:50:19.534 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/data/mon.b.tgz 2024-06-02T16:50:19.535 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-06-02T16:50:19.593 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.5o2K9Vvh4B 2024-06-02T16:50:19.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5o2K9Vvh4B 2024-06-02T16:50:19.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.5o2K9Vvh4B 2024-06-02T16:50:19.947 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.5o2K9Vvh4B is 484KB 2024-06-02T16:50:20.053 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.5o2K9Vvh4B 2024-06-02T16:50:20.110 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/data/mon.c.tgz 2024-06-02T16:50:20.110 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-06-02T16:50:20.164 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.SnLiyk0YqX 2024-06-02T16:50:20.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.SnLiyk0YqX 2024-06-02T16:50:20.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.SnLiyk0YqX 2024-06-02T16:50:20.499 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.SnLiyk0YqX is 484KB 2024-06-02T16:50:20.607 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.SnLiyk0YqX 2024-06-02T16:50:20.663 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-02T16:50:20.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-02T16:50:20.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-02T16:50:20.817 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-02T16:50:20.874 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-02T16:50:20.874 INFO:tasks.ceph:Archiving crash dumps... 2024-06-02T16:50:20.876 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi052/crash 2024-06-02T16:50:20.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-02T16:50:20.970 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi114/crash 2024-06-02T16:50:20.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-02T16:50:21.061 INFO:tasks.ceph:Shutting down logrotate 2024-06-02T16:50:21.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:21.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:21.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:21.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-02T16:50:21.364 INFO:tasks.ceph:Compressing logs... 2024-06-02T16:50:21.364 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T16:50:21.372 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T16:50:21.453 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44751.log 2024-06-02T16:50:21.454 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-06-02T16:50:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2024-06-02T16:50:21.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42431.log 2024-06-02T16:50:21.456 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2024-06-02T16:50:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-02T16:50:21.457 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-06-02T16:50:21.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37382.log 2024-06-02T16:50:21.459 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-06-02T16:50:21.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42838.log 2024-06-02T16:50:21.459 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45543.log: /var/log/ceph/ceph-client.admin.42431.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-06-02T16:50:21.459 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41619.log 2024-06-02T16:50:21.460 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-06-02T16:50:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45045.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz -- 2024-06-02T16:50:21.460 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.41155.log 2024-06-02T16:50:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41409.log 2024-06-02T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41619.log.gz 2024-06-02T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-06-02T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41155.log.gz 2024-06-02T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2024-06-02T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41409.log.gz 2024-06-02T16:50:21.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37382.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-02T16:50:21.464 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-02T16:50:21.464 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37382.log.gz 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.42838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42838.log.gz 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37342.log 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37342.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37342.log.gz 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-02T16:50:21.465 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-02T16:50:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-02T16:50:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log 2024-06-02T16:50:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42857.log 2024-06-02T16:50:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41367.log 2024-06-02T16:50:21.469 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55517.log 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41367.log.gz 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53778.log 2024-06-02T16:50:21.470 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56092.log 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55517.log: /var/log/ceph/ceph-client.admin.53778.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55517.log.gz 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53778.log.gz 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-06-02T16:50:21.471 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56092.log.gz 2024-06-02T16:50:21.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37593.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-02T16:50:21.474 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2024-06-02T16:50:21.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.42857.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-02T16:50:21.474 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42857.log.gz 2024-06-02T16:50:21.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-02T16:50:21.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37429.log 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53187.log 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56881.log 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2024-06-02T16:50:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41661.log 2024-06-02T16:50:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56881.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53187.log.gz 2024-06-02T16:50:21.477 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56881.log.gz 2024-06-02T16:50:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-02T16:50:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-06-02T16:50:21.477 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41661.log.gz 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37184.log 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42512.log 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.37184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54730.log 2024-06-02T16:50:21.480 INFO:teuthology.orchestra.run.smithi052.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37184.log.gz 2024-06-02T16:50:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2024-06-02T16:50:21.481 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42512.log.gz 2024-06-02T16:50:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43252.log 2024-06-02T16:50:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.3.43252.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37429.log.gz 2024-06-02T16:50:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37633.log 2024-06-02T16:50:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37513.log 2024-06-02T16:50:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54730.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30899.log 2024-06-02T16:50:21.484 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54730.log.gz 2024-06-02T16:50:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43946.log 2024-06-02T16:50:21.484 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2024-06-02T16:50:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.30899.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30899.log.gz 2024-06-02T16:50:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-02T16:50:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.2.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46376.log 2024-06-02T16:50:21.485 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43946.log.gz 2024-06-02T16:50:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56503.log 2024-06-02T16:50:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-06-02T16:50:21.489 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46376.log.gz 2024-06-02T16:50:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56797.log 2024-06-02T16:50:21.489 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56503.log.gz 2024-06-02T16:50:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54814.log 2024-06-02T16:50:21.489 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-06-02T16:50:21.490 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0%/var/log/ceph/ceph-client.admin.37513.log: -- replaced with /var/log/ceph/ceph-client.3.43252.log.gz 2024-06-02T16:50:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-06-02T16:50:21.490 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43256.log 2024-06-02T16:50:21.490 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37633.log.gz 2024-06-02T16:50:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37553.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-06-02T16:50:21.491 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37513.log.gz 2024-06-02T16:50:21.492 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-06-02T16:50:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56797.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56797.log.gz 2024-06-02T16:50:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46166.log 2024-06-02T16:50:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2024-06-02T16:50:21.493 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54814.log.gz 2024-06-02T16:50:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53466.log 2024-06-02T16:50:21.493 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46166.log.gz 2024-06-02T16:50:21.495 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.3.43256.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 0.0% -- replaced with /var/log/ceph/ceph-client.3.43256.log.gz 2024-06-02T16:50:21.495 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-06-02T16:50:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54290.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2024-06-02T16:50:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-06-02T16:50:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2024-06-02T16:50:21.497 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53466.log.gz 2024-06-02T16:50:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42879.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-02T16:50:21.497 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-06-02T16:50:21.497 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53676.log 2024-06-02T16:50:21.497 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2024-06-02T16:50:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41069.log 2024-06-02T16:50:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2024-06-02T16:50:21.499 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53676.log.gz 2024-06-02T16:50:21.499 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-02T16:50:21.500 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41069.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41069.log.gz -5 2024-06-02T16:50:21.500 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2024-06-02T16:50:21.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-06-02T16:50:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46082.log 2024-06-02T16:50:21.502 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2024-06-02T16:50:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57091.log 2024-06-02T16:50:21.503 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2024-06-02T16:50:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41577.log 2024-06-02T16:50:21.503 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46082.log.gz 2024-06-02T16:50:21.504 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46672.log 2024-06-02T16:50:21.504 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57091.log.gz 2024-06-02T16:50:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2024-06-02T16:50:21.506 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41577.log.gz 2024-06-02T16:50:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.46672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46672.log.gz 2024-06-02T16:50:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2024-06-02T16:50:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2024-06-02T16:50:21.507 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2024-06-02T16:50:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-06-02T16:50:21.508 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-06-02T16:50:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41325.log 2024-06-02T16:50:21.509 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2024-06-02T16:50:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.37283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2024-06-02T16:50:21.510 INFO:teuthology.orchestra.run.smithi052.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-06-02T16:50:21.511 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41325.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-02T16:50:21.512 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41325.log.gz 2024-06-02T16:50:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53821.log 2024-06-02T16:50:21.513 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2024-06-02T16:50:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55821.log 2024-06-02T16:50:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53905.log 2024-06-02T16:50:21.515 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53821.log.gz 2024-06-02T16:50:21.516 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55821.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55821.log.gz 2024-06-02T16:50:21.516 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54586.log 2024-06-02T16:50:21.516 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54031.log 2024-06-02T16:50:21.517 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53905.log.gz 2024-06-02T16:50:21.518 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54586.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54586.log.gz 2024-06-02T16:50:21.518 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2024-06-02T16:50:21.519 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2024-06-02T16:50:21.519 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54031.log.gz 2024-06-02T16:50:21.520 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56335.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz -5 2024-06-02T16:50:21.520 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-06-02T16:50:21.521 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57291.log 2024-06-02T16:50:21.521 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2024-06-02T16:50:21.522 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43509.log 2024-06-02T16:50:21.522 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-06-02T16:50:21.523 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57291.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-06-02T16:50:21.524 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57291.log.gz 2024-06-02T16:50:21.524 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.43509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43509.log.gz 2024-06-02T16:50:21.524 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2024-06-02T16:50:21.525 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41535.log 2024-06-02T16:50:21.526 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42753.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2024-06-02T16:50:21.527 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46040.log 2024-06-02T16:50:21.528 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43005.log 2024-06-02T16:50:21.529 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41535.log: /var/log/ceph/ceph-client.admin.46040.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46040.log.gz 2024-06-02T16:50:21.529 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41535.log.gz 2024-06-02T16:50:21.529 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46124.log 2024-06-02T16:50:21.530 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2024-06-02T16:50:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43005.log: /var/log/ceph/ceph-client.admin.46124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46124.log.gz 2024-06-02T16:50:21.532 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41451.log 2024-06-02T16:50:21.532 INFO:teuthology.orchestra.run.smithi052.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.43005.log.gz 2024-06-02T16:50:21.532 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56671.log 2024-06-02T16:50:21.533 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53634.log: /var/log/ceph/ceph-client.admin.41451.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2024-06-02T16:50:21.534 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41451.log.gz 2024-06-02T16:50:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45956.log 2024-06-02T16:50:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-02T16:50:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56671.log: /var/log/ceph/ceph-client.admin.45956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56671.log.gz 2024-06-02T16:50:21.536 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45956.log.gz 2024-06-02T16:50:21.536 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56713.log 2024-06-02T16:50:21.537 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-02T16:50:21.538 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.56713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gz 2024-06-02T16:50:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2024-06-02T16:50:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-06-02T16:50:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.46418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2024-06-02T16:50:21.541 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gz 2024-06-02T16:50:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46292.log 2024-06-02T16:50:21.542 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-06-02T16:50:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46676.log 2024-06-02T16:50:21.546 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2024-06-02T16:50:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56923.log 2024-06-02T16:50:21.547 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46292.log.gz 2024-06-02T16:50:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2024-06-02T16:50:21.547 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46676.log.gz 2024-06-02T16:50:21.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56923.log: 89.0% 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-02T16:50:21.548 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54940.log 2024-06-02T16:50:21.548 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56923.log.gz 2024-06-02T16:50:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41842.log 2024-06-02T16:50:21.549 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2024-06-02T16:50:21.551 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54940.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-02T16:50:21.551 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54940.log.gz 2024-06-02T16:50:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42963.log 2024-06-02T16:50:21.552 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-02T16:50:21.553 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41842.log.gz 2024-06-02T16:50:21.553 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55905.log 2024-06-02T16:50:21.554 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40945.log 2024-06-02T16:50:21.554 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42963.log.gz 2024-06-02T16:50:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55905.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55905.log.gz 2024-06-02T16:50:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42175.log 2024-06-02T16:50:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40945.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40945.log.gz 2024-06-02T16:50:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2024-06-02T16:50:21.559 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55779.log 2024-06-02T16:50:21.559 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42175.log.gz 2024-06-02T16:50:21.560 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54073.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2024-06-02T16:50:21.560 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41837.log 2024-06-02T16:50:21.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40750.log 2024-06-02T16:50:21.562 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55779.log.gz 2024-06-02T16:50:21.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54456.log 2024-06-02T16:50:21.563 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41837.log.gz 2024-06-02T16:50:21.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54115.log 2024-06-02T16:50:21.564 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40750.log.gz 2024-06-02T16:50:21.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56755.log 2024-06-02T16:50:21.566 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54456.log.gz 2024-06-02T16:50:21.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53508.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54115.log.gz 2024-06-02T16:50:21.567 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-06-02T16:50:21.568 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56755.log.gz 2024-06-02T16:50:21.569 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41199.log 2024-06-02T16:50:21.570 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2024-06-02T16:50:21.570 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53508.log.gz 2024-06-02T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55737.log 2024-06-02T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2024-06-02T16:50:21.573 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-06-02T16:50:21.573 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2024-06-02T16:50:21.574 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42837.log 2024-06-02T16:50:21.574 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55737.log.gz 2024-06-02T16:50:21.575 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55989.log 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-06-02T16:50:21.576 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-06-02T16:50:21.577 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42837.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56965.log 2024-06-02T16:50:21.577 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42837.log.gz 2024-06-02T16:50:21.578 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56839.log 2024-06-02T16:50:21.579 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55989.log.gz 2024-06-02T16:50:21.580 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56965.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56965.log.gz 2024-06-02T16:50:21.580 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54544.log 2024-06-02T16:50:21.581 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56839.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56839.log.gz 2024-06-02T16:50:21.581 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 2024-06-02T16:50:21.583 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-06-02T16:50:21.583 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54544.log.gz 2024-06-02T16:50:21.584 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53372.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-02T16:50:21.584 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2024-06-02T16:50:21.585 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53037.log 2024-06-02T16:50:21.586 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-06-02T16:50:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55090.log 2024-06-02T16:50:21.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53037.log: 90.9%/var/log/ceph/ceph-client.admin.55090.log: -- replaced with /var/log/ceph/ceph-client.admin.53037.log.gz 2024-06-02T16:50:21.590 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55090.log.gz 2024-06-02T16:50:21.590 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.44961.log 2024-06-02T16:50:21.591 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54688.log 2024-06-02T16:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44961.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-06-02T16:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54688.log: /var/log/ceph/ceph-client.admin.41493.log 2024-06-02T16:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54688.log.gz 2024-06-02T16:50:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54500.log 2024-06-02T16:50:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41493.log.gz 2024-06-02T16:50:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54500.log: /var/log/ceph/ceph-client.admin.54898.log 2024-06-02T16:50:21.598 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54500.log.gz 2024-06-02T16:50:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54898.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54898.log.gz 2024-06-02T16:50:21.601 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53989.log 2024-06-02T16:50:21.603 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42515.log 2024-06-02T16:50:21.604 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53989.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53989.log.gz 2024-06-02T16:50:21.604 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54772.log 2024-06-02T16:50:21.606 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42515.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42515.log.gz 2024-06-02T16:50:21.607 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2024-06-02T16:50:21.607 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54772.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54772.log.gz 2024-06-02T16:50:21.608 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2024-06-02T16:50:21.609 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45850.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2024-06-02T16:50:21.610 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54413.log/var/log/ceph/ceph-client.admin.45417.log: 2024-06-02T16:50:21.611 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2024-06-02T16:50:21.612 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41840.log 2024-06-02T16:50:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54413.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54413.log.gz 2024-06-02T16:50:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43490.log 2024-06-02T16:50:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41840.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41840.log.gz 2024-06-02T16:50:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2024-06-02T16:50:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.43490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43490.log.gz 2024-06-02T16:50:21.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55278.log 2024-06-02T16:50:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45459.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2024-06-02T16:50:21.620 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2024-06-02T16:50:21.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.55278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55278.log.gz 2024-06-02T16:50:21.621 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44506.log 2024-06-02T16:50:21.623 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46754.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2024-06-02T16:50:21.624 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44506.log: -- /var/log/ceph/ceph-client.admin.45808.log 2024-06-02T16:50:21.625 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44506.log.gz 2024-06-02T16:50:21.625 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-06-02T16:50:21.627 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45808.log.gz 2024-06-02T16:50:21.628 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57007.log 2024-06-02T16:50:21.629 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-06-02T16:50:21.630 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2024-06-02T16:50:21.630 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57007.log.gz 2024-06-02T16:50:21.632 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44227.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2024-06-02T16:50:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55422.log 2024-06-02T16:50:21.635 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44793.log 2024-06-02T16:50:21.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55422.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55422.log.gz 2024-06-02T16:50:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-06-02T16:50:21.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44793.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44793.log.gz 2024-06-02T16:50:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55863.log 2024-06-02T16:50:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44877.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-06-02T16:50:21.640 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-02T16:50:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2024-06-02T16:50:21.642 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55863.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55863.log.gz 2024-06-02T16:50:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2024-06-02T16:50:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45087.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2024-06-02T16:50:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56419.log 2024-06-02T16:50:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56293.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2024-06-02T16:50:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45251.log 2024-06-02T16:50:21.647 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56419.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56419.log.gz 2024-06-02T16:50:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2024-06-02T16:50:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45251.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45251.log.gz 2024-06-02T16:50:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.44269.log: --verbose -- /var/log/ceph/ceph-client.admin.54371.log 2024-06-02T16:50:21.651 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2024-06-02T16:50:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56049.log 2024-06-02T16:50:21.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54371.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54371.log.gz 2024-06-02T16:50:21.654 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53863.log 2024-06-02T16:50:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56049.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56049.log.gz 2024-06-02T16:50:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42176.log 2024-06-02T16:50:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53863.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53863.log.gz 2024-06-02T16:50:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55653.log 2024-06-02T16:50:21.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42176.log.gz 2024-06-02T16:50:21.660 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-06-02T16:50:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55653.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55653.log.gz 2024-06-02T16:50:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53253.log 2024-06-02T16:50:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45003.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-06-02T16:50:21.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53253.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53253.log.gz 2024-06-02T16:50:21.666 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2024-06-02T16:50:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-06-02T16:50:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42490.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2024-06-02T16:50:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57133.log 2024-06-02T16:50:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36915.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-06-02T16:50:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2024-06-02T16:50:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57133.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57133.log.gz 2024-06-02T16:50:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43950.log 2024-06-02T16:50:21.673 INFO:teuthology.orchestra.run.smithi114.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-02T16:50:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2024-06-02T16:50:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42464.log/var/log/ceph/ceph-client.2.43950.log: 2024-06-02T16:50:21.676 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43950.log.gz 2024-06-02T16:50:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55024.log 2024-06-02T16:50:21.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42464.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42464.log.gz 2024-06-02T16:50:21.679 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.55024.log: --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-06-02T16:50:21.680 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55024.log.gz 2024-06-02T16:50:21.681 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53103.log 2024-06-02T16:50:21.682 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-06-02T16:50:21.683 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57049.log 2024-06-02T16:50:21.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53103.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53103.log.gz 2024-06-02T16:50:21.685 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.57049.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2024-06-02T16:50:21.686 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57049.log.gz 2024-06-02T16:50:21.687 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2024-06-02T16:50:21.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2024-06-02T16:50:21.689 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2024-06-02T16:50:21.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44083.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2024-06-02T16:50:21.691 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46334.log 2024-06-02T16:50:21.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57249.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2024-06-02T16:50:21.693 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2024-06-02T16:50:21.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46334.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46334.log.gz 2024-06-02T16:50:21.695 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53550.log 2024-06-02T16:50:21.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56545.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2024-06-02T16:50:21.696 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57209.log 2024-06-02T16:50:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53550.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53550.log.gz 2024-06-02T16:50:21.699 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57209.log: -- /var/log/ceph/ceph-client.admin.55695.log 2024-06-02T16:50:21.699 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57209.log.gz 2024-06-02T16:50:21.700 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41843.log 2024-06-02T16:50:21.702 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55695.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55695.log.gz 2024-06-02T16:50:21.703 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41843.log: /var/log/ceph/ceph-client.admin.54982.log 2024-06-02T16:50:21.703 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41843.log.gz 2024-06-02T16:50:21.704 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42178.log 2024-06-02T16:50:21.706 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54982.log.gz 2024-06-02T16:50:21.706 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2024-06-02T16:50:21.707 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42178.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42178.log.gz 2024-06-02T16:50:21.708 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-06-02T16:50:21.709 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-06-02T16:50:21.710 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45627.log: /var/log/ceph/ceph-client.admin.42170.log 2024-06-02T16:50:21.711 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-06-02T16:50:21.712 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-06-02T16:50:21.713 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42170.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gz 2024-06-02T16:50:21.714 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45171.log: -- /var/log/ceph/ceph-client.admin.46484.log 2024-06-02T16:50:21.715 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-06-02T16:50:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2024-06-02T16:50:21.717 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46484.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46484.log.gz 2024-06-02T16:50:21.718 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-06-02T16:50:21.719 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2024-06-02T16:50:21.720 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52971.log 2024-06-02T16:50:21.721 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-06-02T16:50:21.722 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-06-02T16:50:21.724 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52971.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52971.log.gz 2024-06-02T16:50:21.724 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-06-02T16:50:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.44143.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-06-02T16:50:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:gzip 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-06-02T16:50:21.728 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42161.log 2024-06-02T16:50:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2024-06-02T16:50:21.731 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42161.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42161.log.gz 2024-06-02T16:50:21.732 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.56587.log: --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2024-06-02T16:50:21.732 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2024-06-02T16:50:21.733 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-06-02T16:50:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44584.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2024-06-02T16:50:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42711.log: /var/log/ceph/ceph-client.admin.53718.log 2024-06-02T16:50:21.736 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-06-02T16:50:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55611.log 2024-06-02T16:50:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2024-06-02T16:50:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-06-02T16:50:21.740 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55611.log.gz 2024-06-02T16:50:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40849.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-06-02T16:50:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55947.log 2024-06-02T16:50:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56461.log 2024-06-02T16:50:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55947.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55947.log.gz 2024-06-02T16:50:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2024-06-02T16:50:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56461.log.gz 2024-06-02T16:50:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53947.log 2024-06-02T16:50:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2024-06-02T16:50:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44185.log 2024-06-02T16:50:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53947.log.gz 2024-06-02T16:50:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56377.log 2024-06-02T16:50:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44185.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44185.log.gz 2024-06-02T16:50:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56377.log.gz 2024-06-02T16:50:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-06-02T16:50:21.756 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42179.log 2024-06-02T16:50:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44674.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-06-02T16:50:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53592.log 2024-06-02T16:50:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42179.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42179.log.gz 2024-06-02T16:50:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53592.log: -- /var/log/ceph/ceph-client.admin.41283.log 2024-06-02T16:50:21.761 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53592.log.gz 2024-06-02T16:50:21.762 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2024-06-02T16:50:21.763 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41283.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41283.log.gz 2024-06-02T16:50:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41241.log 2024-06-02T16:50:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45713.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2024-06-02T16:50:21.766 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54210.log 2024-06-02T16:50:21.767 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41241.log.gz 2024-06-02T16:50:21.768 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2024-06-02T16:50:21.769 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54210.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54210.log.gz 2024-06-02T16:50:21.770 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55282.log 2024-06-02T16:50:21.771 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45585.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-06-02T16:50:21.772 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2024-06-02T16:50:21.772 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.55282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55282.log.gz 2024-06-02T16:50:21.774 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2024-06-02T16:50:21.999 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-02T16:50:22.101 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-02T16:50:22.143 INFO:teuthology.orchestra.run.smithi052.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-02T16:50:22.178 INFO:teuthology.orchestra.run.smithi114.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-02T16:50:22.199 INFO:teuthology.orchestra.run.smithi114.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-02T16:50:22.268 INFO:teuthology.orchestra.run.smithi114.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-02T16:50:22.462 INFO:teuthology.orchestra.run.smithi052.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-02T16:50:22.518 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-02T16:50:22.568 INFO:teuthology.orchestra.run.smithi114.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-02T16:50:24.384 INFO:teuthology.orchestra.run.smithi114.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-06-02T16:50:24.388 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-06-02T16:50:24.389 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m2.963s 2024-06-02T16:50:24.389 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m6.229s 2024-06-02T16:50:24.389 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.583s 2024-06-02T16:50:44.013 INFO:teuthology.orchestra.run.smithi052.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-06-02T16:50:44.017 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-06-02T16:50:44.017 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m22.596s 2024-06-02T16:50:44.017 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m24.300s 2024-06-02T16:50:44.018 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m2.442s 2024-06-02T16:50:44.019 INFO:tasks.ceph:Archiving logs... 2024-06-02T16:50:44.019 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi052/log 2024-06-02T16:50:44.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T16:50:47.459 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi114/log 2024-06-02T16:50:47.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T16:50:48.336 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T16:50:48.345 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T16:50:48.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T16:50:48.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T16:50:48.488 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T16:50:48.497 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T16:50:48.498 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T16:50:48.506 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T16:50:48.546 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-06-02T16:50:48.554 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T16:50:48.554 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-06-02T16:50:48.554 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv01.front.sepia.ceph.com 3 6 377 65 +1372us[+1448us] +/- 49ms 2024-06-02T16:50:48.554 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +486us[ +486us] +/- 51ms 2024-06-02T16:50:48.554 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -3119us[-3119us] +/- 85ms 2024-06-02T16:50:48.555 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:50:48.557 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +1360us[+1367us] +/- 50ms 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +495us[ +502us] +/- 52ms 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -3183us[-3177us] +/- 84ms 2024-06-02T16:50:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T16:50:48.569 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T16:50:48.579 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T16:50:48.579 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T16:50:48.615 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T16:50:48.823 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T16:50:48.969 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T16:50:49.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:50:49.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T16:50:49.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:50:49.151 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T16:50:49.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T16:50:49.197 INFO:teuthology.task.internal:Duration was 902.707656 seconds 2024-06-02T16:50:49.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T16:50:49.249 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T16:50:49.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T16:50:49.257 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T16:50:49.385 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T16:50:49.412 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T16:50:49.747 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T16:50:49.747 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-06-02T16:50:49.747 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T16:50:49.812 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-06-02T16:50:49.813 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T16:50:49.891 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T16:50:49.892 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T16:50:49.900 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T16:50:49.987 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T16:50:49.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T16:50:49.994 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T16:50:50.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T16:50:50.190 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T16:50:50.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T16:50:50.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T16:50:50.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T16:50:50.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T16:50:50.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T16:50:50.478 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-06-02T16:50:50.479 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-06-02T16:50:50.522 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T16:50:50.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:50:50.572 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T16:50:50.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T16:50:50.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T16:50:50.638 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T16:50:50.639 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi052 2024-06-02T16:50:50.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T16:50:50.732 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-22_20:24:16-fs-main-distro-default-smithi/7720992/remote/smithi114 2024-06-02T16:50:50.732 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T16:50:50.828 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T16:50:50.829 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T16:50:50.837 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T16:50:50.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T16:50:50.902 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T16:50:50.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T16:50:50.935 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T16:50:50.935 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T16:50:50.943 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T16:50:50.994 INFO:teuthology.orchestra.run.smithi052.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 16:50 /home/ubuntu/cephtest 2024-06-02T16:50:50.998 INFO:teuthology.orchestra.run.smithi114.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 16:50 /home/ubuntu/cephtest 2024-06-02T16:50:51.001 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T16:50:51.010 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T16:50:51.093 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 client.1-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 902.7076561450958 failure_reason: 'Test failure: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5527bf1ea5c74397a76be8aadf00de59 status: fail success: false 2024-06-02T16:50:51.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T16:50:51.173 INFO:teuthology.run:FAIL